Dec 05 15:13:18 user nova-compute[75080]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75080) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75080) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75080) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Dec 05 15:13:18 user nova-compute[75080]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:13:18 user nova-compute[75080]: INFO nova.virt.driver [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] Loading compute driver 'libvirt.LibvirtDriver'
Dec 05 15:13:18 user nova-compute[75080]: INFO nova.compute.provider_config [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] Acquiring lock "singleton_lock" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] Acquired lock "singleton_lock" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] Releasing lock "singleton_lock" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] Full set of CONF: {{(pid=75080) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] ******************************************************************************** {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] Configuration options gathered from: {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] ================================================================================ {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] allow_resize_to_same_host      = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] arq_binding_timeout            = 300 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] backdoor_port                  = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] backdoor_socket                = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] block_device_allocate_retries  = 300 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] block_device_allocate_retries_interval = 5 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cert                           = self.pem {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] compute_monitors               = [] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] config_dir                     = [] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] config_drive_format            = iso9660 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] config_source                  = [] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] console_host                   = user {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] control_exchange               = nova {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cpu_allocation_ratio           = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] daemon                         = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] debug                          = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] default_access_ip_network_name = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] default_availability_zone      = nova {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] default_ephemeral_format       = ext4 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] default_green_pool_size        = 1000 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] default_schedule_zone          = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] disk_allocation_ratio          = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] enable_new_services            = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] enabled_ssl_apis               = [] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] flat_injected                  = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] force_config_drive             = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] force_raw_images               = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] graceful_shutdown_timeout      = 5 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] heal_instance_info_cache_interval = 60 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] host                           = user {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] instance_build_timeout         = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] instance_delete_interval       = 300 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] instance_name_template         = instance-%08x {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] instance_usage_audit           = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] instance_usage_audit_period    = month {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] internal_service_availability_zone = internal {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] key                            = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] live_migration_retry_count     = 30 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] log_config_append              = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] log_dir                        = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] log_file                       = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] log_options                    = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] log_rotate_interval            = 1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] log_rotate_interval_type       = days {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] log_rotation_type              = none {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] long_rpc_timeout               = 1800 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] max_concurrent_builds          = 10 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] max_concurrent_live_migrations = 1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] max_concurrent_snapshots       = 5 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] max_local_block_devices        = 3 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] max_logfile_count              = 30 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] max_logfile_size_mb            = 200 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] maximum_instance_delete_attempts = 5 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] metadata_listen                = 0.0.0.0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] metadata_listen_port           = 8775 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] metadata_workers               = 3 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] migrate_max_retries            = -1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] mkisofs_cmd                    = genisoimage {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] my_ip                          = 10.0.0.210 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] network_allocate_retries       = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] osapi_compute_listen_port      = 8774 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] osapi_compute_unique_server_name_scope =  {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] osapi_compute_workers          = 3 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] password_length                = 12 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] periodic_enable                = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] periodic_fuzzy_delay           = 60 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] pointer_model                  = ps2mouse {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] preallocate_images             = none {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] publish_errors                 = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] pybasedir                      = /opt/stack/nova {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] ram_allocation_ratio           = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] rate_limit_burst               = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] rate_limit_except_level        = CRITICAL {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] rate_limit_interval            = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] reboot_timeout                 = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] reclaim_instance_interval      = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] record                         = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] reimage_timeout_per_gb         = 60 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] report_interval                = 120 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] rescue_timeout                 = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] reserved_host_cpus             = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] reserved_host_disk_mb          = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] reserved_host_memory_mb        = 512 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] reserved_huge_pages            = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] resize_confirm_window          = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] resize_fs_using_block_device   = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] resume_guests_state_on_host_boot = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] rpc_response_timeout           = 60 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] run_external_periodic_tasks    = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] running_deleted_instance_action = reap {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] running_deleted_instance_timeout = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] scheduler_instance_sync_interval = 120 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] service_down_time              = 720 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] servicegroup_driver            = db {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] shelved_offload_time           = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] shelved_poll_interval          = 3600 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] shutdown_timeout               = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] source_is_ipv6                 = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] ssl_only                       = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] state_path                     = /opt/stack/data/nova {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] sync_power_state_interval      = 600 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] sync_power_state_pool_size     = 1000 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] syslog_log_facility            = LOG_USER {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] tempdir                        = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] timeout_nbd                    = 10 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] transport_url                  = **** {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] update_resources_interval      = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] use_cow_images                 = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] use_eventlog                   = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] use_journal                    = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] use_json                       = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] use_rootwrap_daemon            = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] use_stderr                     = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] use_syslog                     = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vcpu_pin_set                   = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vif_plugging_is_fatal          = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vif_plugging_timeout           = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] virt_mkfs                      = [] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] volume_usage_poll_interval     = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] watch_log_file                 = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] web                            = /usr/share/spice-html5 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_concurrency.disable_process_locking = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api.auth_strategy              = keystone {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api.compute_link_prefix        = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api.dhcp_domain                = novalocal {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api.enable_instance_password   = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api.glance_link_prefix         = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api.instance_list_per_project_cells = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api.list_records_by_skipping_down_cells = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api.local_metadata_per_cell    = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api.max_limit                  = 1000 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api.metadata_cache_expiration  = 15 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api.neutron_default_tenant_id  = default {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api.use_forwarded_for          = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api.use_neutron_default_nets   = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api.vendordata_dynamic_targets = [] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api.vendordata_jsonfile_path   = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cache.backend_argument         = **** {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cache.config_prefix            = cache.oslo {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cache.dead_timeout             = 60.0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cache.debug_cache_backend      = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cache.enable_retry_client      = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cache.enable_socket_keepalive  = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cache.enabled                  = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cache.expiration_time          = 600 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cache.hashclient_retry_attempts = 2 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cache.memcache_dead_retry      = 300 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cache.memcache_password        =  {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cache.memcache_sasl_enabled    = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cache.memcache_username        =  {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cache.proxies                  = [] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cache.retry_attempts           = 2 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cache.retry_delay              = 0.0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cache.socket_keepalive_count   = 1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cache.socket_keepalive_idle    = 1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cache.socket_keepalive_interval = 1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cache.tls_allowed_ciphers      = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cache.tls_cafile               = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cache.tls_certfile             = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cache.tls_enabled              = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cache.tls_keyfile              = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cinder.auth_section            = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cinder.auth_type               = password {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cinder.cafile                  = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cinder.certfile                = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cinder.collect_timing          = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cinder.cross_az_attach         = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cinder.debug                   = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cinder.endpoint_template       = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cinder.http_retries            = 3 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cinder.insecure                = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cinder.keyfile                 = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cinder.os_region_name          = RegionOne {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cinder.split_loggers           = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cinder.timeout                 = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] compute.cpu_dedicated_set      = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] compute.cpu_shared_set         = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] compute.image_type_exclude_list = [] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] compute.resource_provider_association_refresh = 300 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] compute.shutdown_retry_interval = 10 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] conductor.workers              = 3 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] console.allowed_origins        = [] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] console.ssl_ciphers            = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] console.ssl_minimum_version    = default {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] consoleauth.token_ttl          = 600 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cyborg.cafile                  = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cyborg.certfile                = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cyborg.collect_timing          = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cyborg.connect_retries         = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cyborg.connect_retry_delay     = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cyborg.endpoint_override       = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cyborg.insecure                = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cyborg.keyfile                 = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cyborg.max_version             = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cyborg.min_version             = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cyborg.region_name             = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cyborg.service_name            = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cyborg.service_type            = accelerator {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cyborg.split_loggers           = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cyborg.status_code_retries     = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cyborg.status_code_retry_delay = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cyborg.timeout                 = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] cyborg.version                 = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] database.backend               = sqlalchemy {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] database.connection            = **** {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] database.connection_debug      = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] database.connection_parameters =  {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] database.connection_recycle_time = 3600 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] database.connection_trace      = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] database.db_inc_retry_interval = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] database.db_max_retries        = 20 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] database.db_max_retry_interval = 10 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] database.db_retry_interval     = 1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] database.max_overflow          = 50 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] database.max_pool_size         = 5 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] database.max_retries           = 10 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] database.mysql_wsrep_sync_wait = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] database.pool_timeout          = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] database.retry_interval        = 10 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] database.slave_connection      = **** {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] database.sqlite_synchronous    = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api_database.backend           = sqlalchemy {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api_database.connection        = **** {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api_database.connection_debug  = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api_database.connection_parameters =  {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api_database.connection_recycle_time = 3600 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api_database.connection_trace  = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api_database.db_inc_retry_interval = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api_database.db_max_retries    = 20 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api_database.db_max_retry_interval = 10 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api_database.db_retry_interval = 1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api_database.max_overflow      = 50 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api_database.max_pool_size     = 5 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api_database.max_retries       = 10 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api_database.pool_timeout      = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api_database.retry_interval    = 10 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api_database.slave_connection  = **** {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] api_database.sqlite_synchronous = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] devices.enabled_mdev_types     = [] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] ephemeral_storage_encryption.enabled = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] glance.api_servers             = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] glance.cafile                  = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] glance.certfile                = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] glance.collect_timing          = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] glance.connect_retries         = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] glance.connect_retry_delay     = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] glance.debug                   = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] glance.default_trusted_certificate_ids = [] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] glance.enable_certificate_validation = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] glance.enable_rbd_download     = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] glance.endpoint_override       = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] glance.insecure                = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] glance.keyfile                 = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] glance.max_version             = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] glance.min_version             = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] glance.num_retries             = 3 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] glance.rbd_ceph_conf           =  {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] glance.rbd_connect_timeout     = 5 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] glance.rbd_pool                =  {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] glance.rbd_user                =  {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] glance.region_name             = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] glance.service_name            = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] glance.service_type            = image {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] glance.split_loggers           = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] glance.status_code_retries     = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] glance.status_code_retry_delay = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] glance.timeout                 = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] glance.verify_glance_signatures = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] glance.version                 = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] guestfs.debug                  = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] hyperv.config_drive_cdrom      = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] hyperv.config_drive_inject_password = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] hyperv.enable_remotefx         = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] hyperv.instances_path_share    =  {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] hyperv.limit_cpu_features      = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] hyperv.use_multipath_io        = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] hyperv.vswitch_name            = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] mks.enabled                    = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] image_cache.manager_interval   = 2400 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] image_cache.precache_concurrency = 1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] image_cache.remove_unused_base_images = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] image_cache.subdirectory_name  = _base {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] ironic.api_max_retries         = 60 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] ironic.api_retry_interval      = 2 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] ironic.auth_section            = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] ironic.auth_type               = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] ironic.cafile                  = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] ironic.certfile                = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] ironic.collect_timing          = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] ironic.conductor_group         = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] ironic.connect_retries         = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] ironic.connect_retry_delay     = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] ironic.endpoint_override       = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] ironic.insecure                = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] ironic.keyfile                 = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] ironic.max_version             = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] ironic.min_version             = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] ironic.peer_list               = [] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] ironic.region_name             = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] ironic.serial_console_state_timeout = 10 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] ironic.service_name            = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] ironic.service_type            = baremetal {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] ironic.split_loggers           = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] ironic.status_code_retries     = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] ironic.status_code_retry_delay = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] ironic.timeout                 = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] ironic.version                 = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] key_manager.fixed_key          = **** {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] barbican.barbican_api_version  = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] barbican.barbican_endpoint     = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] barbican.barbican_endpoint_type = public {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] barbican.barbican_region_name  = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] barbican.cafile                = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] barbican.certfile              = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] barbican.collect_timing        = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] barbican.insecure              = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] barbican.keyfile               = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] barbican.number_of_retries     = 60 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] barbican.retry_delay           = 1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] barbican.send_service_user_token = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] barbican.split_loggers         = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] barbican.timeout               = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] barbican.verify_ssl            = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] barbican.verify_ssl_path       = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] barbican_service_user.auth_section = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] barbican_service_user.auth_type = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] barbican_service_user.cafile   = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] barbican_service_user.certfile = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] barbican_service_user.collect_timing = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] barbican_service_user.insecure = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] barbican_service_user.keyfile  = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] barbican_service_user.split_loggers = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] barbican_service_user.timeout  = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vault.approle_role_id          = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vault.approle_secret_id        = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vault.cafile                   = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vault.certfile                 = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vault.collect_timing           = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vault.insecure                 = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vault.keyfile                  = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vault.kv_mountpoint            = secret {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vault.kv_path                  = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vault.kv_version               = 2 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vault.namespace                = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vault.root_token_id            = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vault.split_loggers            = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vault.ssl_ca_crt_file          = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vault.timeout                  = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vault.use_ssl                  = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] keystone.auth_section          = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] keystone.auth_type             = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] keystone.cafile                = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] keystone.certfile              = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] keystone.collect_timing        = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] keystone.connect_retries       = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] keystone.connect_retry_delay   = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] keystone.endpoint_override     = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] keystone.insecure              = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] keystone.keyfile               = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] keystone.max_version           = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] keystone.min_version           = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] keystone.region_name           = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] keystone.service_name          = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] keystone.service_type          = identity {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] keystone.split_loggers         = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] keystone.status_code_retries   = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] keystone.status_code_retry_delay = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] keystone.timeout               = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] keystone.version               = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.connection_uri         =  {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.cpu_mode               = custom {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: WARNING oslo_config.cfg [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.cpu_power_governor_high = performance {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.cpu_power_management   = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.device_detach_attempts = 8 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.device_detach_timeout  = 20 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.disk_cachemodes        = [] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.disk_prefix            = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.enabled_perf_events    = [] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.file_backed_memory     = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.gid_maps               = [] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.hw_disk_discard        = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.hw_machine_type        = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.images_rbd_pool        = rbd {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.images_type            = default {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.images_volume_group    = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.inject_key             = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.inject_partition       = -2 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.inject_password        = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.iscsi_iface            = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.iser_use_multipath     = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.live_migration_downtime = 500 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.live_migration_inbound_addr = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.live_migration_scheme  = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.live_migration_timeout_action = abort {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.live_migration_tunnelled = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: WARNING oslo_config.cfg [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Dec 05 15:13:18 user nova-compute[75080]: live_migration_uri is deprecated for removal in favor of two other options that
Dec 05 15:13:18 user nova-compute[75080]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Dec 05 15:13:18 user nova-compute[75080]: and ``live_migration_inbound_addr`` respectively.
Dec 05 15:13:18 user nova-compute[75080]: ).  Its value may be silently ignored in the future.
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.live_migration_with_native_tls = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.max_queues             = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.migration_inbound_addr = 10.0.0.210 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.nfs_mount_options      = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.num_pcie_ports         = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.pmem_namespaces        = [] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.quobyte_client_cfg     = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.rbd_secret_uuid        = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.rbd_user               = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.rescue_image_id        = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.rescue_kernel_id       = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.rx_queue_size          = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.smbfs_mount_options    =  {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.snapshot_compression   = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.snapshot_image_format  = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.sparse_logical_volumes = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.swtpm_enabled          = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.swtpm_group            = tss {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.swtpm_user             = tss {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.sysinfo_serial         = unique {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.tb_cache_size          = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.tx_queue_size          = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.uid_maps               = [] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.use_virtio_for_bridges = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.virt_type              = kvm {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.volume_clear           = zero {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.volume_clear_size      = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.volume_use_multipath   = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.vzstorage_cache_path   = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] neutron.auth_section           = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] neutron.auth_type              = password {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] neutron.cafile                 = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] neutron.certfile               = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] neutron.collect_timing         = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] neutron.connect_retries        = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] neutron.connect_retry_delay    = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] neutron.default_floating_pool  = public {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] neutron.endpoint_override      = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] neutron.extension_sync_interval = 600 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] neutron.http_retries           = 3 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] neutron.insecure               = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] neutron.keyfile                = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] neutron.max_version            = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] neutron.min_version            = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] neutron.ovs_bridge             = br-int {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] neutron.physnets               = [] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] neutron.region_name            = RegionOne {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] neutron.service_metadata_proxy = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] neutron.service_name           = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] neutron.service_type           = network {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] neutron.split_loggers          = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] neutron.status_code_retries    = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] neutron.status_code_retry_delay = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] neutron.timeout                = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] neutron.version                = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] notifications.bdms_in_notifications = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] notifications.default_level    = INFO {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] notifications.notification_format = unversioned {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] notifications.notify_on_state_change = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] pci.alias                      = [] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] pci.device_spec                = [] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] pci.report_in_placement        = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] placement.auth_section         = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] placement.auth_type            = password {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] placement.cafile               = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] placement.certfile             = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] placement.collect_timing       = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] placement.connect_retries      = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] placement.connect_retry_delay  = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] placement.default_domain_id    = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] placement.default_domain_name  = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] placement.domain_id            = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] placement.domain_name          = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] placement.endpoint_override    = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] placement.insecure             = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] placement.keyfile              = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] placement.max_version          = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] placement.min_version          = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] placement.password             = **** {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] placement.project_domain_id    = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] placement.project_domain_name  = Default {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] placement.project_id           = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] placement.project_name         = service {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] placement.region_name          = RegionOne {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] placement.service_name         = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] placement.service_type         = placement {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] placement.split_loggers        = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] placement.status_code_retries  = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] placement.status_code_retry_delay = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] placement.system_scope         = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] placement.timeout              = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] placement.trust_id             = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] placement.user_domain_id       = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] placement.user_domain_name     = Default {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] placement.user_id              = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] placement.username             = placement {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] placement.version              = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] quota.cores                    = 20 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] quota.count_usage_from_placement = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] quota.injected_file_content_bytes = 10240 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] quota.injected_file_path_length = 255 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] quota.injected_files           = 5 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] quota.instances                = 10 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] quota.key_pairs                = 100 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] quota.metadata_items           = 128 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] quota.ram                      = 51200 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] quota.recheck_quota            = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] quota.server_group_members     = 10 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] quota.server_groups            = 10 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] rdp.enabled                    = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] scheduler.image_metadata_prefilter = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] scheduler.max_attempts         = 3 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] scheduler.max_placement_results = 1000 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] scheduler.workers              = 3 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] filter_scheduler.host_subset_size = 1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] filter_scheduler.isolated_hosts = [] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] filter_scheduler.isolated_images = [] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] filter_scheduler.pci_in_placement = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] filter_scheduler.track_instance_changes = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] metrics.required               = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] metrics.weight_multiplier      = 1.0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] metrics.weight_setting         = [] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] serial_console.enabled         = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] serial_console.port_range      = 10000:20000 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] serial_console.serialproxy_port = 6083 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] service_user.auth_section      = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] service_user.auth_type         = password {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] service_user.cafile            = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] service_user.certfile          = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] service_user.collect_timing    = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] service_user.insecure          = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] service_user.keyfile           = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] service_user.send_service_user_token = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] service_user.split_loggers     = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] service_user.timeout           = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] spice.agent_enabled            = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] spice.enabled                  = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] spice.html5proxy_port          = 6082 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] spice.image_compression        = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] spice.jpeg_compression         = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] spice.playback_compression     = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] spice.server_listen            = 127.0.0.1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] spice.streaming_mode           = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] spice.zlib_compression         = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] upgrade_levels.baseapi         = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] upgrade_levels.compute         = auto {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] upgrade_levels.conductor       = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] upgrade_levels.scheduler       = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vendordata_dynamic_auth.cafile = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vendordata_dynamic_auth.certfile = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vendordata_dynamic_auth.insecure = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vendordata_dynamic_auth.timeout = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vmware.api_retry_count         = 10 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vmware.ca_file                 = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vmware.cache_prefix            = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vmware.cluster_name            = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vmware.connection_pool_size    = 10 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vmware.console_delay_seconds   = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vmware.datastore_regex         = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vmware.host_ip                 = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vmware.host_password           = **** {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vmware.host_port               = 443 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vmware.host_username           = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vmware.insecure                = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vmware.integration_bridge      = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vmware.maximum_objects         = 100 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vmware.pbm_default_policy      = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vmware.pbm_enabled             = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vmware.pbm_wsdl_location       = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vmware.serial_port_proxy_uri   = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vmware.serial_port_service_uri = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vmware.task_poll_interval      = 0.5 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vmware.use_linked_clone        = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vmware.vnc_keymap              = en-us {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vmware.vnc_port                = 5900 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vmware.vnc_port_total          = 10000 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vnc.auth_schemes               = ['none'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vnc.enabled                    = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vnc.novncproxy_port            = 6080 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vnc.vencrypt_ca_certs          = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vnc.vencrypt_client_cert       = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vnc.vencrypt_client_key        = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] workarounds.disable_rootwrap   = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] workarounds.enable_numa_live_migration = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] workarounds.libvirt_disable_apic = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] wsgi.client_socket_timeout     = 900 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] wsgi.default_pool_size         = 1000 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] wsgi.keep_alive                = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] wsgi.max_header_line           = 16384 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] wsgi.ssl_ca_file               = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] wsgi.ssl_cert_file             = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] wsgi.ssl_key_file              = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] wsgi.tcp_keepidle              = 600 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] zvm.ca_file                    = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] zvm.cloud_connector_url        = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] zvm.reachable_timeout          = 300 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_policy.enforce_new_defaults = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_policy.enforce_scope      = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_policy.policy_default_rule = default {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] profiler.connection_string     = messaging:// {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] profiler.enabled               = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] profiler.es_doc_type           = notification {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] profiler.es_scroll_size        = 10000 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] profiler.es_scroll_time        = 2m {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] profiler.filter_error_trace    = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] profiler.hmac_keys             = **** {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] profiler.sentinel_service_name = mymaster {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] profiler.socket_timeout        = 0.1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] profiler.trace_requests        = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:18 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] profiler.trace_sqlalchemy      = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] profiler_jaeger.process_tags   = {} {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] profiler_jaeger.service_name_prefix = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] profiler_otlp.service_name_prefix = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] remote_debug.host              = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] remote_debug.port              = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_notifications.retry = -1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_limit.auth_section        = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_limit.auth_type           = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_limit.cafile              = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_limit.certfile            = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_limit.collect_timing      = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_limit.connect_retries     = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_limit.connect_retry_delay = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_limit.endpoint_id         = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_limit.endpoint_override   = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_limit.insecure            = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_limit.keyfile             = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_limit.max_version         = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_limit.min_version         = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_limit.region_name         = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_limit.service_name        = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_limit.service_type        = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_limit.split_loggers       = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_limit.status_code_retries = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_limit.status_code_retry_delay = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_limit.timeout             = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_limit.valid_interfaces    = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_limit.version             = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_reports.file_event_handler = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] oslo_reports.log_dir           = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vif_plug_ovs_privileged.group  = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] vif_plug_ovs_privileged.user   = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] os_vif_ovs.isolate_vif         = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] os_brick.lock_path             = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] privsep_osbrick.capabilities   = [21] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] privsep_osbrick.group          = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] privsep_osbrick.helper_command = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] privsep_osbrick.user           = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] nova_sys_admin.group           = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] nova_sys_admin.helper_command  = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] nova_sys_admin.user            = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG oslo_service.service [None req-d08b3599-a384-4052-9076-2bbcc1968ee1 None None] ******************************************************************************** {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Dec 05 15:13:19 user nova-compute[75080]: INFO nova.service [-] Starting compute node (version 0.0.0)
Dec 05 15:13:19 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Connecting to libvirt: qemu:///system {{(pid=75080) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f666e176560> {{(pid=75080) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}}
Dec 05 15:13:19 user nova-compute[75080]: libvirt:  error : internal error: could not initialize domain event timer
Dec 05 15:13:19 user nova-compute[75080]: WARNING nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Dec 05 15:13:19 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f666e176560> {{(pid=75080) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Starting native event thread {{(pid=75080) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Starting green dispatch thread {{(pid=75080) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}}
Dec 05 15:13:19 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Starting connection event dispatch thread {{(pid=75080) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Dec 05 15:13:19 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Connection event '1' reason 'None'
Dec 05 15:13:19 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Dec 05 15:13:19 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.mount [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Initialising _HostMountState generation 0 {{(pid=75080) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Dec 05 15:13:26 user nova-compute[75080]: INFO nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Libvirt host capabilities <capabilities>
Dec 05 15:13:26 user nova-compute[75080]:   <host>
Dec 05 15:13:26 user nova-compute[75080]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Dec 05 15:13:26 user nova-compute[75080]:     <cpu>
Dec 05 15:13:26 user nova-compute[75080]:       <arch>x86_64</arch>
Dec 05 15:13:26 user nova-compute[75080]:       <model>IvyBridge-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <vendor>Intel</vendor>
Dec 05 15:13:26 user nova-compute[75080]:       <microcode version='1070'/>
Dec 05 15:13:26 user nova-compute[75080]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Dec 05 15:13:26 user nova-compute[75080]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature name='ss'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature name='vmx'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature name='pcid'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature name='osxsave'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature name='hypervisor'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature name='arat'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature name='tsc_adjust'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature name='md-clear'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature name='stibp'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature name='arch-capabilities'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature name='ssbd'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature name='invtsc'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature name='rsba'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature name='skip-l1dfl-vmentry'/>
Dec 05 15:13:26 user nova-compute[75080]:       <pages unit='KiB' size='4'/>
Dec 05 15:13:26 user nova-compute[75080]:       <pages unit='KiB' size='2048'/>
Dec 05 15:13:26 user nova-compute[75080]:     </cpu>
Dec 05 15:13:26 user nova-compute[75080]:     <power_management>
Dec 05 15:13:26 user nova-compute[75080]:       <suspend_mem/>
Dec 05 15:13:26 user nova-compute[75080]:       <suspend_disk/>
Dec 05 15:13:26 user nova-compute[75080]:       <suspend_hybrid/>
Dec 05 15:13:26 user nova-compute[75080]:     </power_management>
Dec 05 15:13:26 user nova-compute[75080]:     <iommu support='no'/>
Dec 05 15:13:26 user nova-compute[75080]:     <migration_features>
Dec 05 15:13:26 user nova-compute[75080]:       <live/>
Dec 05 15:13:26 user nova-compute[75080]:       <uri_transports>
Dec 05 15:13:26 user nova-compute[75080]:         <uri_transport>tcp</uri_transport>
Dec 05 15:13:26 user nova-compute[75080]:         <uri_transport>rdma</uri_transport>
Dec 05 15:13:26 user nova-compute[75080]:       </uri_transports>
Dec 05 15:13:26 user nova-compute[75080]:     </migration_features>
Dec 05 15:13:26 user nova-compute[75080]:     <topology>
Dec 05 15:13:26 user nova-compute[75080]:       <cells num='2'>
Dec 05 15:13:26 user nova-compute[75080]:         <cell id='0'>
Dec 05 15:13:26 user nova-compute[75080]:           <memory unit='KiB'>8189224</memory>
Dec 05 15:13:26 user nova-compute[75080]:           <pages unit='KiB' size='4'>2047306</pages>
Dec 05 15:13:26 user nova-compute[75080]:           <pages unit='KiB' size='2048'>0</pages>
Dec 05 15:13:26 user nova-compute[75080]:           <distances>
Dec 05 15:13:26 user nova-compute[75080]:             <sibling id='0' value='10'/>
Dec 05 15:13:26 user nova-compute[75080]:             <sibling id='1' value='20'/>
Dec 05 15:13:26 user nova-compute[75080]:           </distances>
Dec 05 15:13:26 user nova-compute[75080]:           <cpus num='6'>
Dec 05 15:13:26 user nova-compute[75080]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Dec 05 15:13:26 user nova-compute[75080]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Dec 05 15:13:26 user nova-compute[75080]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Dec 05 15:13:26 user nova-compute[75080]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Dec 05 15:13:26 user nova-compute[75080]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Dec 05 15:13:26 user nova-compute[75080]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Dec 05 15:13:26 user nova-compute[75080]:           </cpus>
Dec 05 15:13:26 user nova-compute[75080]:         </cell>
Dec 05 15:13:26 user nova-compute[75080]:         <cell id='1'>
Dec 05 15:13:26 user nova-compute[75080]:           <memory unit='KiB'>8206460</memory>
Dec 05 15:13:26 user nova-compute[75080]:           <pages unit='KiB' size='4'>2051615</pages>
Dec 05 15:13:26 user nova-compute[75080]:           <pages unit='KiB' size='2048'>0</pages>
Dec 05 15:13:26 user nova-compute[75080]:           <distances>
Dec 05 15:13:26 user nova-compute[75080]:             <sibling id='0' value='20'/>
Dec 05 15:13:26 user nova-compute[75080]:             <sibling id='1' value='10'/>
Dec 05 15:13:26 user nova-compute[75080]:           </distances>
Dec 05 15:13:26 user nova-compute[75080]:           <cpus num='6'>
Dec 05 15:13:26 user nova-compute[75080]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Dec 05 15:13:26 user nova-compute[75080]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Dec 05 15:13:26 user nova-compute[75080]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Dec 05 15:13:26 user nova-compute[75080]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Dec 05 15:13:26 user nova-compute[75080]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Dec 05 15:13:26 user nova-compute[75080]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Dec 05 15:13:26 user nova-compute[75080]:           </cpus>
Dec 05 15:13:26 user nova-compute[75080]:         </cell>
Dec 05 15:13:26 user nova-compute[75080]:       </cells>
Dec 05 15:13:26 user nova-compute[75080]:     </topology>
Dec 05 15:13:26 user nova-compute[75080]:     <cache>
Dec 05 15:13:26 user nova-compute[75080]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Dec 05 15:13:26 user nova-compute[75080]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Dec 05 15:13:26 user nova-compute[75080]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Dec 05 15:13:26 user nova-compute[75080]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Dec 05 15:13:26 user nova-compute[75080]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Dec 05 15:13:26 user nova-compute[75080]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Dec 05 15:13:26 user nova-compute[75080]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Dec 05 15:13:26 user nova-compute[75080]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Dec 05 15:13:26 user nova-compute[75080]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Dec 05 15:13:26 user nova-compute[75080]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Dec 05 15:13:26 user nova-compute[75080]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Dec 05 15:13:26 user nova-compute[75080]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Dec 05 15:13:26 user nova-compute[75080]:     </cache>
Dec 05 15:13:26 user nova-compute[75080]:     <secmodel>
Dec 05 15:13:26 user nova-compute[75080]:       <model>apparmor</model>
Dec 05 15:13:26 user nova-compute[75080]:       <doi>0</doi>
Dec 05 15:13:26 user nova-compute[75080]:     </secmodel>
Dec 05 15:13:26 user nova-compute[75080]:     <secmodel>
Dec 05 15:13:26 user nova-compute[75080]:       <model>dac</model>
Dec 05 15:13:26 user nova-compute[75080]:       <doi>0</doi>
Dec 05 15:13:26 user nova-compute[75080]:       <baselabel type='kvm'>+64055:+108</baselabel>
Dec 05 15:13:26 user nova-compute[75080]:       <baselabel type='qemu'>+64055:+108</baselabel>
Dec 05 15:13:26 user nova-compute[75080]:     </secmodel>
Dec 05 15:13:26 user nova-compute[75080]:   </host>
Dec 05 15:13:26 user nova-compute[75080]:   <guest>
Dec 05 15:13:26 user nova-compute[75080]:     <os_type>hvm</os_type>
Dec 05 15:13:26 user nova-compute[75080]:     <arch name='alpha'>
Dec 05 15:13:26 user nova-compute[75080]:       <wordsize>64</wordsize>
Dec 05 15:13:26 user nova-compute[75080]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='4'>clipper</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <domain type='qemu'/>
Dec 05 15:13:26 user nova-compute[75080]:     </arch>
Dec 05 15:13:26 user nova-compute[75080]:     <features>
Dec 05 15:13:26 user nova-compute[75080]:       <cpuselection/>
Dec 05 15:13:26 user nova-compute[75080]:       <deviceboot/>
Dec 05 15:13:26 user nova-compute[75080]:       <disksnapshot default='on' toggle='no'/>
Dec 05 15:13:26 user nova-compute[75080]:     </features>
Dec 05 15:13:26 user nova-compute[75080]:   </guest>
Dec 05 15:13:26 user nova-compute[75080]:   <guest>
Dec 05 15:13:26 user nova-compute[75080]:     <os_type>hvm</os_type>
Dec 05 15:13:26 user nova-compute[75080]:     <arch name='armv6l'>
Dec 05 15:13:26 user nova-compute[75080]:       <wordsize>32</wordsize>
Dec 05 15:13:26 user nova-compute[75080]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>integratorcp</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>ast2600-evb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>borzoi</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>spitz</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>virt-2.7</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>nuri</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>romulus-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='512'>virt-3.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='512'>virt-5.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>npcm750-evb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>virt-2.10</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>rainier-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>mps3-an547</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>musca-b1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>versatileab</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>kzm</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>virt-2.8</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>musca-a</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='512'>virt-3.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='512'>virt-5.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>smdkc210</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>sx1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>virt-2.11</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>imx25-pdk</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>virt-2.9</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='4'>orangepi-pc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>z2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='512'>virt-5.2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>tosa</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>mps2-an500</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>virt-2.12</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>mps2-an521</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='4'>sabrelite</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>mps2-an511</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>canon-a1100</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>realview-eb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>emcraft-sf2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>realview-pb-a8</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='512'>virt-4.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>raspi1ap</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>palmetto-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>sx1-v1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>n810</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>g220a-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>n800</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>tacoma-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='512'>virt-4.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>quanta-gsj</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>versatilepb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>terrier</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>mainstone</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='512'>virt-4.2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>mps3-an524</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>kudo-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='4'>vexpress-a9</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='4'>midway</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>musicpal</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>lm3s811evb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>lm3s6965evb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>microbit</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>mps2-an505</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>mps2-an385</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='512'>virt-6.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>cubieboard</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>verdex</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>netduino2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>mps2-an386</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='512'>virt-6.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='4'>raspi2b</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='4'>vexpress-a15</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>fuji-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='512'>virt-6.2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>cheetah</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>virt-2.6</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>ast2500-evb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='4'>highbank</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>akita</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>connex</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>netduinoplus2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>collie</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>raspi0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <domain type='qemu'/>
Dec 05 15:13:26 user nova-compute[75080]:     </arch>
Dec 05 15:13:26 user nova-compute[75080]:     <features>
Dec 05 15:13:26 user nova-compute[75080]:       <cpuselection/>
Dec 05 15:13:26 user nova-compute[75080]:       <deviceboot/>
Dec 05 15:13:26 user nova-compute[75080]:       <disksnapshot default='on' toggle='no'/>
Dec 05 15:13:26 user nova-compute[75080]:     </features>
Dec 05 15:13:26 user nova-compute[75080]:   </guest>
Dec 05 15:13:26 user nova-compute[75080]:   <guest>
Dec 05 15:13:26 user nova-compute[75080]:     <os_type>hvm</os_type>
Dec 05 15:13:26 user nova-compute[75080]:     <arch name='armv7l'>
Dec 05 15:13:26 user nova-compute[75080]:       <wordsize>32</wordsize>
Dec 05 15:13:26 user nova-compute[75080]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>integratorcp</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>ast2600-evb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>borzoi</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>spitz</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>virt-2.7</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>nuri</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>romulus-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='512'>virt-3.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='512'>virt-5.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>npcm750-evb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>virt-2.10</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>rainier-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>mps3-an547</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>musca-b1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>versatileab</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>kzm</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>virt-2.8</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>musca-a</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='512'>virt-3.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='512'>virt-5.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>smdkc210</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>sx1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>virt-2.11</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>imx25-pdk</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>virt-2.9</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='4'>orangepi-pc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>z2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='512'>virt-5.2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>tosa</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>mps2-an500</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>virt-2.12</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>mps2-an521</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='4'>sabrelite</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>mps2-an511</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>canon-a1100</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>realview-eb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>emcraft-sf2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>realview-pb-a8</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='512'>virt-4.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>raspi1ap</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>palmetto-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>sx1-v1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>n810</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>g220a-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>n800</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>tacoma-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='512'>virt-4.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>quanta-gsj</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>versatilepb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>terrier</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>mainstone</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='512'>virt-4.2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>mps3-an524</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>kudo-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='4'>vexpress-a9</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='4'>midway</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>musicpal</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>lm3s811evb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>lm3s6965evb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>microbit</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>mps2-an505</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>mps2-an385</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='512'>virt-6.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>cubieboard</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>verdex</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>netduino2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>mps2-an386</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='512'>virt-6.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='4'>raspi2b</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='4'>vexpress-a15</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>fuji-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='512'>virt-6.2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>cheetah</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>virt-2.6</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>ast2500-evb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='4'>highbank</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>akita</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>connex</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>netduinoplus2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>collie</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>raspi0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <domain type='qemu'/>
Dec 05 15:13:26 user nova-compute[75080]:     </arch>
Dec 05 15:13:26 user nova-compute[75080]:     <features>
Dec 05 15:13:26 user nova-compute[75080]:       <cpuselection/>
Dec 05 15:13:26 user nova-compute[75080]:       <deviceboot/>
Dec 05 15:13:26 user nova-compute[75080]:       <disksnapshot default='on' toggle='no'/>
Dec 05 15:13:26 user nova-compute[75080]:     </features>
Dec 05 15:13:26 user nova-compute[75080]:   </guest>
Dec 05 15:13:26 user nova-compute[75080]:   <guest>
Dec 05 15:13:26 user nova-compute[75080]:     <os_type>hvm</os_type>
Dec 05 15:13:26 user nova-compute[75080]:     <arch name='aarch64'>
Dec 05 15:13:26 user nova-compute[75080]:       <wordsize>64</wordsize>
Dec 05 15:13:26 user nova-compute[75080]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>integratorcp</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>ast2600-evb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>borzoi</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>spitz</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>virt-2.7</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>nuri</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>romulus-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='512'>virt-3.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='512'>virt-5.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>npcm750-evb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>virt-2.10</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>rainier-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>mps3-an547</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>virt-2.8</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>musca-b1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>versatileab</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>kzm</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>musca-a</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='512'>virt-3.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='512'>virt-5.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>smdkc210</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>sx1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>virt-2.11</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>imx25-pdk</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>virt-2.9</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='4'>orangepi-pc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>z2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='512'>virt-5.2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>tosa</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>mps2-an500</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>virt-2.12</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>mps2-an521</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='4'>sabrelite</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>mps2-an511</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>canon-a1100</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>realview-eb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>emcraft-sf2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>realview-pb-a8</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='512'>sbsa-ref</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='512'>virt-4.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>raspi1ap</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>palmetto-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>sx1-v1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>n810</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>g220a-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>n800</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>tacoma-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='512'>virt-4.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>quanta-gsj</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>versatilepb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>terrier</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>mainstone</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='512'>virt-4.2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>mps3-an524</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>kudo-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='4'>vexpress-a9</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='4'>midway</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>musicpal</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>lm3s811evb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>lm3s6965evb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>microbit</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>mps2-an505</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>mps2-an385</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='512'>virt-6.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='4'>raspi3ap</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>cubieboard</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>verdex</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>netduino2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>mps2-an386</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='512'>virt-6.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='4'>raspi3b</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='4'>raspi2b</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='4'>vexpress-a15</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2'>fuji-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='512'>virt-6.2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>cheetah</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>virt-2.6</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>ast2500-evb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='4'>highbank</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>akita</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>connex</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>netduinoplus2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>collie</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>raspi0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <domain type='qemu'/>
Dec 05 15:13:26 user nova-compute[75080]:     </arch>
Dec 05 15:13:26 user nova-compute[75080]:     <features>
Dec 05 15:13:26 user nova-compute[75080]:       <acpi default='on' toggle='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:       <cpuselection/>
Dec 05 15:13:26 user nova-compute[75080]:       <deviceboot/>
Dec 05 15:13:26 user nova-compute[75080]:       <disksnapshot default='on' toggle='no'/>
Dec 05 15:13:26 user nova-compute[75080]:     </features>
Dec 05 15:13:26 user nova-compute[75080]:   </guest>
Dec 05 15:13:26 user nova-compute[75080]:   <guest>
Dec 05 15:13:26 user nova-compute[75080]:     <os_type>hvm</os_type>
Dec 05 15:13:26 user nova-compute[75080]:     <arch name='cris'>
Dec 05 15:13:26 user nova-compute[75080]:       <wordsize>32</wordsize>
Dec 05 15:13:26 user nova-compute[75080]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>axis-dev88</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <domain type='qemu'/>
Dec 05 15:13:26 user nova-compute[75080]:     </arch>
Dec 05 15:13:26 user nova-compute[75080]:     <features>
Dec 05 15:13:26 user nova-compute[75080]:       <cpuselection/>
Dec 05 15:13:26 user nova-compute[75080]:       <deviceboot/>
Dec 05 15:13:26 user nova-compute[75080]:       <disksnapshot default='on' toggle='no'/>
Dec 05 15:13:26 user nova-compute[75080]:     </features>
Dec 05 15:13:26 user nova-compute[75080]:   </guest>
Dec 05 15:13:26 user nova-compute[75080]:   <guest>
Dec 05 15:13:26 user nova-compute[75080]:     <os_type>hvm</os_type>
Dec 05 15:13:26 user nova-compute[75080]:     <arch name='i686'>
Dec 05 15:13:26 user nova-compute[75080]:       <wordsize>32</wordsize>
Dec 05 15:13:26 user nova-compute[75080]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-artful</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>x-remote</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>isapc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-disco</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-impish</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-focal</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>microvm</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <domain type='qemu'/>
Dec 05 15:13:26 user nova-compute[75080]:       <domain type='kvm'/>
Dec 05 15:13:26 user nova-compute[75080]:     </arch>
Dec 05 15:13:26 user nova-compute[75080]:     <features>
Dec 05 15:13:26 user nova-compute[75080]:       <pae/>
Dec 05 15:13:26 user nova-compute[75080]:       <nonpae/>
Dec 05 15:13:26 user nova-compute[75080]:       <acpi default='on' toggle='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:       <apic default='on' toggle='no'/>
Dec 05 15:13:26 user nova-compute[75080]:       <cpuselection/>
Dec 05 15:13:26 user nova-compute[75080]:       <deviceboot/>
Dec 05 15:13:26 user nova-compute[75080]:       <disksnapshot default='on' toggle='no'/>
Dec 05 15:13:26 user nova-compute[75080]:     </features>
Dec 05 15:13:26 user nova-compute[75080]:   </guest>
Dec 05 15:13:26 user nova-compute[75080]:   <guest>
Dec 05 15:13:26 user nova-compute[75080]:     <os_type>hvm</os_type>
Dec 05 15:13:26 user nova-compute[75080]:     <arch name='m68k'>
Dec 05 15:13:26 user nova-compute[75080]:       <wordsize>32</wordsize>
Dec 05 15:13:26 user nova-compute[75080]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>mcf5208evb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>an5206</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>virt-6.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>q800</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>virt-6.2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>next-cube</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>virt-6.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <domain type='qemu'/>
Dec 05 15:13:26 user nova-compute[75080]:     </arch>
Dec 05 15:13:26 user nova-compute[75080]:     <features>
Dec 05 15:13:26 user nova-compute[75080]:       <cpuselection/>
Dec 05 15:13:26 user nova-compute[75080]:       <deviceboot/>
Dec 05 15:13:26 user nova-compute[75080]:       <disksnapshot default='on' toggle='no'/>
Dec 05 15:13:26 user nova-compute[75080]:     </features>
Dec 05 15:13:26 user nova-compute[75080]:   </guest>
Dec 05 15:13:26 user nova-compute[75080]:   <guest>
Dec 05 15:13:26 user nova-compute[75080]:     <os_type>hvm</os_type>
Dec 05 15:13:26 user nova-compute[75080]:     <arch name='microblaze'>
Dec 05 15:13:26 user nova-compute[75080]:       <wordsize>32</wordsize>
Dec 05 15:13:26 user nova-compute[75080]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>petalogix-ml605</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <domain type='qemu'/>
Dec 05 15:13:26 user nova-compute[75080]:     </arch>
Dec 05 15:13:26 user nova-compute[75080]:     <features>
Dec 05 15:13:26 user nova-compute[75080]:       <cpuselection/>
Dec 05 15:13:26 user nova-compute[75080]:       <deviceboot/>
Dec 05 15:13:26 user nova-compute[75080]:       <disksnapshot default='on' toggle='no'/>
Dec 05 15:13:26 user nova-compute[75080]:     </features>
Dec 05 15:13:26 user nova-compute[75080]:   </guest>
Dec 05 15:13:26 user nova-compute[75080]:   <guest>
Dec 05 15:13:26 user nova-compute[75080]:     <os_type>hvm</os_type>
Dec 05 15:13:26 user nova-compute[75080]:     <arch name='microblazeel'>
Dec 05 15:13:26 user nova-compute[75080]:       <wordsize>32</wordsize>
Dec 05 15:13:26 user nova-compute[75080]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>petalogix-ml605</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <domain type='qemu'/>
Dec 05 15:13:26 user nova-compute[75080]:     </arch>
Dec 05 15:13:26 user nova-compute[75080]:     <features>
Dec 05 15:13:26 user nova-compute[75080]:       <cpuselection/>
Dec 05 15:13:26 user nova-compute[75080]:       <deviceboot/>
Dec 05 15:13:26 user nova-compute[75080]:       <disksnapshot default='on' toggle='no'/>
Dec 05 15:13:26 user nova-compute[75080]:     </features>
Dec 05 15:13:26 user nova-compute[75080]:   </guest>
Dec 05 15:13:26 user nova-compute[75080]:   <guest>
Dec 05 15:13:26 user nova-compute[75080]:     <os_type>hvm</os_type>
Dec 05 15:13:26 user nova-compute[75080]:     <arch name='mips'>
Dec 05 15:13:26 user nova-compute[75080]:       <wordsize>32</wordsize>
Dec 05 15:13:26 user nova-compute[75080]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='16'>malta</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>mipssim</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <domain type='qemu'/>
Dec 05 15:13:26 user nova-compute[75080]:     </arch>
Dec 05 15:13:26 user nova-compute[75080]:     <features>
Dec 05 15:13:26 user nova-compute[75080]:       <cpuselection/>
Dec 05 15:13:26 user nova-compute[75080]:       <deviceboot/>
Dec 05 15:13:26 user nova-compute[75080]:       <disksnapshot default='on' toggle='no'/>
Dec 05 15:13:26 user nova-compute[75080]:     </features>
Dec 05 15:13:26 user nova-compute[75080]:   </guest>
Dec 05 15:13:26 user nova-compute[75080]:   <guest>
Dec 05 15:13:26 user nova-compute[75080]:     <os_type>hvm</os_type>
Dec 05 15:13:26 user nova-compute[75080]:     <arch name='mipsel'>
Dec 05 15:13:26 user nova-compute[75080]:       <wordsize>32</wordsize>
Dec 05 15:13:26 user nova-compute[75080]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='16'>malta</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>mipssim</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <domain type='qemu'/>
Dec 05 15:13:26 user nova-compute[75080]:     </arch>
Dec 05 15:13:26 user nova-compute[75080]:     <features>
Dec 05 15:13:26 user nova-compute[75080]:       <cpuselection/>
Dec 05 15:13:26 user nova-compute[75080]:       <deviceboot/>
Dec 05 15:13:26 user nova-compute[75080]:       <disksnapshot default='on' toggle='no'/>
Dec 05 15:13:26 user nova-compute[75080]:     </features>
Dec 05 15:13:26 user nova-compute[75080]:   </guest>
Dec 05 15:13:26 user nova-compute[75080]:   <guest>
Dec 05 15:13:26 user nova-compute[75080]:     <os_type>hvm</os_type>
Dec 05 15:13:26 user nova-compute[75080]:     <arch name='mips64'>
Dec 05 15:13:26 user nova-compute[75080]:       <wordsize>64</wordsize>
Dec 05 15:13:26 user nova-compute[75080]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='16'>malta</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>mipssim</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>pica61</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>magnum</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <domain type='qemu'/>
Dec 05 15:13:26 user nova-compute[75080]:     </arch>
Dec 05 15:13:26 user nova-compute[75080]:     <features>
Dec 05 15:13:26 user nova-compute[75080]:       <cpuselection/>
Dec 05 15:13:26 user nova-compute[75080]:       <deviceboot/>
Dec 05 15:13:26 user nova-compute[75080]:       <disksnapshot default='on' toggle='no'/>
Dec 05 15:13:26 user nova-compute[75080]:     </features>
Dec 05 15:13:26 user nova-compute[75080]:   </guest>
Dec 05 15:13:26 user nova-compute[75080]:   <guest>
Dec 05 15:13:26 user nova-compute[75080]:     <os_type>hvm</os_type>
Dec 05 15:13:26 user nova-compute[75080]:     <arch name='mips64el'>
Dec 05 15:13:26 user nova-compute[75080]:       <wordsize>64</wordsize>
Dec 05 15:13:26 user nova-compute[75080]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='16'>malta</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='16'>loongson3-virt</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>mipssim</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>pica61</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>magnum</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='16'>boston</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>fuloong2e</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <domain type='qemu'/>
Dec 05 15:13:26 user nova-compute[75080]:     </arch>
Dec 05 15:13:26 user nova-compute[75080]:     <features>
Dec 05 15:13:26 user nova-compute[75080]:       <cpuselection/>
Dec 05 15:13:26 user nova-compute[75080]:       <deviceboot/>
Dec 05 15:13:26 user nova-compute[75080]:       <disksnapshot default='on' toggle='no'/>
Dec 05 15:13:26 user nova-compute[75080]:     </features>
Dec 05 15:13:26 user nova-compute[75080]:   </guest>
Dec 05 15:13:26 user nova-compute[75080]:   <guest>
Dec 05 15:13:26 user nova-compute[75080]:     <os_type>hvm</os_type>
Dec 05 15:13:26 user nova-compute[75080]:     <arch name='ppc'>
Dec 05 15:13:26 user nova-compute[75080]:       <wordsize>32</wordsize>
Dec 05 15:13:26 user nova-compute[75080]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>g3beige</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>virtex-ml507</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>mac99</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='32'>ppce500</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>pegasos2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>sam460ex</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>bamboo</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>40p</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>ref405ep</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='15'>mpc8544ds</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>taihu</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <domain type='qemu'/>
Dec 05 15:13:26 user nova-compute[75080]:     </arch>
Dec 05 15:13:26 user nova-compute[75080]:     <features>
Dec 05 15:13:26 user nova-compute[75080]:       <cpuselection/>
Dec 05 15:13:26 user nova-compute[75080]:       <deviceboot/>
Dec 05 15:13:26 user nova-compute[75080]:       <disksnapshot default='on' toggle='no'/>
Dec 05 15:13:26 user nova-compute[75080]:     </features>
Dec 05 15:13:26 user nova-compute[75080]:   </guest>
Dec 05 15:13:26 user nova-compute[75080]:   <guest>
Dec 05 15:13:26 user nova-compute[75080]:     <os_type>hvm</os_type>
Dec 05 15:13:26 user nova-compute[75080]:     <arch name='ppc64'>
Dec 05 15:13:26 user nova-compute[75080]:       <wordsize>64</wordsize>
Dec 05 15:13:26 user nova-compute[75080]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2048'>powernv9</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>taihu</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='15'>mpc8544ds</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2048'>powernv10</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='32'>ppce500</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>40p</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>pegasos2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>bamboo</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>g3beige</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>virtex-ml507</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>mac99</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>sam460ex</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>ref405ep</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2048'>powernv8</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <domain type='qemu'/>
Dec 05 15:13:26 user nova-compute[75080]:     </arch>
Dec 05 15:13:26 user nova-compute[75080]:     <features>
Dec 05 15:13:26 user nova-compute[75080]:       <cpuselection/>
Dec 05 15:13:26 user nova-compute[75080]:       <deviceboot/>
Dec 05 15:13:26 user nova-compute[75080]:       <disksnapshot default='on' toggle='no'/>
Dec 05 15:13:26 user nova-compute[75080]:     </features>
Dec 05 15:13:26 user nova-compute[75080]:   </guest>
Dec 05 15:13:26 user nova-compute[75080]:   <guest>
Dec 05 15:13:26 user nova-compute[75080]:     <os_type>hvm</os_type>
Dec 05 15:13:26 user nova-compute[75080]:     <arch name='ppc64le'>
Dec 05 15:13:26 user nova-compute[75080]:       <wordsize>64</wordsize>
Dec 05 15:13:26 user nova-compute[75080]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2048'>powernv9</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>taihu</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='15'>mpc8544ds</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2048'>powernv10</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='32'>ppce500</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>40p</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>pegasos2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>bamboo</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>g3beige</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>virtex-ml507</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>mac99</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>sam460ex</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>ref405ep</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2048'>powernv8</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <domain type='qemu'/>
Dec 05 15:13:26 user nova-compute[75080]:     </arch>
Dec 05 15:13:26 user nova-compute[75080]:     <features>
Dec 05 15:13:26 user nova-compute[75080]:       <cpuselection/>
Dec 05 15:13:26 user nova-compute[75080]:       <deviceboot/>
Dec 05 15:13:26 user nova-compute[75080]:       <disksnapshot default='on' toggle='no'/>
Dec 05 15:13:26 user nova-compute[75080]:     </features>
Dec 05 15:13:26 user nova-compute[75080]:   </guest>
Dec 05 15:13:26 user nova-compute[75080]:   <guest>
Dec 05 15:13:26 user nova-compute[75080]:     <os_type>hvm</os_type>
Dec 05 15:13:26 user nova-compute[75080]:     <arch name='riscv32'>
Dec 05 15:13:26 user nova-compute[75080]:       <wordsize>32</wordsize>
Dec 05 15:13:26 user nova-compute[75080]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='8'>spike</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>opentitan</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='5'>sifive_u</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>sifive_e</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='8'>virt</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <domain type='qemu'/>
Dec 05 15:13:26 user nova-compute[75080]:     </arch>
Dec 05 15:13:26 user nova-compute[75080]:     <features>
Dec 05 15:13:26 user nova-compute[75080]:       <cpuselection/>
Dec 05 15:13:26 user nova-compute[75080]:       <deviceboot/>
Dec 05 15:13:26 user nova-compute[75080]:       <disksnapshot default='on' toggle='no'/>
Dec 05 15:13:26 user nova-compute[75080]:     </features>
Dec 05 15:13:26 user nova-compute[75080]:   </guest>
Dec 05 15:13:26 user nova-compute[75080]:   <guest>
Dec 05 15:13:26 user nova-compute[75080]:     <os_type>hvm</os_type>
Dec 05 15:13:26 user nova-compute[75080]:     <arch name='riscv64'>
Dec 05 15:13:26 user nova-compute[75080]:       <wordsize>64</wordsize>
Dec 05 15:13:26 user nova-compute[75080]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='8'>spike</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='5'>sifive_u</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>shakti_c</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>sifive_e</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='8'>virt</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <domain type='qemu'/>
Dec 05 15:13:26 user nova-compute[75080]:     </arch>
Dec 05 15:13:26 user nova-compute[75080]:     <features>
Dec 05 15:13:26 user nova-compute[75080]:       <cpuselection/>
Dec 05 15:13:26 user nova-compute[75080]:       <deviceboot/>
Dec 05 15:13:26 user nova-compute[75080]:       <disksnapshot default='on' toggle='no'/>
Dec 05 15:13:26 user nova-compute[75080]:     </features>
Dec 05 15:13:26 user nova-compute[75080]:   </guest>
Dec 05 15:13:26 user nova-compute[75080]:   <guest>
Dec 05 15:13:26 user nova-compute[75080]:     <os_type>hvm</os_type>
Dec 05 15:13:26 user nova-compute[75080]:     <arch name='s390x'>
Dec 05 15:13:26 user nova-compute[75080]:       <wordsize>64</wordsize>
Dec 05 15:13:26 user nova-compute[75080]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <domain type='qemu'/>
Dec 05 15:13:26 user nova-compute[75080]:     </arch>
Dec 05 15:13:26 user nova-compute[75080]:     <features>
Dec 05 15:13:26 user nova-compute[75080]:       <cpuselection/>
Dec 05 15:13:26 user nova-compute[75080]:       <deviceboot/>
Dec 05 15:13:26 user nova-compute[75080]:       <disksnapshot default='on' toggle='no'/>
Dec 05 15:13:26 user nova-compute[75080]:     </features>
Dec 05 15:13:26 user nova-compute[75080]:   </guest>
Dec 05 15:13:26 user nova-compute[75080]:   <guest>
Dec 05 15:13:26 user nova-compute[75080]:     <os_type>hvm</os_type>
Dec 05 15:13:26 user nova-compute[75080]:     <arch name='sh4'>
Dec 05 15:13:26 user nova-compute[75080]:       <wordsize>32</wordsize>
Dec 05 15:13:26 user nova-compute[75080]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>shix</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>r2d</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <domain type='qemu'/>
Dec 05 15:13:26 user nova-compute[75080]:     </arch>
Dec 05 15:13:26 user nova-compute[75080]:     <features>
Dec 05 15:13:26 user nova-compute[75080]:       <cpuselection/>
Dec 05 15:13:26 user nova-compute[75080]:       <deviceboot/>
Dec 05 15:13:26 user nova-compute[75080]:       <disksnapshot default='on' toggle='no'/>
Dec 05 15:13:26 user nova-compute[75080]:     </features>
Dec 05 15:13:26 user nova-compute[75080]:   </guest>
Dec 05 15:13:26 user nova-compute[75080]:   <guest>
Dec 05 15:13:26 user nova-compute[75080]:     <os_type>hvm</os_type>
Dec 05 15:13:26 user nova-compute[75080]:     <arch name='sh4eb'>
Dec 05 15:13:26 user nova-compute[75080]:       <wordsize>64</wordsize>
Dec 05 15:13:26 user nova-compute[75080]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>shix</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>r2d</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <domain type='qemu'/>
Dec 05 15:13:26 user nova-compute[75080]:     </arch>
Dec 05 15:13:26 user nova-compute[75080]:     <features>
Dec 05 15:13:26 user nova-compute[75080]:       <cpuselection/>
Dec 05 15:13:26 user nova-compute[75080]:       <deviceboot/>
Dec 05 15:13:26 user nova-compute[75080]:       <disksnapshot default='on' toggle='no'/>
Dec 05 15:13:26 user nova-compute[75080]:     </features>
Dec 05 15:13:26 user nova-compute[75080]:   </guest>
Dec 05 15:13:26 user nova-compute[75080]:   <guest>
Dec 05 15:13:26 user nova-compute[75080]:     <os_type>hvm</os_type>
Dec 05 15:13:26 user nova-compute[75080]:     <arch name='sparc'>
Dec 05 15:13:26 user nova-compute[75080]:       <wordsize>32</wordsize>
Dec 05 15:13:26 user nova-compute[75080]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>SS-5</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='4'>SS-20</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>LX</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>SPARCClassic</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>leon3_generic</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>SPARCbook</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>SS-4</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='4'>SS-600MP</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='4'>SS-10</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>Voyager</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <domain type='qemu'/>
Dec 05 15:13:26 user nova-compute[75080]:     </arch>
Dec 05 15:13:26 user nova-compute[75080]:     <features>
Dec 05 15:13:26 user nova-compute[75080]:       <cpuselection/>
Dec 05 15:13:26 user nova-compute[75080]:       <deviceboot/>
Dec 05 15:13:26 user nova-compute[75080]:       <disksnapshot default='on' toggle='no'/>
Dec 05 15:13:26 user nova-compute[75080]:     </features>
Dec 05 15:13:26 user nova-compute[75080]:   </guest>
Dec 05 15:13:26 user nova-compute[75080]:   <guest>
Dec 05 15:13:26 user nova-compute[75080]:     <os_type>hvm</os_type>
Dec 05 15:13:26 user nova-compute[75080]:     <arch name='sparc64'>
Dec 05 15:13:26 user nova-compute[75080]:       <wordsize>64</wordsize>
Dec 05 15:13:26 user nova-compute[75080]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>sun4u</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>niagara</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>sun4v</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <domain type='qemu'/>
Dec 05 15:13:26 user nova-compute[75080]:     </arch>
Dec 05 15:13:26 user nova-compute[75080]:     <features>
Dec 05 15:13:26 user nova-compute[75080]:       <cpuselection/>
Dec 05 15:13:26 user nova-compute[75080]:       <deviceboot/>
Dec 05 15:13:26 user nova-compute[75080]:       <disksnapshot default='on' toggle='no'/>
Dec 05 15:13:26 user nova-compute[75080]:     </features>
Dec 05 15:13:26 user nova-compute[75080]:   </guest>
Dec 05 15:13:26 user nova-compute[75080]:   <guest>
Dec 05 15:13:26 user nova-compute[75080]:     <os_type>hvm</os_type>
Dec 05 15:13:26 user nova-compute[75080]:     <arch name='x86_64'>
Dec 05 15:13:26 user nova-compute[75080]:       <wordsize>64</wordsize>
Dec 05 15:13:26 user nova-compute[75080]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-artful</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>x-remote</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='1'>isapc</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-disco</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-impish</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-focal</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>microvm</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <domain type='qemu'/>
Dec 05 15:13:26 user nova-compute[75080]:       <domain type='kvm'/>
Dec 05 15:13:26 user nova-compute[75080]:     </arch>
Dec 05 15:13:26 user nova-compute[75080]:     <features>
Dec 05 15:13:26 user nova-compute[75080]:       <acpi default='on' toggle='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:       <apic default='on' toggle='no'/>
Dec 05 15:13:26 user nova-compute[75080]:       <cpuselection/>
Dec 05 15:13:26 user nova-compute[75080]:       <deviceboot/>
Dec 05 15:13:26 user nova-compute[75080]:       <disksnapshot default='on' toggle='no'/>
Dec 05 15:13:26 user nova-compute[75080]:     </features>
Dec 05 15:13:26 user nova-compute[75080]:   </guest>
Dec 05 15:13:26 user nova-compute[75080]:   <guest>
Dec 05 15:13:26 user nova-compute[75080]:     <os_type>hvm</os_type>
Dec 05 15:13:26 user nova-compute[75080]:     <arch name='xtensa'>
Dec 05 15:13:26 user nova-compute[75080]:       <wordsize>32</wordsize>
Dec 05 15:13:26 user nova-compute[75080]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='4'>sim</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='32'>kc705</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='32'>ml605</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='32'>ml605-nommu</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='32'>virt</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='32'>lx60-nommu</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='32'>lx200</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='32'>lx200-nommu</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='32'>lx60</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='32'>kc705-nommu</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <domain type='qemu'/>
Dec 05 15:13:26 user nova-compute[75080]:     </arch>
Dec 05 15:13:26 user nova-compute[75080]:     <features>
Dec 05 15:13:26 user nova-compute[75080]:       <cpuselection/>
Dec 05 15:13:26 user nova-compute[75080]:       <deviceboot/>
Dec 05 15:13:26 user nova-compute[75080]:       <disksnapshot default='on' toggle='no'/>
Dec 05 15:13:26 user nova-compute[75080]:     </features>
Dec 05 15:13:26 user nova-compute[75080]:   </guest>
Dec 05 15:13:26 user nova-compute[75080]:   <guest>
Dec 05 15:13:26 user nova-compute[75080]:     <os_type>hvm</os_type>
Dec 05 15:13:26 user nova-compute[75080]:     <arch name='xtensaeb'>
Dec 05 15:13:26 user nova-compute[75080]:       <wordsize>32</wordsize>
Dec 05 15:13:26 user nova-compute[75080]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='4'>sim</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='32'>kc705</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='32'>ml605</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='32'>ml605-nommu</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='32'>virt</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='32'>lx60-nommu</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='32'>lx200</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='32'>lx200-nommu</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='32'>lx60</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <machine maxCpus='32'>kc705-nommu</machine>
Dec 05 15:13:26 user nova-compute[75080]:       <domain type='qemu'/>
Dec 05 15:13:26 user nova-compute[75080]:     </arch>
Dec 05 15:13:26 user nova-compute[75080]:     <features>
Dec 05 15:13:26 user nova-compute[75080]:       <cpuselection/>
Dec 05 15:13:26 user nova-compute[75080]:       <deviceboot/>
Dec 05 15:13:26 user nova-compute[75080]:       <disksnapshot default='on' toggle='no'/>
Dec 05 15:13:26 user nova-compute[75080]:     </features>
Dec 05 15:13:26 user nova-compute[75080]:   </guest>
Dec 05 15:13:26 user nova-compute[75080]: </capabilities>
Dec 05 15:13:26 user nova-compute[75080]: 
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'ubuntu', 'pc', 'q35'} {{(pid=75080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Dec 05 15:13:26 user nova-compute[75080]: <domainCapabilities>
Dec 05 15:13:26 user nova-compute[75080]:   <path>/usr/bin/qemu-system-i386</path>
Dec 05 15:13:26 user nova-compute[75080]:   <domain>kvm</domain>
Dec 05 15:13:26 user nova-compute[75080]:   <machine>pc-q35-jammy</machine>
Dec 05 15:13:26 user nova-compute[75080]:   <arch>i686</arch>
Dec 05 15:13:26 user nova-compute[75080]:   <vcpu max='288'/>
Dec 05 15:13:26 user nova-compute[75080]:   <iothreads supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:   <os supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:     <enum name='firmware'/>
Dec 05 15:13:26 user nova-compute[75080]:     <loader supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Dec 05 15:13:26 user nova-compute[75080]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Dec 05 15:13:26 user nova-compute[75080]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Dec 05 15:13:26 user nova-compute[75080]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Dec 05 15:13:26 user nova-compute[75080]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='type'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>rom</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>pflash</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='readonly'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>yes</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>no</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='secure'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>no</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </loader>
Dec 05 15:13:26 user nova-compute[75080]:   </os>
Dec 05 15:13:26 user nova-compute[75080]:   <cpu>
Dec 05 15:13:26 user nova-compute[75080]:     <mode name='host-passthrough' supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='hostPassthroughMigratable'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>off</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </mode>
Dec 05 15:13:26 user nova-compute[75080]:     <mode name='maximum' supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='maximumMigratable'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>on</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>off</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </mode>
Dec 05 15:13:26 user nova-compute[75080]:     <mode name='host-model' supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <vendor>Intel</vendor>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='ss'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='vmx'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='pcid'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='hypervisor'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='arat'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='tsc_adjust'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='umip'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='md-clear'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='stibp'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='arch-capabilities'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='ssbd'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='ibpb'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='ibrs'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='amd-stibp'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='amd-ssbd'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='disable' name='erms'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='disable' name='xsaveopt'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='disable' name='lm'/>
Dec 05 15:13:26 user nova-compute[75080]:     </mode>
Dec 05 15:13:26 user nova-compute[75080]:     <mode name='custom' supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>qemu64</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>qemu32</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>phenom</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>pentium3</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>pentium2</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>pentium</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>n270</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>kvm64</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>kvm32</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>coreduo</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>core2duo</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>athlon</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Westmere-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Westmere</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Snowridge</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Server</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Client</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>SandyBridge</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Penryn</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Opteron_G5</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Opteron_G4</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Opteron_G3</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Opteron_G2</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Opteron_G1</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Nehalem-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Nehalem</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>IvyBridge</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Icelake-Server</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Haswell-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Haswell-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Haswell</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>EPYC-Rome</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>EPYC-Milan</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>EPYC-IBPB</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>EPYC</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Dhyana</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Cooperlake</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Conroe</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Cascadelake-Server</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Broadwell-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Broadwell-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Broadwell</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>486</model>
Dec 05 15:13:26 user nova-compute[75080]:     </mode>
Dec 05 15:13:26 user nova-compute[75080]:   </cpu>
Dec 05 15:13:26 user nova-compute[75080]:   <memoryBacking supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:     <enum name='sourceType'>
Dec 05 15:13:26 user nova-compute[75080]:       <value>file</value>
Dec 05 15:13:26 user nova-compute[75080]:       <value>anonymous</value>
Dec 05 15:13:26 user nova-compute[75080]:       <value>memfd</value>
Dec 05 15:13:26 user nova-compute[75080]:     </enum>
Dec 05 15:13:26 user nova-compute[75080]:   </memoryBacking>
Dec 05 15:13:26 user nova-compute[75080]:   <devices>
Dec 05 15:13:26 user nova-compute[75080]:     <disk supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='diskDevice'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>disk</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>cdrom</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>floppy</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>lun</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='bus'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>fdc</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>scsi</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>usb</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>sata</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='model'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio-transitional</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio-non-transitional</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </disk>
Dec 05 15:13:26 user nova-compute[75080]:     <graphics supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='type'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>sdl</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>vnc</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>spice</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>egl-headless</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </graphics>
Dec 05 15:13:26 user nova-compute[75080]:     <video supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='modelType'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>vga</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>cirrus</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>vmvga</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>qxl</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>none</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>bochs</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>ramfb</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </video>
Dec 05 15:13:26 user nova-compute[75080]:     <hostdev supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='mode'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>subsystem</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='startupPolicy'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>default</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>mandatory</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>requisite</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>optional</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='subsysType'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>usb</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>pci</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>scsi</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='capsType'/>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='pciBackend'/>
Dec 05 15:13:26 user nova-compute[75080]:     </hostdev>
Dec 05 15:13:26 user nova-compute[75080]:     <rng supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='model'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio-transitional</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio-non-transitional</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='backendModel'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>random</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>egd</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>builtin</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </rng>
Dec 05 15:13:26 user nova-compute[75080]:     <filesystem supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='driverType'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>path</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>handle</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtiofs</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </filesystem>
Dec 05 15:13:26 user nova-compute[75080]:     <tpm supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='model'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>tpm-tis</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>tpm-crb</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='backendModel'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>passthrough</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>emulator</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </tpm>
Dec 05 15:13:26 user nova-compute[75080]:   </devices>
Dec 05 15:13:26 user nova-compute[75080]:   <features>
Dec 05 15:13:26 user nova-compute[75080]:     <gic supported='no'/>
Dec 05 15:13:26 user nova-compute[75080]:     <vmcoreinfo supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:     <genid supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:     <backingStoreInput supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:     <backup supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:     <sev supported='no'/>
Dec 05 15:13:26 user nova-compute[75080]:   </features>
Dec 05 15:13:26 user nova-compute[75080]: </domainCapabilities>
Dec 05 15:13:26 user nova-compute[75080]:  {{(pid=75080) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Dec 05 15:13:26 user nova-compute[75080]: <domainCapabilities>
Dec 05 15:13:26 user nova-compute[75080]:   <path>/usr/bin/qemu-system-i386</path>
Dec 05 15:13:26 user nova-compute[75080]:   <domain>kvm</domain>
Dec 05 15:13:26 user nova-compute[75080]:   <machine>pc-i440fx-jammy</machine>
Dec 05 15:13:26 user nova-compute[75080]:   <arch>i686</arch>
Dec 05 15:13:26 user nova-compute[75080]:   <vcpu max='255'/>
Dec 05 15:13:26 user nova-compute[75080]:   <iothreads supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:   <os supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:     <enum name='firmware'/>
Dec 05 15:13:26 user nova-compute[75080]:     <loader supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Dec 05 15:13:26 user nova-compute[75080]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Dec 05 15:13:26 user nova-compute[75080]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Dec 05 15:13:26 user nova-compute[75080]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Dec 05 15:13:26 user nova-compute[75080]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='type'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>rom</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>pflash</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='readonly'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>yes</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>no</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='secure'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>no</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </loader>
Dec 05 15:13:26 user nova-compute[75080]:   </os>
Dec 05 15:13:26 user nova-compute[75080]:   <cpu>
Dec 05 15:13:26 user nova-compute[75080]:     <mode name='host-passthrough' supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='hostPassthroughMigratable'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>off</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </mode>
Dec 05 15:13:26 user nova-compute[75080]:     <mode name='maximum' supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='maximumMigratable'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>on</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>off</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </mode>
Dec 05 15:13:26 user nova-compute[75080]:     <mode name='host-model' supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <vendor>Intel</vendor>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='ss'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='vmx'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='pcid'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='hypervisor'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='arat'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='tsc_adjust'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='umip'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='md-clear'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='stibp'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='arch-capabilities'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='ssbd'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='ibpb'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='ibrs'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='amd-stibp'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='amd-ssbd'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='disable' name='erms'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='disable' name='xsaveopt'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='disable' name='lm'/>
Dec 05 15:13:26 user nova-compute[75080]:     </mode>
Dec 05 15:13:26 user nova-compute[75080]:     <mode name='custom' supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>qemu64</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>qemu32</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>phenom</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>pentium3</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>pentium2</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>pentium</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>n270</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>kvm64</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>kvm32</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>coreduo</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>core2duo</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>athlon</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Westmere-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Westmere</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Snowridge</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Server</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Client</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>SandyBridge</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Penryn</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Opteron_G5</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Opteron_G4</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Opteron_G3</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Opteron_G2</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Opteron_G1</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Nehalem-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Nehalem</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>IvyBridge</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Icelake-Server</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Haswell-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Haswell-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Haswell</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>EPYC-Rome</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>EPYC-Milan</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>EPYC-IBPB</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>EPYC</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Dhyana</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Cooperlake</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Conroe</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Cascadelake-Server</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Broadwell-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Broadwell-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Broadwell</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>486</model>
Dec 05 15:13:26 user nova-compute[75080]:     </mode>
Dec 05 15:13:26 user nova-compute[75080]:   </cpu>
Dec 05 15:13:26 user nova-compute[75080]:   <memoryBacking supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:     <enum name='sourceType'>
Dec 05 15:13:26 user nova-compute[75080]:       <value>file</value>
Dec 05 15:13:26 user nova-compute[75080]:       <value>anonymous</value>
Dec 05 15:13:26 user nova-compute[75080]:       <value>memfd</value>
Dec 05 15:13:26 user nova-compute[75080]:     </enum>
Dec 05 15:13:26 user nova-compute[75080]:   </memoryBacking>
Dec 05 15:13:26 user nova-compute[75080]:   <devices>
Dec 05 15:13:26 user nova-compute[75080]:     <disk supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='diskDevice'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>disk</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>cdrom</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>floppy</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>lun</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='bus'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>ide</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>fdc</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>scsi</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>usb</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>sata</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='model'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio-transitional</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio-non-transitional</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </disk>
Dec 05 15:13:26 user nova-compute[75080]:     <graphics supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='type'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>sdl</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>vnc</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>spice</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>egl-headless</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </graphics>
Dec 05 15:13:26 user nova-compute[75080]:     <video supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='modelType'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>vga</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>cirrus</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>vmvga</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>qxl</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>none</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>bochs</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>ramfb</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </video>
Dec 05 15:13:26 user nova-compute[75080]:     <hostdev supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='mode'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>subsystem</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='startupPolicy'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>default</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>mandatory</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>requisite</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>optional</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='subsysType'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>usb</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>pci</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>scsi</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='capsType'/>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='pciBackend'/>
Dec 05 15:13:26 user nova-compute[75080]:     </hostdev>
Dec 05 15:13:26 user nova-compute[75080]:     <rng supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='model'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio-transitional</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio-non-transitional</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='backendModel'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>random</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>egd</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>builtin</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </rng>
Dec 05 15:13:26 user nova-compute[75080]:     <filesystem supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='driverType'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>path</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>handle</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtiofs</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </filesystem>
Dec 05 15:13:26 user nova-compute[75080]:     <tpm supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='model'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>tpm-tis</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>tpm-crb</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='backendModel'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>passthrough</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>emulator</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </tpm>
Dec 05 15:13:26 user nova-compute[75080]:   </devices>
Dec 05 15:13:26 user nova-compute[75080]:   <features>
Dec 05 15:13:26 user nova-compute[75080]:     <gic supported='no'/>
Dec 05 15:13:26 user nova-compute[75080]:     <vmcoreinfo supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:     <genid supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:     <backingStoreInput supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:     <backup supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:     <sev supported='no'/>
Dec 05 15:13:26 user nova-compute[75080]:   </features>
Dec 05 15:13:26 user nova-compute[75080]: </domainCapabilities>
Dec 05 15:13:26 user nova-compute[75080]:  {{(pid=75080) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Dec 05 15:13:26 user nova-compute[75080]: <domainCapabilities>
Dec 05 15:13:26 user nova-compute[75080]:   <path>/usr/bin/qemu-system-i386</path>
Dec 05 15:13:26 user nova-compute[75080]:   <domain>kvm</domain>
Dec 05 15:13:26 user nova-compute[75080]:   <machine>pc-i440fx-6.2</machine>
Dec 05 15:13:26 user nova-compute[75080]:   <arch>i686</arch>
Dec 05 15:13:26 user nova-compute[75080]:   <vcpu max='255'/>
Dec 05 15:13:26 user nova-compute[75080]:   <iothreads supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:   <os supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:     <enum name='firmware'/>
Dec 05 15:13:26 user nova-compute[75080]:     <loader supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Dec 05 15:13:26 user nova-compute[75080]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Dec 05 15:13:26 user nova-compute[75080]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Dec 05 15:13:26 user nova-compute[75080]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Dec 05 15:13:26 user nova-compute[75080]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='type'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>rom</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>pflash</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='readonly'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>yes</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>no</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='secure'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>no</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </loader>
Dec 05 15:13:26 user nova-compute[75080]:   </os>
Dec 05 15:13:26 user nova-compute[75080]:   <cpu>
Dec 05 15:13:26 user nova-compute[75080]:     <mode name='host-passthrough' supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='hostPassthroughMigratable'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>off</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </mode>
Dec 05 15:13:26 user nova-compute[75080]:     <mode name='maximum' supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='maximumMigratable'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>on</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>off</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </mode>
Dec 05 15:13:26 user nova-compute[75080]:     <mode name='host-model' supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <vendor>Intel</vendor>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='ss'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='vmx'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='pcid'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='hypervisor'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='arat'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='tsc_adjust'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='umip'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='md-clear'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='stibp'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='arch-capabilities'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='ssbd'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='ibpb'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='ibrs'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='amd-stibp'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='amd-ssbd'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='disable' name='erms'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='disable' name='xsaveopt'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='disable' name='lm'/>
Dec 05 15:13:26 user nova-compute[75080]:     </mode>
Dec 05 15:13:26 user nova-compute[75080]:     <mode name='custom' supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>qemu64</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>qemu32</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>phenom</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>pentium3</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>pentium2</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>pentium</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>n270</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>kvm64</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>kvm32</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>coreduo</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>core2duo</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>athlon</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Westmere-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Westmere</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Snowridge</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Server</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Client</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>SandyBridge</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Penryn</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Opteron_G5</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Opteron_G4</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Opteron_G3</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Opteron_G2</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Opteron_G1</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Nehalem-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Nehalem</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>IvyBridge</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Icelake-Server</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Haswell-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Haswell-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Haswell</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>EPYC-Rome</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>EPYC-Milan</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>EPYC-IBPB</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>EPYC</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Dhyana</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Cooperlake</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Conroe</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Cascadelake-Server</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Broadwell-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Broadwell-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Broadwell</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>486</model>
Dec 05 15:13:26 user nova-compute[75080]:     </mode>
Dec 05 15:13:26 user nova-compute[75080]:   </cpu>
Dec 05 15:13:26 user nova-compute[75080]:   <memoryBacking supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:     <enum name='sourceType'>
Dec 05 15:13:26 user nova-compute[75080]:       <value>file</value>
Dec 05 15:13:26 user nova-compute[75080]:       <value>anonymous</value>
Dec 05 15:13:26 user nova-compute[75080]:       <value>memfd</value>
Dec 05 15:13:26 user nova-compute[75080]:     </enum>
Dec 05 15:13:26 user nova-compute[75080]:   </memoryBacking>
Dec 05 15:13:26 user nova-compute[75080]:   <devices>
Dec 05 15:13:26 user nova-compute[75080]:     <disk supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='diskDevice'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>disk</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>cdrom</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>floppy</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>lun</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='bus'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>ide</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>fdc</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>scsi</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>usb</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>sata</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='model'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio-transitional</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio-non-transitional</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </disk>
Dec 05 15:13:26 user nova-compute[75080]:     <graphics supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='type'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>sdl</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>vnc</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>spice</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>egl-headless</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </graphics>
Dec 05 15:13:26 user nova-compute[75080]:     <video supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='modelType'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>vga</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>cirrus</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>vmvga</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>qxl</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>none</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>bochs</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>ramfb</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </video>
Dec 05 15:13:26 user nova-compute[75080]:     <hostdev supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='mode'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>subsystem</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='startupPolicy'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>default</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>mandatory</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>requisite</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>optional</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='subsysType'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>usb</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>pci</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>scsi</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='capsType'/>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='pciBackend'/>
Dec 05 15:13:26 user nova-compute[75080]:     </hostdev>
Dec 05 15:13:26 user nova-compute[75080]:     <rng supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='model'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio-transitional</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio-non-transitional</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='backendModel'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>random</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>egd</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>builtin</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </rng>
Dec 05 15:13:26 user nova-compute[75080]:     <filesystem supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='driverType'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>path</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>handle</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtiofs</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </filesystem>
Dec 05 15:13:26 user nova-compute[75080]:     <tpm supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='model'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>tpm-tis</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>tpm-crb</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='backendModel'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>passthrough</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>emulator</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </tpm>
Dec 05 15:13:26 user nova-compute[75080]:   </devices>
Dec 05 15:13:26 user nova-compute[75080]:   <features>
Dec 05 15:13:26 user nova-compute[75080]:     <gic supported='no'/>
Dec 05 15:13:26 user nova-compute[75080]:     <vmcoreinfo supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:     <genid supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:     <backingStoreInput supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:     <backup supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:     <sev supported='no'/>
Dec 05 15:13:26 user nova-compute[75080]:   </features>
Dec 05 15:13:26 user nova-compute[75080]: </domainCapabilities>
Dec 05 15:13:26 user nova-compute[75080]:  {{(pid=75080) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Dec 05 15:13:26 user nova-compute[75080]: <domainCapabilities>
Dec 05 15:13:26 user nova-compute[75080]:   <path>/usr/bin/qemu-system-i386</path>
Dec 05 15:13:26 user nova-compute[75080]:   <domain>kvm</domain>
Dec 05 15:13:26 user nova-compute[75080]:   <machine>pc-q35-6.2</machine>
Dec 05 15:13:26 user nova-compute[75080]:   <arch>i686</arch>
Dec 05 15:13:26 user nova-compute[75080]:   <vcpu max='288'/>
Dec 05 15:13:26 user nova-compute[75080]:   <iothreads supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:   <os supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:     <enum name='firmware'/>
Dec 05 15:13:26 user nova-compute[75080]:     <loader supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Dec 05 15:13:26 user nova-compute[75080]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Dec 05 15:13:26 user nova-compute[75080]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Dec 05 15:13:26 user nova-compute[75080]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Dec 05 15:13:26 user nova-compute[75080]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='type'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>rom</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>pflash</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='readonly'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>yes</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>no</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='secure'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>no</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </loader>
Dec 05 15:13:26 user nova-compute[75080]:   </os>
Dec 05 15:13:26 user nova-compute[75080]:   <cpu>
Dec 05 15:13:26 user nova-compute[75080]:     <mode name='host-passthrough' supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='hostPassthroughMigratable'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>off</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </mode>
Dec 05 15:13:26 user nova-compute[75080]:     <mode name='maximum' supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='maximumMigratable'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>on</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>off</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </mode>
Dec 05 15:13:26 user nova-compute[75080]:     <mode name='host-model' supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <vendor>Intel</vendor>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='ss'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='vmx'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='pcid'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='hypervisor'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='arat'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='tsc_adjust'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='umip'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='md-clear'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='stibp'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='arch-capabilities'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='ssbd'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='ibpb'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='ibrs'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='amd-stibp'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='amd-ssbd'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='disable' name='erms'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='disable' name='xsaveopt'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='disable' name='lm'/>
Dec 05 15:13:26 user nova-compute[75080]:     </mode>
Dec 05 15:13:26 user nova-compute[75080]:     <mode name='custom' supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>qemu64</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>qemu32</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>phenom</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>pentium3</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>pentium2</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>pentium</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>n270</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>kvm64</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>kvm32</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>coreduo</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>core2duo</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>athlon</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Westmere-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Westmere</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Snowridge</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Server</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Client</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>SandyBridge</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Penryn</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Opteron_G5</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Opteron_G4</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Opteron_G3</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Opteron_G2</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Opteron_G1</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Nehalem-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Nehalem</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>IvyBridge</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Icelake-Server</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Haswell-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Haswell-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Haswell</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>EPYC-Rome</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>EPYC-Milan</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>EPYC-IBPB</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>EPYC</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Dhyana</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Cooperlake</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Conroe</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Cascadelake-Server</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Broadwell-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Broadwell-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Broadwell</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>486</model>
Dec 05 15:13:26 user nova-compute[75080]:     </mode>
Dec 05 15:13:26 user nova-compute[75080]:   </cpu>
Dec 05 15:13:26 user nova-compute[75080]:   <memoryBacking supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:     <enum name='sourceType'>
Dec 05 15:13:26 user nova-compute[75080]:       <value>file</value>
Dec 05 15:13:26 user nova-compute[75080]:       <value>anonymous</value>
Dec 05 15:13:26 user nova-compute[75080]:       <value>memfd</value>
Dec 05 15:13:26 user nova-compute[75080]:     </enum>
Dec 05 15:13:26 user nova-compute[75080]:   </memoryBacking>
Dec 05 15:13:26 user nova-compute[75080]:   <devices>
Dec 05 15:13:26 user nova-compute[75080]:     <disk supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='diskDevice'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>disk</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>cdrom</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>floppy</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>lun</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='bus'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>fdc</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>scsi</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>usb</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>sata</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='model'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio-transitional</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio-non-transitional</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </disk>
Dec 05 15:13:26 user nova-compute[75080]:     <graphics supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='type'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>sdl</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>vnc</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>spice</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>egl-headless</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </graphics>
Dec 05 15:13:26 user nova-compute[75080]:     <video supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='modelType'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>vga</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>cirrus</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>vmvga</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>qxl</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>none</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>bochs</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>ramfb</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </video>
Dec 05 15:13:26 user nova-compute[75080]:     <hostdev supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='mode'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>subsystem</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='startupPolicy'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>default</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>mandatory</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>requisite</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>optional</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='subsysType'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>usb</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>pci</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>scsi</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='capsType'/>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='pciBackend'/>
Dec 05 15:13:26 user nova-compute[75080]:     </hostdev>
Dec 05 15:13:26 user nova-compute[75080]:     <rng supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='model'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio-transitional</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio-non-transitional</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='backendModel'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>random</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>egd</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>builtin</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </rng>
Dec 05 15:13:26 user nova-compute[75080]:     <filesystem supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='driverType'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>path</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>handle</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtiofs</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </filesystem>
Dec 05 15:13:26 user nova-compute[75080]:     <tpm supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='model'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>tpm-tis</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>tpm-crb</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='backendModel'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>passthrough</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>emulator</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </tpm>
Dec 05 15:13:26 user nova-compute[75080]:   </devices>
Dec 05 15:13:26 user nova-compute[75080]:   <features>
Dec 05 15:13:26 user nova-compute[75080]:     <gic supported='no'/>
Dec 05 15:13:26 user nova-compute[75080]:     <vmcoreinfo supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:     <genid supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:     <backingStoreInput supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:     <backup supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:     <sev supported='no'/>
Dec 05 15:13:26 user nova-compute[75080]:   </features>
Dec 05 15:13:26 user nova-compute[75080]: </domainCapabilities>
Dec 05 15:13:26 user nova-compute[75080]:  {{(pid=75080) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=75080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'ubuntu', 'pc', 'q35'} {{(pid=75080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Dec 05 15:13:26 user nova-compute[75080]: <domainCapabilities>
Dec 05 15:13:26 user nova-compute[75080]:   <path>/usr/bin/qemu-system-x86_64</path>
Dec 05 15:13:26 user nova-compute[75080]:   <domain>kvm</domain>
Dec 05 15:13:26 user nova-compute[75080]:   <machine>pc-q35-jammy</machine>
Dec 05 15:13:26 user nova-compute[75080]:   <arch>x86_64</arch>
Dec 05 15:13:26 user nova-compute[75080]:   <vcpu max='288'/>
Dec 05 15:13:26 user nova-compute[75080]:   <iothreads supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:   <os supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:     <enum name='firmware'>
Dec 05 15:13:26 user nova-compute[75080]:       <value>efi</value>
Dec 05 15:13:26 user nova-compute[75080]:     </enum>
Dec 05 15:13:26 user nova-compute[75080]:     <loader supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Dec 05 15:13:26 user nova-compute[75080]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Dec 05 15:13:26 user nova-compute[75080]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='type'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>rom</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>pflash</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='readonly'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>yes</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>no</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='secure'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>yes</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>no</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </loader>
Dec 05 15:13:26 user nova-compute[75080]:   </os>
Dec 05 15:13:26 user nova-compute[75080]:   <cpu>
Dec 05 15:13:26 user nova-compute[75080]:     <mode name='host-passthrough' supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='hostPassthroughMigratable'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>on</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>off</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </mode>
Dec 05 15:13:26 user nova-compute[75080]:     <mode name='maximum' supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='maximumMigratable'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>on</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>off</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </mode>
Dec 05 15:13:26 user nova-compute[75080]:     <mode name='host-model' supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <vendor>Intel</vendor>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='ss'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='vmx'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='pcid'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='hypervisor'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='arat'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='tsc_adjust'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='umip'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='md-clear'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='stibp'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='arch-capabilities'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='ssbd'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='invtsc'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='ibpb'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='ibrs'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='amd-stibp'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='amd-ssbd'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='rsba'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='pschange-mc-no'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='disable' name='erms'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='disable' name='xsaveopt'/>
Dec 05 15:13:26 user nova-compute[75080]:     </mode>
Dec 05 15:13:26 user nova-compute[75080]:     <mode name='custom' supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>qemu64</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>qemu32</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>phenom</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>pentium3</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>pentium2</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>pentium</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>n270</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>kvm64</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>kvm32</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>coreduo</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>core2duo</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>athlon</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>Westmere-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>Westmere</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Snowridge</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Server</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Client</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>SandyBridge</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>Penryn</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Opteron_G5</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Opteron_G4</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Opteron_G3</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Opteron_G2</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>Opteron_G1</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>Nehalem-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>Nehalem</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>IvyBridge</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Icelake-Server</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Haswell-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Haswell-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Haswell</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>EPYC-Rome</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>EPYC-Milan</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>EPYC-IBPB</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>EPYC</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Dhyana</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Cooperlake</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>Conroe</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Cascadelake-Server</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Broadwell-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Broadwell-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Broadwell</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>486</model>
Dec 05 15:13:26 user nova-compute[75080]:     </mode>
Dec 05 15:13:26 user nova-compute[75080]:   </cpu>
Dec 05 15:13:26 user nova-compute[75080]:   <memoryBacking supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:     <enum name='sourceType'>
Dec 05 15:13:26 user nova-compute[75080]:       <value>file</value>
Dec 05 15:13:26 user nova-compute[75080]:       <value>anonymous</value>
Dec 05 15:13:26 user nova-compute[75080]:       <value>memfd</value>
Dec 05 15:13:26 user nova-compute[75080]:     </enum>
Dec 05 15:13:26 user nova-compute[75080]:   </memoryBacking>
Dec 05 15:13:26 user nova-compute[75080]:   <devices>
Dec 05 15:13:26 user nova-compute[75080]:     <disk supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='diskDevice'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>disk</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>cdrom</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>floppy</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>lun</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='bus'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>fdc</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>scsi</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>usb</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>sata</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='model'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio-transitional</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio-non-transitional</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </disk>
Dec 05 15:13:26 user nova-compute[75080]:     <graphics supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='type'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>sdl</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>vnc</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>spice</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>egl-headless</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </graphics>
Dec 05 15:13:26 user nova-compute[75080]:     <video supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='modelType'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>vga</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>cirrus</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>vmvga</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>qxl</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>none</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>bochs</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>ramfb</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </video>
Dec 05 15:13:26 user nova-compute[75080]:     <hostdev supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='mode'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>subsystem</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='startupPolicy'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>default</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>mandatory</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>requisite</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>optional</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='subsysType'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>usb</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>pci</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>scsi</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='capsType'/>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='pciBackend'/>
Dec 05 15:13:26 user nova-compute[75080]:     </hostdev>
Dec 05 15:13:26 user nova-compute[75080]:     <rng supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='model'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio-transitional</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio-non-transitional</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='backendModel'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>random</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>egd</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>builtin</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </rng>
Dec 05 15:13:26 user nova-compute[75080]:     <filesystem supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='driverType'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>path</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>handle</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtiofs</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </filesystem>
Dec 05 15:13:26 user nova-compute[75080]:     <tpm supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='model'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>tpm-tis</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>tpm-crb</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='backendModel'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>passthrough</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>emulator</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </tpm>
Dec 05 15:13:26 user nova-compute[75080]:   </devices>
Dec 05 15:13:26 user nova-compute[75080]:   <features>
Dec 05 15:13:26 user nova-compute[75080]:     <gic supported='no'/>
Dec 05 15:13:26 user nova-compute[75080]:     <vmcoreinfo supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:     <genid supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:     <backingStoreInput supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:     <backup supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:     <sev supported='no'/>
Dec 05 15:13:26 user nova-compute[75080]:   </features>
Dec 05 15:13:26 user nova-compute[75080]: </domainCapabilities>
Dec 05 15:13:26 user nova-compute[75080]:  {{(pid=75080) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Dec 05 15:13:26 user nova-compute[75080]: <domainCapabilities>
Dec 05 15:13:26 user nova-compute[75080]:   <path>/usr/bin/qemu-system-x86_64</path>
Dec 05 15:13:26 user nova-compute[75080]:   <domain>kvm</domain>
Dec 05 15:13:26 user nova-compute[75080]:   <machine>pc-i440fx-jammy</machine>
Dec 05 15:13:26 user nova-compute[75080]:   <arch>x86_64</arch>
Dec 05 15:13:26 user nova-compute[75080]:   <vcpu max='255'/>
Dec 05 15:13:26 user nova-compute[75080]:   <iothreads supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:   <os supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:     <enum name='firmware'>
Dec 05 15:13:26 user nova-compute[75080]:       <value>efi</value>
Dec 05 15:13:26 user nova-compute[75080]:     </enum>
Dec 05 15:13:26 user nova-compute[75080]:     <loader supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='type'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>rom</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>pflash</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='readonly'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>yes</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>no</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='secure'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>no</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </loader>
Dec 05 15:13:26 user nova-compute[75080]:   </os>
Dec 05 15:13:26 user nova-compute[75080]:   <cpu>
Dec 05 15:13:26 user nova-compute[75080]:     <mode name='host-passthrough' supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='hostPassthroughMigratable'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>on</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>off</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </mode>
Dec 05 15:13:26 user nova-compute[75080]:     <mode name='maximum' supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='maximumMigratable'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>on</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>off</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </mode>
Dec 05 15:13:26 user nova-compute[75080]:     <mode name='host-model' supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <vendor>Intel</vendor>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='ss'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='vmx'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='pcid'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='hypervisor'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='arat'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='tsc_adjust'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='umip'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='md-clear'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='stibp'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='arch-capabilities'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='ssbd'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='invtsc'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='ibpb'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='ibrs'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='amd-stibp'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='amd-ssbd'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='rsba'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='pschange-mc-no'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='disable' name='erms'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='disable' name='xsaveopt'/>
Dec 05 15:13:26 user nova-compute[75080]:     </mode>
Dec 05 15:13:26 user nova-compute[75080]:     <mode name='custom' supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>qemu64</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>qemu32</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>phenom</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>pentium3</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>pentium2</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>pentium</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>n270</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>kvm64</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>kvm32</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>coreduo</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>core2duo</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>athlon</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>Westmere-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>Westmere</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Snowridge</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Server</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Client</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>SandyBridge</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>Penryn</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Opteron_G5</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Opteron_G4</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Opteron_G3</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Opteron_G2</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>Opteron_G1</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>Nehalem-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>Nehalem</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>IvyBridge</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Icelake-Server</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Haswell-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Haswell-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Haswell</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>EPYC-Rome</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>EPYC-Milan</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>EPYC-IBPB</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>EPYC</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Dhyana</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Cooperlake</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>Conroe</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Cascadelake-Server</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Broadwell-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Broadwell-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Broadwell</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>486</model>
Dec 05 15:13:26 user nova-compute[75080]:     </mode>
Dec 05 15:13:26 user nova-compute[75080]:   </cpu>
Dec 05 15:13:26 user nova-compute[75080]:   <memoryBacking supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:     <enum name='sourceType'>
Dec 05 15:13:26 user nova-compute[75080]:       <value>file</value>
Dec 05 15:13:26 user nova-compute[75080]:       <value>anonymous</value>
Dec 05 15:13:26 user nova-compute[75080]:       <value>memfd</value>
Dec 05 15:13:26 user nova-compute[75080]:     </enum>
Dec 05 15:13:26 user nova-compute[75080]:   </memoryBacking>
Dec 05 15:13:26 user nova-compute[75080]:   <devices>
Dec 05 15:13:26 user nova-compute[75080]:     <disk supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='diskDevice'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>disk</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>cdrom</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>floppy</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>lun</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='bus'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>ide</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>fdc</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>scsi</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>usb</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>sata</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='model'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio-transitional</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio-non-transitional</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </disk>
Dec 05 15:13:26 user nova-compute[75080]:     <graphics supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='type'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>sdl</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>vnc</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>spice</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>egl-headless</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </graphics>
Dec 05 15:13:26 user nova-compute[75080]:     <video supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='modelType'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>vga</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>cirrus</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>vmvga</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>qxl</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>none</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>bochs</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>ramfb</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </video>
Dec 05 15:13:26 user nova-compute[75080]:     <hostdev supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='mode'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>subsystem</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='startupPolicy'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>default</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>mandatory</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>requisite</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>optional</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='subsysType'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>usb</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>pci</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>scsi</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='capsType'/>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='pciBackend'/>
Dec 05 15:13:26 user nova-compute[75080]:     </hostdev>
Dec 05 15:13:26 user nova-compute[75080]:     <rng supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='model'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio-transitional</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio-non-transitional</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='backendModel'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>random</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>egd</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>builtin</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </rng>
Dec 05 15:13:26 user nova-compute[75080]:     <filesystem supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='driverType'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>path</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>handle</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtiofs</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </filesystem>
Dec 05 15:13:26 user nova-compute[75080]:     <tpm supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='model'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>tpm-tis</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>tpm-crb</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='backendModel'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>passthrough</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>emulator</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </tpm>
Dec 05 15:13:26 user nova-compute[75080]:   </devices>
Dec 05 15:13:26 user nova-compute[75080]:   <features>
Dec 05 15:13:26 user nova-compute[75080]:     <gic supported='no'/>
Dec 05 15:13:26 user nova-compute[75080]:     <vmcoreinfo supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:     <genid supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:     <backingStoreInput supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:     <backup supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:     <sev supported='no'/>
Dec 05 15:13:26 user nova-compute[75080]:   </features>
Dec 05 15:13:26 user nova-compute[75080]: </domainCapabilities>
Dec 05 15:13:26 user nova-compute[75080]:  {{(pid=75080) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Dec 05 15:13:26 user nova-compute[75080]: <domainCapabilities>
Dec 05 15:13:26 user nova-compute[75080]:   <path>/usr/bin/qemu-system-x86_64</path>
Dec 05 15:13:26 user nova-compute[75080]:   <domain>kvm</domain>
Dec 05 15:13:26 user nova-compute[75080]:   <machine>pc-i440fx-6.2</machine>
Dec 05 15:13:26 user nova-compute[75080]:   <arch>x86_64</arch>
Dec 05 15:13:26 user nova-compute[75080]:   <vcpu max='255'/>
Dec 05 15:13:26 user nova-compute[75080]:   <iothreads supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:   <os supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:     <enum name='firmware'>
Dec 05 15:13:26 user nova-compute[75080]:       <value>efi</value>
Dec 05 15:13:26 user nova-compute[75080]:     </enum>
Dec 05 15:13:26 user nova-compute[75080]:     <loader supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='type'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>rom</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>pflash</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='readonly'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>yes</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>no</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='secure'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>no</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </loader>
Dec 05 15:13:26 user nova-compute[75080]:   </os>
Dec 05 15:13:26 user nova-compute[75080]:   <cpu>
Dec 05 15:13:26 user nova-compute[75080]:     <mode name='host-passthrough' supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='hostPassthroughMigratable'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>on</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>off</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </mode>
Dec 05 15:13:26 user nova-compute[75080]:     <mode name='maximum' supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='maximumMigratable'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>on</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>off</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </mode>
Dec 05 15:13:26 user nova-compute[75080]:     <mode name='host-model' supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <vendor>Intel</vendor>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='ss'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='vmx'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='pcid'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='hypervisor'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='arat'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='tsc_adjust'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='umip'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='md-clear'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='stibp'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='arch-capabilities'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='ssbd'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='invtsc'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='ibpb'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='ibrs'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='amd-stibp'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='amd-ssbd'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='rsba'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='pschange-mc-no'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='disable' name='erms'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='disable' name='xsaveopt'/>
Dec 05 15:13:26 user nova-compute[75080]:     </mode>
Dec 05 15:13:26 user nova-compute[75080]:     <mode name='custom' supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>qemu64</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>qemu32</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>phenom</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>pentium3</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>pentium2</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>pentium</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>n270</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>kvm64</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>kvm32</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>coreduo</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>core2duo</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>athlon</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>Westmere-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>Westmere</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Snowridge</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Server</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Client</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>SandyBridge</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>Penryn</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Opteron_G5</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Opteron_G4</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Opteron_G3</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Opteron_G2</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>Opteron_G1</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>Nehalem-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>Nehalem</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>IvyBridge</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Icelake-Server</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Haswell-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Haswell-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Haswell</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>EPYC-Rome</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>EPYC-Milan</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>EPYC-IBPB</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>EPYC</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Dhyana</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Cooperlake</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>Conroe</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Cascadelake-Server</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Broadwell-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Broadwell-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Broadwell</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>486</model>
Dec 05 15:13:26 user nova-compute[75080]:     </mode>
Dec 05 15:13:26 user nova-compute[75080]:   </cpu>
Dec 05 15:13:26 user nova-compute[75080]:   <memoryBacking supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:     <enum name='sourceType'>
Dec 05 15:13:26 user nova-compute[75080]:       <value>file</value>
Dec 05 15:13:26 user nova-compute[75080]:       <value>anonymous</value>
Dec 05 15:13:26 user nova-compute[75080]:       <value>memfd</value>
Dec 05 15:13:26 user nova-compute[75080]:     </enum>
Dec 05 15:13:26 user nova-compute[75080]:   </memoryBacking>
Dec 05 15:13:26 user nova-compute[75080]:   <devices>
Dec 05 15:13:26 user nova-compute[75080]:     <disk supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='diskDevice'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>disk</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>cdrom</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>floppy</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>lun</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='bus'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>ide</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>fdc</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>scsi</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>usb</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>sata</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='model'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio-transitional</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio-non-transitional</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </disk>
Dec 05 15:13:26 user nova-compute[75080]:     <graphics supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='type'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>sdl</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>vnc</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>spice</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>egl-headless</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </graphics>
Dec 05 15:13:26 user nova-compute[75080]:     <video supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='modelType'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>vga</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>cirrus</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>vmvga</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>qxl</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>none</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>bochs</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>ramfb</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </video>
Dec 05 15:13:26 user nova-compute[75080]:     <hostdev supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='mode'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>subsystem</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='startupPolicy'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>default</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>mandatory</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>requisite</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>optional</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='subsysType'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>usb</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>pci</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>scsi</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='capsType'/>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='pciBackend'/>
Dec 05 15:13:26 user nova-compute[75080]:     </hostdev>
Dec 05 15:13:26 user nova-compute[75080]:     <rng supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='model'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio-transitional</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio-non-transitional</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='backendModel'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>random</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>egd</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>builtin</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </rng>
Dec 05 15:13:26 user nova-compute[75080]:     <filesystem supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='driverType'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>path</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>handle</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtiofs</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </filesystem>
Dec 05 15:13:26 user nova-compute[75080]:     <tpm supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='model'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>tpm-tis</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>tpm-crb</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='backendModel'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>passthrough</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>emulator</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </tpm>
Dec 05 15:13:26 user nova-compute[75080]:   </devices>
Dec 05 15:13:26 user nova-compute[75080]:   <features>
Dec 05 15:13:26 user nova-compute[75080]:     <gic supported='no'/>
Dec 05 15:13:26 user nova-compute[75080]:     <vmcoreinfo supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:     <genid supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:     <backingStoreInput supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:     <backup supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:     <sev supported='no'/>
Dec 05 15:13:26 user nova-compute[75080]:   </features>
Dec 05 15:13:26 user nova-compute[75080]: </domainCapabilities>
Dec 05 15:13:26 user nova-compute[75080]:  {{(pid=75080) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Dec 05 15:13:26 user nova-compute[75080]: <domainCapabilities>
Dec 05 15:13:26 user nova-compute[75080]:   <path>/usr/bin/qemu-system-x86_64</path>
Dec 05 15:13:26 user nova-compute[75080]:   <domain>kvm</domain>
Dec 05 15:13:26 user nova-compute[75080]:   <machine>pc-q35-6.2</machine>
Dec 05 15:13:26 user nova-compute[75080]:   <arch>x86_64</arch>
Dec 05 15:13:26 user nova-compute[75080]:   <vcpu max='288'/>
Dec 05 15:13:26 user nova-compute[75080]:   <iothreads supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:   <os supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:     <enum name='firmware'>
Dec 05 15:13:26 user nova-compute[75080]:       <value>efi</value>
Dec 05 15:13:26 user nova-compute[75080]:     </enum>
Dec 05 15:13:26 user nova-compute[75080]:     <loader supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Dec 05 15:13:26 user nova-compute[75080]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Dec 05 15:13:26 user nova-compute[75080]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='type'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>rom</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>pflash</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='readonly'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>yes</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>no</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='secure'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>yes</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>no</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </loader>
Dec 05 15:13:26 user nova-compute[75080]:   </os>
Dec 05 15:13:26 user nova-compute[75080]:   <cpu>
Dec 05 15:13:26 user nova-compute[75080]:     <mode name='host-passthrough' supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='hostPassthroughMigratable'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>on</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>off</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </mode>
Dec 05 15:13:26 user nova-compute[75080]:     <mode name='maximum' supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='maximumMigratable'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>on</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>off</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </mode>
Dec 05 15:13:26 user nova-compute[75080]:     <mode name='host-model' supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <vendor>Intel</vendor>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='ss'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='vmx'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='pcid'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='hypervisor'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='arat'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='tsc_adjust'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='umip'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='md-clear'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='stibp'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='arch-capabilities'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='ssbd'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='invtsc'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='ibpb'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='ibrs'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='amd-stibp'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='amd-ssbd'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='rsba'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='require' name='pschange-mc-no'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='disable' name='erms'/>
Dec 05 15:13:26 user nova-compute[75080]:       <feature policy='disable' name='xsaveopt'/>
Dec 05 15:13:26 user nova-compute[75080]:     </mode>
Dec 05 15:13:26 user nova-compute[75080]:     <mode name='custom' supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>qemu64</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>qemu32</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>phenom</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>pentium3</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>pentium2</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>pentium</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>n270</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>kvm64</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>kvm32</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>coreduo</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>core2duo</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>athlon</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>Westmere-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>Westmere</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Snowridge</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Server</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Skylake-Client</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>SandyBridge</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>Penryn</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Opteron_G5</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Opteron_G4</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Opteron_G3</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Opteron_G2</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>Opteron_G1</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>Nehalem-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>Nehalem</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>IvyBridge</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Icelake-Server</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Haswell-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Haswell-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Haswell</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>EPYC-Rome</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>EPYC-Milan</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>EPYC-IBPB</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>EPYC</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Dhyana</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Cooperlake</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>Conroe</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Cascadelake-Server</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Broadwell-noTSX</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Broadwell-IBRS</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='no'>Broadwell</model>
Dec 05 15:13:26 user nova-compute[75080]:       <model usable='yes'>486</model>
Dec 05 15:13:26 user nova-compute[75080]:     </mode>
Dec 05 15:13:26 user nova-compute[75080]:   </cpu>
Dec 05 15:13:26 user nova-compute[75080]:   <memoryBacking supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:     <enum name='sourceType'>
Dec 05 15:13:26 user nova-compute[75080]:       <value>file</value>
Dec 05 15:13:26 user nova-compute[75080]:       <value>anonymous</value>
Dec 05 15:13:26 user nova-compute[75080]:       <value>memfd</value>
Dec 05 15:13:26 user nova-compute[75080]:     </enum>
Dec 05 15:13:26 user nova-compute[75080]:   </memoryBacking>
Dec 05 15:13:26 user nova-compute[75080]:   <devices>
Dec 05 15:13:26 user nova-compute[75080]:     <disk supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='diskDevice'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>disk</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>cdrom</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>floppy</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>lun</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='bus'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>fdc</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>scsi</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>usb</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>sata</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='model'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio-transitional</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio-non-transitional</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </disk>
Dec 05 15:13:26 user nova-compute[75080]:     <graphics supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='type'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>sdl</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>vnc</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>spice</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>egl-headless</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </graphics>
Dec 05 15:13:26 user nova-compute[75080]:     <video supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='modelType'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>vga</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>cirrus</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>vmvga</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>qxl</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>none</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>bochs</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>ramfb</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </video>
Dec 05 15:13:26 user nova-compute[75080]:     <hostdev supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='mode'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>subsystem</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='startupPolicy'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>default</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>mandatory</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>requisite</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>optional</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='subsysType'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>usb</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>pci</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>scsi</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='capsType'/>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='pciBackend'/>
Dec 05 15:13:26 user nova-compute[75080]:     </hostdev>
Dec 05 15:13:26 user nova-compute[75080]:     <rng supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='model'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio-transitional</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtio-non-transitional</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='backendModel'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>random</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>egd</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>builtin</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </rng>
Dec 05 15:13:26 user nova-compute[75080]:     <filesystem supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='driverType'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>path</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>handle</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>virtiofs</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </filesystem>
Dec 05 15:13:26 user nova-compute[75080]:     <tpm supported='yes'>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='model'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>tpm-tis</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>tpm-crb</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:       <enum name='backendModel'>
Dec 05 15:13:26 user nova-compute[75080]:         <value>passthrough</value>
Dec 05 15:13:26 user nova-compute[75080]:         <value>emulator</value>
Dec 05 15:13:26 user nova-compute[75080]:       </enum>
Dec 05 15:13:26 user nova-compute[75080]:     </tpm>
Dec 05 15:13:26 user nova-compute[75080]:   </devices>
Dec 05 15:13:26 user nova-compute[75080]:   <features>
Dec 05 15:13:26 user nova-compute[75080]:     <gic supported='no'/>
Dec 05 15:13:26 user nova-compute[75080]:     <vmcoreinfo supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:     <genid supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:     <backingStoreInput supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:     <backup supported='yes'/>
Dec 05 15:13:26 user nova-compute[75080]:     <sev supported='no'/>
Dec 05 15:13:26 user nova-compute[75080]:   </features>
Dec 05 15:13:26 user nova-compute[75080]: </domainCapabilities>
Dec 05 15:13:26 user nova-compute[75080]:  {{(pid=75080) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Checking secure boot support for host arch (x86_64) {{(pid=75080) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Dec 05 15:13:26 user nova-compute[75080]: INFO nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Secure Boot support detected
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] cpu compare xml: <cpu match="exact">
Dec 05 15:13:26 user nova-compute[75080]:   <model>Nehalem</model>
Dec 05 15:13:26 user nova-compute[75080]: </cpu>
Dec 05 15:13:26 user nova-compute[75080]:  {{(pid=75080) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10025}}
Dec 05 15:13:26 user nova-compute[75080]: INFO nova.virt.node [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Generated node identity 21b770fa-b774-46c9-9415-db26064ccd0f
Dec 05 15:13:26 user nova-compute[75080]: INFO nova.virt.node [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Wrote node identity 21b770fa-b774-46c9-9415-db26064ccd0f to /opt/stack/data/nova/compute_id
Dec 05 15:13:26 user nova-compute[75080]: WARNING nova.compute.manager [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Compute nodes ['21b770fa-b774-46c9-9415-db26064ccd0f'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Dec 05 15:13:26 user nova-compute[75080]: INFO nova.compute.manager [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Dec 05 15:13:26 user nova-compute[75080]: WARNING nova.compute.manager [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Dec 05 15:13:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:13:26 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:13:26 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:13:26 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Hypervisor/Node resource view: name=user free_ram=11004MB free_disk=26.09539794921875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:13:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:13:26 user nova-compute[75080]: WARNING nova.compute.resource_tracker [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] No compute node record for user:21b770fa-b774-46c9-9415-db26064ccd0f: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 21b770fa-b774-46c9-9415-db26064ccd0f could not be found.
Dec 05 15:13:26 user nova-compute[75080]: INFO nova.compute.resource_tracker [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Compute node record created for user:user with uuid: 21b770fa-b774-46c9-9415-db26064ccd0f
Dec 05 15:13:27 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:13:27 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:13:27 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] [req-d179a3b5-8c93-49a5-aaa8-a8b39e0c241c] Created resource provider record via placement API for resource provider with UUID 21b770fa-b774-46c9-9415-db26064ccd0f and name user.
Dec 05 15:13:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75080) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}}
Dec 05 15:13:27 user nova-compute[75080]: INFO nova.virt.libvirt.host [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] kernel doesn't support AMD SEV
Dec 05 15:13:27 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Updating inventory in ProviderTree for provider 21b770fa-b774-46c9-9415-db26064ccd0f with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 15:13:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:13:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Libvirt baseline CPU <cpu>
Dec 05 15:13:27 user nova-compute[75080]:   <arch>x86_64</arch>
Dec 05 15:13:27 user nova-compute[75080]:   <model>Nehalem</model>
Dec 05 15:13:27 user nova-compute[75080]:   <vendor>Intel</vendor>
Dec 05 15:13:27 user nova-compute[75080]:   <topology sockets="6" cores="1" threads="1"/>
Dec 05 15:13:27 user nova-compute[75080]: </cpu>
Dec 05 15:13:27 user nova-compute[75080]:  {{(pid=75080) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12524}}
Dec 05 15:13:27 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Updated inventory for provider 21b770fa-b774-46c9-9415-db26064ccd0f with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Dec 05 15:13:27 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Updating resource provider 21b770fa-b774-46c9-9415-db26064ccd0f generation from 0 to 1 during operation: update_inventory {{(pid=75080) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Dec 05 15:13:27 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Updating inventory in ProviderTree for provider 21b770fa-b774-46c9-9415-db26064ccd0f with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 15:13:27 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Updating resource provider 21b770fa-b774-46c9-9415-db26064ccd0f generation from 1 to 2 during operation: update_traits {{(pid=75080) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Dec 05 15:13:27 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:13:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.626s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:13:27 user nova-compute[75080]: DEBUG nova.service [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Creating RPC server for service compute {{(pid=75080) start /opt/stack/nova/nova/service.py:182}}
Dec 05 15:13:27 user nova-compute[75080]: DEBUG nova.service [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] Join ServiceGroup membership for this service compute {{(pid=75080) start /opt/stack/nova/nova/service.py:199}}
Dec 05 15:13:27 user nova-compute[75080]: DEBUG nova.servicegroup.drivers.db [None req-56cd647b-a368-495e-8e0e-b5bece039c42 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75080) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Dec 05 15:14:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:14:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:14:22 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:14:22 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Rebuilding the list of instances to heal {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 15:14:22 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Didn't find any instances for network info cache update. {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 15:14:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:14:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:14:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:14:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:14:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:14:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:14:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:14:22 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:14:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:14:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:14:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:14:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:14:22 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:14:22 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:14:22 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:14:22 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=10328MB free_disk=25.999107360839844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:14:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:14:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:14:23 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:14:23 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:14:23 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:14:23 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:14:23 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:14:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.208s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:14:23 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:15:19 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:15:19 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:15:19 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:15:19 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:15:19 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:15:19 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:15:19 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:15:19 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:15:19 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:15:19 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:15:19 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Rebuilding the list of instances to heal {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 15:15:19 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Didn't find any instances for network info cache update. {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 15:15:19 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:15:19 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:15:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:15:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:15:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:15:19 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:15:19 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:15:19 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:15:19 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=10379MB free_disk=26.064102172851562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:15:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:15:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:15:19 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:15:19 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:15:19 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:15:19 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:15:19 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:15:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:16:18 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:16:19 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:16:19 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:16:19 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Rebuilding the list of instances to heal {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 15:16:19 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Didn't find any instances for network info cache update. {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 15:16:19 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:16:19 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:16:19 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:16:20 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:16:20 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:16:20 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:16:20 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:16:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:16:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:16:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:16:20 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:16:20 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:16:20 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:16:20 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=10355MB free_disk=25.815959930419922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:16:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:16:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:16:20 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:16:20 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:16:20 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:16:20 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:16:20 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:16:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.107s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:16:21 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:17:19 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:17:19 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:17:20 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:17:20 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:17:20 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Rebuilding the list of instances to heal {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 15:17:20 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Didn't find any instances for network info cache update. {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 15:17:20 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:17:20 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:17:21 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:17:21 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:17:21 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:17:21 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:17:21 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:17:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:17:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:17:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:17:21 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:17:21 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:17:21 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:17:21 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=9674MB free_disk=25.836593627929688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:17:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:17:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:17:21 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:17:21 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:17:21 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:17:21 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:17:21 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:17:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.149s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:17:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:17:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Acquiring lock "bd75375a-8b70-4bc2-a72b-14213ebaa4e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:17:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Lock "bd75375a-8b70-4bc2-a72b-14213ebaa4e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:17:29 user nova-compute[75080]: DEBUG nova.compute.manager [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:17:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:17:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:17:29 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:17:29 user nova-compute[75080]: INFO nova.compute.claims [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Claim successful on node user
Dec 05 15:17:29 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:17:29 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:17:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.306s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:17:29 user nova-compute[75080]: DEBUG nova.compute.manager [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:17:30 user nova-compute[75080]: DEBUG nova.compute.manager [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:17:30 user nova-compute[75080]: DEBUG nova.network.neutron [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:17:30 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:17:30 user nova-compute[75080]: DEBUG nova.compute.manager [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:17:30 user nova-compute[75080]: DEBUG nova.compute.manager [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:17:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:17:30 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Creating image(s)
Dec 05 15:17:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Acquiring lock "/opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:17:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Lock "/opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:17:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Lock "/opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:17:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:17:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:17:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee.part --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:17:31 user nova-compute[75080]: DEBUG nova.policy [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e06d18d33aaa442dba24fbd214a49f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e73fbf2c414f32bcdeef4bae598b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:17:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee.part --force-share --output=json" returned: 0 in 0.197s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:17:31 user nova-compute[75080]: DEBUG nova.virt.images [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] 945b9282-153c-4cca-bc1c-40b0d399f793 was qcow2, converting to raw {{(pid=75080) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 05 15:17:31 user nova-compute[75080]: DEBUG nova.privsep.utils [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75080) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 15:17:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee.part /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee.converted {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:17:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee.part /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee.converted" returned: 0 in 0.311s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:17:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee.converted --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:17:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee.converted --force-share --output=json" returned: 0 in 0.165s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:17:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.338s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:17:31 user nova-compute[75080]: INFO oslo.privsep.daemon [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp4bzifdxw/privsep.sock']
Dec 05 15:17:31 user sudo[84375]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp4bzifdxw/privsep.sock
Dec 05 15:17:31 user sudo[84375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Dec 05 15:17:33 user sudo[84375]: pam_unix(sudo:session): session closed for user root
Dec 05 15:17:33 user nova-compute[75080]: INFO oslo.privsep.daemon [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Spawned new privsep daemon via rootwrap
Dec 05 15:17:33 user nova-compute[75080]: INFO oslo.privsep.daemon [-] privsep daemon starting
Dec 05 15:17:33 user nova-compute[75080]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Dec 05 15:17:33 user nova-compute[75080]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Dec 05 15:17:33 user nova-compute[75080]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84378
Dec 05 15:17:33 user nova-compute[75080]: DEBUG nova.network.neutron [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Successfully created port: 06f46569-efd3-4978-b954-cdbb51b09e30 {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:17:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:17:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.189s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:17:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:17:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:17:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:17:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.205s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:17:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:17:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk 1073741824" returned: 0 in 0.060s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:17:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:17:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:17:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.219s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:17:34 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 15:17:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:17:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:17:34 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Cannot resize image /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 15:17:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:17:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Ensure instance console log exists: /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:17:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:17:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:17:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:17:35 user nova-compute[75080]: DEBUG nova.network.neutron [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Successfully updated port: 06f46569-efd3-4978-b954-cdbb51b09e30 {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:17:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Acquiring lock "refresh_cache-bd75375a-8b70-4bc2-a72b-14213ebaa4e9" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:17:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Acquired lock "refresh_cache-bd75375a-8b70-4bc2-a72b-14213ebaa4e9" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:17:35 user nova-compute[75080]: DEBUG nova.network.neutron [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:17:35 user nova-compute[75080]: DEBUG nova.network.neutron [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG nova.compute.manager [req-65f187b0-dc65-4e98-8e30-3d08420f3b91 req-91ab55e9-b53e-4365-94f6-731e04c882cc service nova] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Received event network-changed-06f46569-efd3-4978-b954-cdbb51b09e30 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG nova.compute.manager [req-65f187b0-dc65-4e98-8e30-3d08420f3b91 req-91ab55e9-b53e-4365-94f6-731e04c882cc service nova] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Refreshing instance network info cache due to event network-changed-06f46569-efd3-4978-b954-cdbb51b09e30. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-65f187b0-dc65-4e98-8e30-3d08420f3b91 req-91ab55e9-b53e-4365-94f6-731e04c882cc service nova] Acquiring lock "refresh_cache-bd75375a-8b70-4bc2-a72b-14213ebaa4e9" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG nova.network.neutron [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Updating instance_info_cache with network_info: [{"id": "06f46569-efd3-4978-b954-cdbb51b09e30", "address": "fa:16:3e:8e:cb:88", "network": {"id": "05b09885-a021-44b4-b8d6-1504a4c2dfeb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1903039338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e73fbf2c414f32bcdeef4bae598b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f46569-ef", "ovs_interfaceid": "06f46569-efd3-4978-b954-cdbb51b09e30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Releasing lock "refresh_cache-bd75375a-8b70-4bc2-a72b-14213ebaa4e9" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG nova.compute.manager [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Instance network_info: |[{"id": "06f46569-efd3-4978-b954-cdbb51b09e30", "address": "fa:16:3e:8e:cb:88", "network": {"id": "05b09885-a021-44b4-b8d6-1504a4c2dfeb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1903039338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e73fbf2c414f32bcdeef4bae598b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f46569-ef", "ovs_interfaceid": "06f46569-efd3-4978-b954-cdbb51b09e30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-65f187b0-dc65-4e98-8e30-3d08420f3b91 req-91ab55e9-b53e-4365-94f6-731e04c882cc service nova] Acquired lock "refresh_cache-bd75375a-8b70-4bc2-a72b-14213ebaa4e9" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG nova.network.neutron [req-65f187b0-dc65-4e98-8e30-3d08420f3b91 req-91ab55e9-b53e-4365-94f6-731e04c882cc service nova] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Refreshing network info cache for port 06f46569-efd3-4978-b954-cdbb51b09e30 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Start _get_guest_xml network_info=[{"id": "06f46569-efd3-4978-b954-cdbb51b09e30", "address": "fa:16:3e:8e:cb:88", "network": {"id": "05b09885-a021-44b4-b8d6-1504a4c2dfeb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1903039338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e73fbf2c414f32bcdeef4bae598b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f46569-ef", "ovs_interfaceid": "06f46569-efd3-4978-b954-cdbb51b09e30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:17:36 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:17:36 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:17:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG nova.privsep.utils [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75080) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:17:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1899701466',display_name='tempest-ServersNegativeTestJSON-server-1899701466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1899701466',id=1,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48e73fbf2c414f32bcdeef4bae598b2f',ramdisk_id='',reservation_id='r-5iwn6f9j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-32084328',owner_user_name='tempest-ServersNegativeTestJSON-32084328-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:17:30Z,user_data=None,user_id='e06d18d33aaa442dba24fbd214a49f9d',uuid=bd75375a-8b70-4bc2-a72b-14213ebaa4e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06f46569-efd3-4978-b954-cdbb51b09e30", "address": "fa:16:3e:8e:cb:88", "network": {"id": "05b09885-a021-44b4-b8d6-1504a4c2dfeb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1903039338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e73fbf2c414f32bcdeef4bae598b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f46569-ef", "ovs_interfaceid": "06f46569-efd3-4978-b954-cdbb51b09e30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Converting VIF {"id": "06f46569-efd3-4978-b954-cdbb51b09e30", "address": "fa:16:3e:8e:cb:88", "network": {"id": "05b09885-a021-44b4-b8d6-1504a4c2dfeb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1903039338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e73fbf2c414f32bcdeef4bae598b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f46569-ef", "ovs_interfaceid": "06f46569-efd3-4978-b954-cdbb51b09e30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:cb:88,bridge_name='br-int',has_traffic_filtering=True,id=06f46569-efd3-4978-b954-cdbb51b09e30,network=Network(05b09885-a021-44b4-b8d6-1504a4c2dfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06f46569-ef') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG nova.objects.instance [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Lazy-loading 'pci_devices' on Instance uuid bd75375a-8b70-4bc2-a72b-14213ebaa4e9 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "eedd1529-4feb-4f85-8625-0c20d8e0359d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "eedd1529-4feb-4f85-8625-0c20d8e0359d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:17:36 user nova-compute[75080]:   <uuid>bd75375a-8b70-4bc2-a72b-14213ebaa4e9</uuid>
Dec 05 15:17:36 user nova-compute[75080]:   <name>instance-00000001</name>
Dec 05 15:17:36 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:17:36 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:17:36 user nova-compute[75080]:   <metadata>
Dec 05 15:17:36 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:17:36 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:17:36 user nova-compute[75080]:       <nova:name>tempest-ServersNegativeTestJSON-server-1899701466</nova:name>
Dec 05 15:17:36 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:17:36</nova:creationTime>
Dec 05 15:17:36 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:17:36 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:17:36 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:17:36 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:17:36 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:17:36 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:17:36 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:17:36 user nova-compute[75080]:       <nova:owner>
Dec 05 15:17:36 user nova-compute[75080]:         <nova:user uuid="e06d18d33aaa442dba24fbd214a49f9d">tempest-ServersNegativeTestJSON-32084328-project-member</nova:user>
Dec 05 15:17:36 user nova-compute[75080]:         <nova:project uuid="48e73fbf2c414f32bcdeef4bae598b2f">tempest-ServersNegativeTestJSON-32084328</nova:project>
Dec 05 15:17:36 user nova-compute[75080]:       </nova:owner>
Dec 05 15:17:36 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:17:36 user nova-compute[75080]:       <nova:ports>
Dec 05 15:17:36 user nova-compute[75080]:         <nova:port uuid="06f46569-efd3-4978-b954-cdbb51b09e30">
Dec 05 15:17:36 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 05 15:17:36 user nova-compute[75080]:         </nova:port>
Dec 05 15:17:36 user nova-compute[75080]:       </nova:ports>
Dec 05 15:17:36 user nova-compute[75080]:     </nova:instance>
Dec 05 15:17:36 user nova-compute[75080]:   </metadata>
Dec 05 15:17:36 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:17:36 user nova-compute[75080]:     <system>
Dec 05 15:17:36 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:17:36 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:17:36 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:17:36 user nova-compute[75080]:       <entry name="serial">bd75375a-8b70-4bc2-a72b-14213ebaa4e9</entry>
Dec 05 15:17:36 user nova-compute[75080]:       <entry name="uuid">bd75375a-8b70-4bc2-a72b-14213ebaa4e9</entry>
Dec 05 15:17:36 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:17:36 user nova-compute[75080]:     </system>
Dec 05 15:17:36 user nova-compute[75080]:   </sysinfo>
Dec 05 15:17:36 user nova-compute[75080]:   <os>
Dec 05 15:17:36 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:17:36 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:17:36 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:17:36 user nova-compute[75080]:   </os>
Dec 05 15:17:36 user nova-compute[75080]:   <features>
Dec 05 15:17:36 user nova-compute[75080]:     <acpi/>
Dec 05 15:17:36 user nova-compute[75080]:     <apic/>
Dec 05 15:17:36 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:17:36 user nova-compute[75080]:   </features>
Dec 05 15:17:36 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:17:36 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:17:36 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:17:36 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:17:36 user nova-compute[75080]:   </clock>
Dec 05 15:17:36 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:17:36 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:17:36 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:17:36 user nova-compute[75080]:   </cpu>
Dec 05 15:17:36 user nova-compute[75080]:   <devices>
Dec 05 15:17:36 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:17:36 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:17:36 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk"/>
Dec 05 15:17:36 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:17:36 user nova-compute[75080]:     </disk>
Dec 05 15:17:36 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:17:36 user nova-compute[75080]:       <mac address="fa:16:3e:8e:cb:88"/>
Dec 05 15:17:36 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:17:36 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:17:36 user nova-compute[75080]:       <target dev="tap06f46569-ef"/>
Dec 05 15:17:36 user nova-compute[75080]:     </interface>
Dec 05 15:17:36 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:17:36 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/console.log" append="off"/>
Dec 05 15:17:36 user nova-compute[75080]:     </serial>
Dec 05 15:17:36 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:17:36 user nova-compute[75080]:     <video>
Dec 05 15:17:36 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:17:36 user nova-compute[75080]:     </video>
Dec 05 15:17:36 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:17:36 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:17:36 user nova-compute[75080]:     </rng>
Dec 05 15:17:36 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:17:36 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:17:36 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:17:36 user nova-compute[75080]:     </memballoon>
Dec 05 15:17:36 user nova-compute[75080]:   </devices>
Dec 05 15:17:36 user nova-compute[75080]: </domain>
Dec 05 15:17:36 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:17:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1899701466',display_name='tempest-ServersNegativeTestJSON-server-1899701466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1899701466',id=1,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48e73fbf2c414f32bcdeef4bae598b2f',ramdisk_id='',reservation_id='r-5iwn6f9j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-32084328',owner_user_name='tempest-ServersNegativeTestJSON-32084328-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:17:30Z,user_data=None,user_id='e06d18d33aaa442dba24fbd214a49f9d',uuid=bd75375a-8b70-4bc2-a72b-14213ebaa4e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06f46569-efd3-4978-b954-cdbb51b09e30", "address": "fa:16:3e:8e:cb:88", "network": {"id": "05b09885-a021-44b4-b8d6-1504a4c2dfeb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1903039338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e73fbf2c414f32bcdeef4bae598b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f46569-ef", "ovs_interfaceid": "06f46569-efd3-4978-b954-cdbb51b09e30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Converting VIF {"id": "06f46569-efd3-4978-b954-cdbb51b09e30", "address": "fa:16:3e:8e:cb:88", "network": {"id": "05b09885-a021-44b4-b8d6-1504a4c2dfeb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1903039338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e73fbf2c414f32bcdeef4bae598b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f46569-ef", "ovs_interfaceid": "06f46569-efd3-4978-b954-cdbb51b09e30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:cb:88,bridge_name='br-int',has_traffic_filtering=True,id=06f46569-efd3-4978-b954-cdbb51b09e30,network=Network(05b09885-a021-44b4-b8d6-1504a4c2dfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06f46569-ef') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG os_vif [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:cb:88,bridge_name='br-int',has_traffic_filtering=True,id=06f46569-efd3-4978-b954-cdbb51b09e30,network=Network(05b09885-a021-44b4-b8d6-1504a4c2dfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06f46569-ef') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG nova.compute.manager [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Created schema index Interface.name {{(pid=75080) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Created schema index Port.name {{(pid=75080) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Created schema index Bridge.name {{(pid=75080) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [POLLOUT] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:17:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:17:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4d1597ed-5d9c-504a-9c6a-ffdb7a36ac65', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:17:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:37 user nova-compute[75080]: INFO oslo.privsep.daemon [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpyddl38lz/privsep.sock']
Dec 05 15:17:37 user sudo[84404]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpyddl38lz/privsep.sock
Dec 05 15:17:37 user sudo[84404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Dec 05 15:17:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:17:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:17:37 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:17:37 user nova-compute[75080]: INFO nova.compute.claims [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Claim successful on node user
Dec 05 15:17:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:37 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:17:37 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:17:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.325s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:17:37 user nova-compute[75080]: DEBUG nova.compute.manager [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:17:37 user nova-compute[75080]: DEBUG nova.compute.manager [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:17:37 user nova-compute[75080]: DEBUG nova.network.neutron [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:17:37 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:17:37 user nova-compute[75080]: DEBUG nova.compute.manager [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:17:37 user nova-compute[75080]: DEBUG nova.network.neutron [req-65f187b0-dc65-4e98-8e30-3d08420f3b91 req-91ab55e9-b53e-4365-94f6-731e04c882cc service nova] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Updated VIF entry in instance network info cache for port 06f46569-efd3-4978-b954-cdbb51b09e30. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:17:37 user nova-compute[75080]: DEBUG nova.network.neutron [req-65f187b0-dc65-4e98-8e30-3d08420f3b91 req-91ab55e9-b53e-4365-94f6-731e04c882cc service nova] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Updating instance_info_cache with network_info: [{"id": "06f46569-efd3-4978-b954-cdbb51b09e30", "address": "fa:16:3e:8e:cb:88", "network": {"id": "05b09885-a021-44b4-b8d6-1504a4c2dfeb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1903039338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e73fbf2c414f32bcdeef4bae598b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f46569-ef", "ovs_interfaceid": "06f46569-efd3-4978-b954-cdbb51b09e30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:17:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-65f187b0-dc65-4e98-8e30-3d08420f3b91 req-91ab55e9-b53e-4365-94f6-731e04c882cc service nova] Releasing lock "refresh_cache-bd75375a-8b70-4bc2-a72b-14213ebaa4e9" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:17:37 user nova-compute[75080]: DEBUG nova.compute.manager [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:17:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:17:37 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Creating image(s)
Dec 05 15:17:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "/opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:17:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "/opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:17:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "/opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:17:37 user nova-compute[75080]: DEBUG nova.policy [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8e99cb2f1c4541fd9a656e038f4afac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f49255d5b74f448dc941027afbf84a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:17:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:17:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.182s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:17:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:17:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:17:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:17:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.194s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:17:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:17:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk 1073741824" returned: 0 in 0.044s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:17:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:17:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:17:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.149s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:17:38 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 15:17:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:17:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:17:38 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Cannot resize image /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 15:17:38 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:17:38 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Ensure instance console log exists: /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:17:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:17:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:17:38 user sudo[84404]: pam_unix(sudo:session): session closed for user root
Dec 05 15:17:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:17:38 user nova-compute[75080]: INFO oslo.privsep.daemon [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Spawned new privsep daemon via rootwrap
Dec 05 15:17:38 user nova-compute[75080]: INFO oslo.privsep.daemon [-] privsep daemon starting
Dec 05 15:17:38 user nova-compute[75080]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Dec 05 15:17:38 user nova-compute[75080]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Dec 05 15:17:38 user nova-compute[75080]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84420
Dec 05 15:17:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06f46569-ef, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:17:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap06f46569-ef, col_values=(('qos', UUID('416b3eeb-bf0a-417e-aba9-6b43d186f999')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:17:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap06f46569-ef, col_values=(('external_ids', {'iface-id': '06f46569-efd3-4978-b954-cdbb51b09e30', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:cb:88', 'vm-uuid': 'bd75375a-8b70-4bc2-a72b-14213ebaa4e9'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:17:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:17:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:39 user nova-compute[75080]: INFO os_vif [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:cb:88,bridge_name='br-int',has_traffic_filtering=True,id=06f46569-efd3-4978-b954-cdbb51b09e30,network=Network(05b09885-a021-44b4-b8d6-1504a4c2dfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06f46569-ef')
Dec 05 15:17:39 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:17:39 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] No VIF found with MAC fa:16:3e:8e:cb:88, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:17:39 user nova-compute[75080]: DEBUG nova.network.neutron [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Successfully created port: f0094ba7-45c2-445b-bd35-d5c7aedd68bd {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:17:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:41 user nova-compute[75080]: DEBUG nova.network.neutron [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Successfully updated port: f0094ba7-45c2-445b-bd35-d5c7aedd68bd {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:17:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "refresh_cache-eedd1529-4feb-4f85-8625-0c20d8e0359d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:17:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquired lock "refresh_cache-eedd1529-4feb-4f85-8625-0c20d8e0359d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:17:41 user nova-compute[75080]: DEBUG nova.network.neutron [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:17:41 user nova-compute[75080]: DEBUG nova.compute.manager [req-a33b5f30-4793-4f17-ae9f-55dc8b83aa6c req-be36dee7-16b3-415b-87f5-b7c4c85cdd4e service nova] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Received event network-changed-f0094ba7-45c2-445b-bd35-d5c7aedd68bd {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:17:41 user nova-compute[75080]: DEBUG nova.compute.manager [req-a33b5f30-4793-4f17-ae9f-55dc8b83aa6c req-be36dee7-16b3-415b-87f5-b7c4c85cdd4e service nova] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Refreshing instance network info cache due to event network-changed-f0094ba7-45c2-445b-bd35-d5c7aedd68bd. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:17:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a33b5f30-4793-4f17-ae9f-55dc8b83aa6c req-be36dee7-16b3-415b-87f5-b7c4c85cdd4e service nova] Acquiring lock "refresh_cache-eedd1529-4feb-4f85-8625-0c20d8e0359d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:17:41 user nova-compute[75080]: DEBUG nova.network.neutron [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:17:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.network.neutron [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Updating instance_info_cache with network_info: [{"id": "f0094ba7-45c2-445b-bd35-d5c7aedd68bd", "address": "fa:16:3e:f9:84:93", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0094ba7-45", "ovs_interfaceid": "f0094ba7-45c2-445b-bd35-d5c7aedd68bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Releasing lock "refresh_cache-eedd1529-4feb-4f85-8625-0c20d8e0359d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.compute.manager [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Instance network_info: |[{"id": "f0094ba7-45c2-445b-bd35-d5c7aedd68bd", "address": "fa:16:3e:f9:84:93", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0094ba7-45", "ovs_interfaceid": "f0094ba7-45c2-445b-bd35-d5c7aedd68bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a33b5f30-4793-4f17-ae9f-55dc8b83aa6c req-be36dee7-16b3-415b-87f5-b7c4c85cdd4e service nova] Acquired lock "refresh_cache-eedd1529-4feb-4f85-8625-0c20d8e0359d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.network.neutron [req-a33b5f30-4793-4f17-ae9f-55dc8b83aa6c req-be36dee7-16b3-415b-87f5-b7c4c85cdd4e service nova] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Refreshing network info cache for port f0094ba7-45c2-445b-bd35-d5c7aedd68bd {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Start _get_guest_xml network_info=[{"id": "f0094ba7-45c2-445b-bd35-d5c7aedd68bd", "address": "fa:16:3e:f9:84:93", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0094ba7-45", "ovs_interfaceid": "f0094ba7-45c2-445b-bd35-d5c7aedd68bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:42 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:17:42 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2054899921',display_name='tempest-ServerActionsTestOtherA-server-2054899921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2054899921',id=2,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIP5nbHwDP3MaLimasQ81bdHfaI0CFiTpw2YpAxQTZDkv+5y7AL53TfAVsSe07r4BvGkQeGQdB4lyczKq+WcllL3mLq5dj12AlRuMlnnGy3kUrnJXEIK2cec4EX/PelNSA==',key_name='tempest-keypair-1219993291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50f49255d5b74f448dc941027afbf84a',ramdisk_id='',reservation_id='r-0o6z2oq7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-393209338',owner_user_name='tempest-ServerActionsTestOtherA-393209338-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:17:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e99cb2f1c4541fd9a656e038f4afac3',uuid=eedd1529-4feb-4f85-8625-0c20d8e0359d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0094ba7-45c2-445b-bd35-d5c7aedd68bd", "address": "fa:16:3e:f9:84:93", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0094ba7-45", "ovs_interfaceid": "f0094ba7-45c2-445b-bd35-d5c7aedd68bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Converting VIF {"id": "f0094ba7-45c2-445b-bd35-d5c7aedd68bd", "address": "fa:16:3e:f9:84:93", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0094ba7-45", "ovs_interfaceid": "f0094ba7-45c2-445b-bd35-d5c7aedd68bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:84:93,bridge_name='br-int',has_traffic_filtering=True,id=f0094ba7-45c2-445b-bd35-d5c7aedd68bd,network=Network(efba4a7e-3a56-41d2-8af7-4c064ba641fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0094ba7-45') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.objects.instance [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lazy-loading 'pci_devices' on Instance uuid eedd1529-4feb-4f85-8625-0c20d8e0359d {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:17:42 user nova-compute[75080]:   <uuid>eedd1529-4feb-4f85-8625-0c20d8e0359d</uuid>
Dec 05 15:17:42 user nova-compute[75080]:   <name>instance-00000002</name>
Dec 05 15:17:42 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:17:42 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:17:42 user nova-compute[75080]:   <metadata>
Dec 05 15:17:42 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:17:42 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:17:42 user nova-compute[75080]:       <nova:name>tempest-ServerActionsTestOtherA-server-2054899921</nova:name>
Dec 05 15:17:42 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:17:42</nova:creationTime>
Dec 05 15:17:42 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:17:42 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:17:42 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:17:42 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:17:42 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:17:42 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:17:42 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:17:42 user nova-compute[75080]:       <nova:owner>
Dec 05 15:17:42 user nova-compute[75080]:         <nova:user uuid="8e99cb2f1c4541fd9a656e038f4afac3">tempest-ServerActionsTestOtherA-393209338-project-member</nova:user>
Dec 05 15:17:42 user nova-compute[75080]:         <nova:project uuid="50f49255d5b74f448dc941027afbf84a">tempest-ServerActionsTestOtherA-393209338</nova:project>
Dec 05 15:17:42 user nova-compute[75080]:       </nova:owner>
Dec 05 15:17:42 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:17:42 user nova-compute[75080]:       <nova:ports>
Dec 05 15:17:42 user nova-compute[75080]:         <nova:port uuid="f0094ba7-45c2-445b-bd35-d5c7aedd68bd">
Dec 05 15:17:42 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 05 15:17:42 user nova-compute[75080]:         </nova:port>
Dec 05 15:17:42 user nova-compute[75080]:       </nova:ports>
Dec 05 15:17:42 user nova-compute[75080]:     </nova:instance>
Dec 05 15:17:42 user nova-compute[75080]:   </metadata>
Dec 05 15:17:42 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:17:42 user nova-compute[75080]:     <system>
Dec 05 15:17:42 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:17:42 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:17:42 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:17:42 user nova-compute[75080]:       <entry name="serial">eedd1529-4feb-4f85-8625-0c20d8e0359d</entry>
Dec 05 15:17:42 user nova-compute[75080]:       <entry name="uuid">eedd1529-4feb-4f85-8625-0c20d8e0359d</entry>
Dec 05 15:17:42 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:17:42 user nova-compute[75080]:     </system>
Dec 05 15:17:42 user nova-compute[75080]:   </sysinfo>
Dec 05 15:17:42 user nova-compute[75080]:   <os>
Dec 05 15:17:42 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:17:42 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:17:42 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:17:42 user nova-compute[75080]:   </os>
Dec 05 15:17:42 user nova-compute[75080]:   <features>
Dec 05 15:17:42 user nova-compute[75080]:     <acpi/>
Dec 05 15:17:42 user nova-compute[75080]:     <apic/>
Dec 05 15:17:42 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:17:42 user nova-compute[75080]:   </features>
Dec 05 15:17:42 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:17:42 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:17:42 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:17:42 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:17:42 user nova-compute[75080]:   </clock>
Dec 05 15:17:42 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:17:42 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:17:42 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:17:42 user nova-compute[75080]:   </cpu>
Dec 05 15:17:42 user nova-compute[75080]:   <devices>
Dec 05 15:17:42 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:17:42 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:17:42 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk"/>
Dec 05 15:17:42 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:17:42 user nova-compute[75080]:     </disk>
Dec 05 15:17:42 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:17:42 user nova-compute[75080]:       <mac address="fa:16:3e:f9:84:93"/>
Dec 05 15:17:42 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:17:42 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:17:42 user nova-compute[75080]:       <target dev="tapf0094ba7-45"/>
Dec 05 15:17:42 user nova-compute[75080]:     </interface>
Dec 05 15:17:42 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:17:42 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/console.log" append="off"/>
Dec 05 15:17:42 user nova-compute[75080]:     </serial>
Dec 05 15:17:42 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:17:42 user nova-compute[75080]:     <video>
Dec 05 15:17:42 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:17:42 user nova-compute[75080]:     </video>
Dec 05 15:17:42 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:17:42 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:17:42 user nova-compute[75080]:     </rng>
Dec 05 15:17:42 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:17:42 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:17:42 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:17:42 user nova-compute[75080]:     </memballoon>
Dec 05 15:17:42 user nova-compute[75080]:   </devices>
Dec 05 15:17:42 user nova-compute[75080]: </domain>
Dec 05 15:17:42 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2054899921',display_name='tempest-ServerActionsTestOtherA-server-2054899921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2054899921',id=2,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIP5nbHwDP3MaLimasQ81bdHfaI0CFiTpw2YpAxQTZDkv+5y7AL53TfAVsSe07r4BvGkQeGQdB4lyczKq+WcllL3mLq5dj12AlRuMlnnGy3kUrnJXEIK2cec4EX/PelNSA==',key_name='tempest-keypair-1219993291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50f49255d5b74f448dc941027afbf84a',ramdisk_id='',reservation_id='r-0o6z2oq7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-393209338',owner_user_name='tempest-ServerActionsTestOtherA-393209338-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:17:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e99cb2f1c4541fd9a656e038f4afac3',uuid=eedd1529-4feb-4f85-8625-0c20d8e0359d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0094ba7-45c2-445b-bd35-d5c7aedd68bd", "address": "fa:16:3e:f9:84:93", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0094ba7-45", "ovs_interfaceid": "f0094ba7-45c2-445b-bd35-d5c7aedd68bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Converting VIF {"id": "f0094ba7-45c2-445b-bd35-d5c7aedd68bd", "address": "fa:16:3e:f9:84:93", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0094ba7-45", "ovs_interfaceid": "f0094ba7-45c2-445b-bd35-d5c7aedd68bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:84:93,bridge_name='br-int',has_traffic_filtering=True,id=f0094ba7-45c2-445b-bd35-d5c7aedd68bd,network=Network(efba4a7e-3a56-41d2-8af7-4c064ba641fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0094ba7-45') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG os_vif [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:84:93,bridge_name='br-int',has_traffic_filtering=True,id=f0094ba7-45c2-445b-bd35-d5c7aedd68bd,network=Network(efba4a7e-3a56-41d2-8af7-4c064ba641fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0094ba7-45') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7c8777fc-67c0-5a5d-b26f-b6dc3f1eb15f', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0094ba7-45, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf0094ba7-45, col_values=(('qos', UUID('1b12f7cb-c461-4356-881e-6d046c336650')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf0094ba7-45, col_values=(('external_ids', {'iface-id': 'f0094ba7-45c2-445b-bd35-d5c7aedd68bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:84:93', 'vm-uuid': 'eedd1529-4feb-4f85-8625-0c20d8e0359d'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:42 user nova-compute[75080]: INFO os_vif [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:84:93,bridge_name='br-int',has_traffic_filtering=True,id=f0094ba7-45c2-445b-bd35-d5c7aedd68bd,network=Network(efba4a7e-3a56-41d2-8af7-4c064ba641fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0094ba7-45')
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] No VIF found with MAC fa:16:3e:f9:84:93, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.compute.manager [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:17:42 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Instance spawned successfully.
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:17:42 user nova-compute[75080]: INFO nova.compute.manager [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Took 12.33 seconds to spawn the instance on the hypervisor.
Dec 05 15:17:42 user nova-compute[75080]: DEBUG nova.compute.manager [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:17:42 user nova-compute[75080]: INFO nova.compute.manager [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Took 13.48 seconds to build instance.
Dec 05 15:17:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07d773a6-15b8-47cd-9f2c-4fad294a39e3 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Lock "bd75375a-8b70-4bc2-a72b-14213ebaa4e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.880s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:17:43 user nova-compute[75080]: DEBUG nova.network.neutron [req-a33b5f30-4793-4f17-ae9f-55dc8b83aa6c req-be36dee7-16b3-415b-87f5-b7c4c85cdd4e service nova] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Updated VIF entry in instance network info cache for port f0094ba7-45c2-445b-bd35-d5c7aedd68bd. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:17:43 user nova-compute[75080]: DEBUG nova.network.neutron [req-a33b5f30-4793-4f17-ae9f-55dc8b83aa6c req-be36dee7-16b3-415b-87f5-b7c4c85cdd4e service nova] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Updating instance_info_cache with network_info: [{"id": "f0094ba7-45c2-445b-bd35-d5c7aedd68bd", "address": "fa:16:3e:f9:84:93", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0094ba7-45", "ovs_interfaceid": "f0094ba7-45c2-445b-bd35-d5c7aedd68bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:17:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a33b5f30-4793-4f17-ae9f-55dc8b83aa6c req-be36dee7-16b3-415b-87f5-b7c4c85cdd4e service nova] Releasing lock "refresh_cache-eedd1529-4feb-4f85-8625-0c20d8e0359d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:17:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:46 user nova-compute[75080]: DEBUG nova.compute.manager [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:17:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:17:46 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Instance spawned successfully.
Dec 05 15:17:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:17:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:17:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:17:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:17:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:17:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:17:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:17:46 user nova-compute[75080]: INFO nova.compute.manager [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Took 9.19 seconds to spawn the instance on the hypervisor.
Dec 05 15:17:46 user nova-compute[75080]: DEBUG nova.compute.manager [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:17:47 user nova-compute[75080]: INFO nova.compute.manager [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Took 10.02 seconds to build instance.
Dec 05 15:17:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-66afe8fa-f61e-46b0-a23d-ed56e1154ea0 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "eedd1529-4feb-4f85-8625-0c20d8e0359d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.302s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:17:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Acquiring lock "a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:17:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.013s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:17:51 user nova-compute[75080]: DEBUG nova.compute.manager [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:17:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:17:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:17:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Acquiring lock "0259351f-617f-47be-bfb6-2fef1c35bf15" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:17:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lock "0259351f-617f-47be-bfb6-2fef1c35bf15" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:17:51 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:17:51 user nova-compute[75080]: INFO nova.compute.claims [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Claim successful on node user
Dec 05 15:17:51 user nova-compute[75080]: DEBUG nova.compute.manager [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:17:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:17:51 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:17:51 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:17:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:17:51 user nova-compute[75080]: DEBUG nova.compute.manager [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:17:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.216s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:17:51 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:17:51 user nova-compute[75080]: INFO nova.compute.claims [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Claim successful on node user
Dec 05 15:17:51 user nova-compute[75080]: DEBUG nova.compute.manager [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:17:51 user nova-compute[75080]: DEBUG nova.network.neutron [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:17:51 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:17:51 user nova-compute[75080]: DEBUG nova.compute.manager [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:17:52 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:17:52 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:17:52 user nova-compute[75080]: DEBUG nova.compute.manager [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:17:52 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:17:52 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Creating image(s)
Dec 05 15:17:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:17:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "/opt/stack/data/nova/instances/a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:17:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "/opt/stack/data/nova/instances/a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:17:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:17:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.425s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:17:52 user nova-compute[75080]: DEBUG nova.compute.manager [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:17:52 user nova-compute[75080]: DEBUG nova.policy [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5fa6ef27452432c8c1b6d57906b9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74a9586932440678d59170e174336a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:17:52 user nova-compute[75080]: DEBUG nova.compute.manager [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:17:52 user nova-compute[75080]: DEBUG nova.network.neutron [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:17:52 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:17:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.211s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:17:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:17:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:17:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:17:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:52 user nova-compute[75080]: DEBUG nova.compute.manager [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:17:52 user nova-compute[75080]: DEBUG nova.policy [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2bd4a8e35eed47d1b156037a6dda5668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e3fe3c0db24db598f947ebfe7a8b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:17:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.248s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:17:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:17:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1/disk 1073741824" returned: 0 in 0.063s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:17:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.316s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:17:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:17:52 user nova-compute[75080]: DEBUG nova.compute.manager [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:17:52 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:17:52 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Creating image(s)
Dec 05 15:17:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Acquiring lock "/opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:17:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lock "/opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:17:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lock "/opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:17:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:17:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.274s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:17:52 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 15:17:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:17:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.233s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:17:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:17:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:17:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:17:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:17:53 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Cannot resize image /opt/stack/data/nova/instances/a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 15:17:53 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:17:53 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Ensure instance console log exists: /opt/stack/data/nova/instances/a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:17:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:17:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:17:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:17:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Acquiring lock "f3cdfe20-7429-476d-9914-8141ba8b7488" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:17:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Lock "f3cdfe20-7429-476d-9914-8141ba8b7488" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:17:53 user nova-compute[75080]: DEBUG nova.compute.manager [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:17:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.269s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:17:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:17:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/disk 1073741824" returned: 0 in 0.075s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:17:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.350s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:17:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:17:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:17:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:17:53 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:17:53 user nova-compute[75080]: INFO nova.compute.claims [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Claim successful on node user
Dec 05 15:17:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.213s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:17:53 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 15:17:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:17:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:17:53 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Cannot resize image /opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 15:17:53 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:17:53 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Ensure instance console log exists: /opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:17:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:17:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:17:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:17:53 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:17:53 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:17:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.602s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:17:54 user nova-compute[75080]: DEBUG nova.compute.manager [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:17:54 user nova-compute[75080]: DEBUG nova.network.neutron [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Successfully created port: 74eb53ef-5ba7-4bd5-81af-d6adede99fad {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:17:54 user nova-compute[75080]: DEBUG nova.compute.manager [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:17:54 user nova-compute[75080]: DEBUG nova.network.neutron [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:17:54 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Dec 05 15:17:54 user nova-compute[75080]: DEBUG nova.network.neutron [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Successfully created port: 3e2379bd-6e97-45dc-917b-e8e4478a3be0 {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:17:54 user nova-compute[75080]: DEBUG nova.compute.manager [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:17:54 user nova-compute[75080]: DEBUG nova.policy [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6e7816a5ba3b4d0c91cd742070069bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2a6722602c4978b5eb12cdce13bb1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:17:54 user nova-compute[75080]: DEBUG nova.compute.manager [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:17:54 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:17:54 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Creating image(s)
Dec 05 15:17:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Acquiring lock "/opt/stack/data/nova/instances/f3cdfe20-7429-476d-9914-8141ba8b7488/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:17:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Lock "/opt/stack/data/nova/instances/f3cdfe20-7429-476d-9914-8141ba8b7488/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:17:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Lock "/opt/stack/data/nova/instances/f3cdfe20-7429-476d-9914-8141ba8b7488/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.040s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:17:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Acquiring lock "2065b70a707228fa5425420645de326baa55157b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:17:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Lock "2065b70a707228fa5425420645de326baa55157b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:17:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2065b70a707228fa5425420645de326baa55157b.part --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:17:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2065b70a707228fa5425420645de326baa55157b.part --force-share --output=json" returned: 0 in 0.255s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:17:55 user nova-compute[75080]: DEBUG nova.virt.images [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] d433c1b8-6238-4615-b3e0-770c9979eaa3 was qcow2, converting to raw {{(pid=75080) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 05 15:17:55 user nova-compute[75080]: DEBUG nova.privsep.utils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75080) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 15:17:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2065b70a707228fa5425420645de326baa55157b.part /opt/stack/data/nova/instances/_base/2065b70a707228fa5425420645de326baa55157b.converted {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:17:55 user nova-compute[75080]: DEBUG nova.network.neutron [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Successfully updated port: 74eb53ef-5ba7-4bd5-81af-d6adede99fad {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:17:55 user nova-compute[75080]: DEBUG nova.network.neutron [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Successfully updated port: 3e2379bd-6e97-45dc-917b-e8e4478a3be0 {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:17:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Acquiring lock "refresh_cache-a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:17:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Acquired lock "refresh_cache-a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:17:55 user nova-compute[75080]: DEBUG nova.network.neutron [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:17:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Acquiring lock "refresh_cache-0259351f-617f-47be-bfb6-2fef1c35bf15" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:17:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Acquired lock "refresh_cache-0259351f-617f-47be-bfb6-2fef1c35bf15" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:17:55 user nova-compute[75080]: DEBUG nova.network.neutron [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:17:55 user nova-compute[75080]: DEBUG nova.compute.manager [req-079c7aac-55be-4327-9b26-0ee0288181b6 req-a6abcd4a-b3ae-41de-be79-3b65dd2cf2e2 service nova] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Received event network-changed-74eb53ef-5ba7-4bd5-81af-d6adede99fad {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:17:55 user nova-compute[75080]: DEBUG nova.compute.manager [req-079c7aac-55be-4327-9b26-0ee0288181b6 req-a6abcd4a-b3ae-41de-be79-3b65dd2cf2e2 service nova] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Refreshing instance network info cache due to event network-changed-74eb53ef-5ba7-4bd5-81af-d6adede99fad. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:17:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-079c7aac-55be-4327-9b26-0ee0288181b6 req-a6abcd4a-b3ae-41de-be79-3b65dd2cf2e2 service nova] Acquiring lock "refresh_cache-a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:17:55 user nova-compute[75080]: DEBUG nova.network.neutron [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:17:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2065b70a707228fa5425420645de326baa55157b.part /opt/stack/data/nova/instances/_base/2065b70a707228fa5425420645de326baa55157b.converted" returned: 0 in 0.587s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:17:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2065b70a707228fa5425420645de326baa55157b.converted --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG nova.network.neutron [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG nova.network.neutron [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Successfully created port: a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347 {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2065b70a707228fa5425420645de326baa55157b.converted --force-share --output=json" returned: 0 in 0.267s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Lock "2065b70a707228fa5425420645de326baa55157b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.772s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2065b70a707228fa5425420645de326baa55157b --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2065b70a707228fa5425420645de326baa55157b --force-share --output=json" returned: 0 in 0.214s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Acquiring lock "2065b70a707228fa5425420645de326baa55157b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Lock "2065b70a707228fa5425420645de326baa55157b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2065b70a707228fa5425420645de326baa55157b --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG nova.network.neutron [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Updating instance_info_cache with network_info: [{"id": "3e2379bd-6e97-45dc-917b-e8e4478a3be0", "address": "fa:16:3e:68:6e:ba", "network": {"id": "1adc7b37-8fcb-4b25-92e7-e746874f778b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-490224437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24e3fe3c0db24db598f947ebfe7a8b3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2379bd-6e", "ovs_interfaceid": "3e2379bd-6e97-45dc-917b-e8e4478a3be0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG nova.network.neutron [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Updating instance_info_cache with network_info: [{"id": "74eb53ef-5ba7-4bd5-81af-d6adede99fad", "address": "fa:16:3e:91:12:8c", "network": {"id": "ecbc1165-663e-47ca-87c7-ecda194bb3cc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-140281562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b74a9586932440678d59170e174336a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74eb53ef-5b", "ovs_interfaceid": "74eb53ef-5ba7-4bd5-81af-d6adede99fad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2065b70a707228fa5425420645de326baa55157b --force-share --output=json" returned: 0 in 0.257s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Acquiring lock "1830878a-71e0-48f1-85b8-9ed83b1419cd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Lock "1830878a-71e0-48f1-85b8-9ed83b1419cd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2065b70a707228fa5425420645de326baa55157b,backing_fmt=raw /opt/stack/data/nova/instances/f3cdfe20-7429-476d-9914-8141ba8b7488/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Releasing lock "refresh_cache-0259351f-617f-47be-bfb6-2fef1c35bf15" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG nova.compute.manager [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Instance network_info: |[{"id": "3e2379bd-6e97-45dc-917b-e8e4478a3be0", "address": "fa:16:3e:68:6e:ba", "network": {"id": "1adc7b37-8fcb-4b25-92e7-e746874f778b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-490224437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24e3fe3c0db24db598f947ebfe7a8b3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2379bd-6e", "ovs_interfaceid": "3e2379bd-6e97-45dc-917b-e8e4478a3be0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Releasing lock "refresh_cache-a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG nova.compute.manager [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Instance network_info: |[{"id": "74eb53ef-5ba7-4bd5-81af-d6adede99fad", "address": "fa:16:3e:91:12:8c", "network": {"id": "ecbc1165-663e-47ca-87c7-ecda194bb3cc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-140281562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b74a9586932440678d59170e174336a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74eb53ef-5b", "ovs_interfaceid": "74eb53ef-5ba7-4bd5-81af-d6adede99fad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Start _get_guest_xml network_info=[{"id": "3e2379bd-6e97-45dc-917b-e8e4478a3be0", "address": "fa:16:3e:68:6e:ba", "network": {"id": "1adc7b37-8fcb-4b25-92e7-e746874f778b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-490224437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24e3fe3c0db24db598f947ebfe7a8b3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2379bd-6e", "ovs_interfaceid": "3e2379bd-6e97-45dc-917b-e8e4478a3be0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-079c7aac-55be-4327-9b26-0ee0288181b6 req-a6abcd4a-b3ae-41de-be79-3b65dd2cf2e2 service nova] Acquired lock "refresh_cache-a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG nova.network.neutron [req-079c7aac-55be-4327-9b26-0ee0288181b6 req-a6abcd4a-b3ae-41de-be79-3b65dd2cf2e2 service nova] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Refreshing network info cache for port 74eb53ef-5ba7-4bd5-81af-d6adede99fad {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Start _get_guest_xml network_info=[{"id": "74eb53ef-5ba7-4bd5-81af-d6adede99fad", "address": "fa:16:3e:91:12:8c", "network": {"id": "ecbc1165-663e-47ca-87c7-ecda194bb3cc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-140281562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b74a9586932440678d59170e174336a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74eb53ef-5b", "ovs_interfaceid": "74eb53ef-5ba7-4bd5-81af-d6adede99fad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2065b70a707228fa5425420645de326baa55157b,backing_fmt=raw /opt/stack/data/nova/instances/f3cdfe20-7429-476d-9914-8141ba8b7488/disk 1073741824" returned: 0 in 0.081s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Lock "2065b70a707228fa5425420645de326baa55157b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.357s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2065b70a707228fa5425420645de326baa55157b --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:17:56 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:17:56 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:17:56 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:17:56 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:17:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:17:56 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-640774861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-640774861',id=4,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOcchwMQ/y1AsP3A0b3QpAgR94U3k1ch+DL7mOp5G4Jk3dTtQRet9PTuUq+tE9S2nFGwMJzhzoriFDCKnxJ67e/D1DfTAZHVMm0T9FYpXt1Eg6HZqWa1ZIEyx+Gye4eIQ==',key_name='tempest-keypair-1279310443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24e3fe3c0db24db598f947ebfe7a8b3d',ramdisk_id='',reservation_id='r-yuqxc4c9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1860660485',owner_user_name='tempest-TaggedAttachmentsTest-1860660485-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:17:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bd4a8e35eed47d1b156037a6dda5668',uuid=0259351f-617f-47be-bfb6-2fef1c35bf15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e2379bd-6e97-45dc-917b-e8e4478a3be0", "address": "fa:16:3e:68:6e:ba", "network": {"id": "1adc7b37-8fcb-4b25-92e7-e746874f778b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-490224437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24e3fe3c0db24db598f947ebfe7a8b3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2379bd-6e", "ovs_interfaceid": "3e2379bd-6e97-45dc-917b-e8e4478a3be0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Converting VIF {"id": "3e2379bd-6e97-45dc-917b-e8e4478a3be0", "address": "fa:16:3e:68:6e:ba", "network": {"id": "1adc7b37-8fcb-4b25-92e7-e746874f778b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-490224437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24e3fe3c0db24db598f947ebfe7a8b3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2379bd-6e", "ovs_interfaceid": "3e2379bd-6e97-45dc-917b-e8e4478a3be0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:6e:ba,bridge_name='br-int',has_traffic_filtering=True,id=3e2379bd-6e97-45dc-917b-e8e4478a3be0,network=Network(1adc7b37-8fcb-4b25-92e7-e746874f778b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e2379bd-6e') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.objects.instance [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lazy-loading 'pci_devices' on Instance uuid 0259351f-617f-47be-bfb6-2fef1c35bf15 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:17:57 user nova-compute[75080]:   <uuid>0259351f-617f-47be-bfb6-2fef1c35bf15</uuid>
Dec 05 15:17:57 user nova-compute[75080]:   <name>instance-00000004</name>
Dec 05 15:17:57 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:17:57 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:17:57 user nova-compute[75080]:   <metadata>
Dec 05 15:17:57 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:17:57 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:17:57 user nova-compute[75080]:       <nova:name>tempest-device-tagging-server-640774861</nova:name>
Dec 05 15:17:57 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:17:56</nova:creationTime>
Dec 05 15:17:57 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:17:57 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:17:57 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:17:57 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:17:57 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:17:57 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:17:57 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:17:57 user nova-compute[75080]:       <nova:owner>
Dec 05 15:17:57 user nova-compute[75080]:         <nova:user uuid="2bd4a8e35eed47d1b156037a6dda5668">tempest-TaggedAttachmentsTest-1860660485-project-member</nova:user>
Dec 05 15:17:57 user nova-compute[75080]:         <nova:project uuid="24e3fe3c0db24db598f947ebfe7a8b3d">tempest-TaggedAttachmentsTest-1860660485</nova:project>
Dec 05 15:17:57 user nova-compute[75080]:       </nova:owner>
Dec 05 15:17:57 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:17:57 user nova-compute[75080]:       <nova:ports>
Dec 05 15:17:57 user nova-compute[75080]:         <nova:port uuid="3e2379bd-6e97-45dc-917b-e8e4478a3be0">
Dec 05 15:17:57 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 05 15:17:57 user nova-compute[75080]:         </nova:port>
Dec 05 15:17:57 user nova-compute[75080]:       </nova:ports>
Dec 05 15:17:57 user nova-compute[75080]:     </nova:instance>
Dec 05 15:17:57 user nova-compute[75080]:   </metadata>
Dec 05 15:17:57 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:17:57 user nova-compute[75080]:     <system>
Dec 05 15:17:57 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:17:57 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:17:57 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:17:57 user nova-compute[75080]:       <entry name="serial">0259351f-617f-47be-bfb6-2fef1c35bf15</entry>
Dec 05 15:17:57 user nova-compute[75080]:       <entry name="uuid">0259351f-617f-47be-bfb6-2fef1c35bf15</entry>
Dec 05 15:17:57 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:17:57 user nova-compute[75080]:     </system>
Dec 05 15:17:57 user nova-compute[75080]:   </sysinfo>
Dec 05 15:17:57 user nova-compute[75080]:   <os>
Dec 05 15:17:57 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:17:57 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:17:57 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:17:57 user nova-compute[75080]:   </os>
Dec 05 15:17:57 user nova-compute[75080]:   <features>
Dec 05 15:17:57 user nova-compute[75080]:     <acpi/>
Dec 05 15:17:57 user nova-compute[75080]:     <apic/>
Dec 05 15:17:57 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:17:57 user nova-compute[75080]:   </features>
Dec 05 15:17:57 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:17:57 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:17:57 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:17:57 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:17:57 user nova-compute[75080]:   </clock>
Dec 05 15:17:57 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:17:57 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:17:57 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:17:57 user nova-compute[75080]:   </cpu>
Dec 05 15:17:57 user nova-compute[75080]:   <devices>
Dec 05 15:17:57 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:17:57 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:17:57 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/disk"/>
Dec 05 15:17:57 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:17:57 user nova-compute[75080]:     </disk>
Dec 05 15:17:57 user nova-compute[75080]:     <disk type="file" device="cdrom">
Dec 05 15:17:57 user nova-compute[75080]:       <driver name="qemu" type="raw" cache="none"/>
Dec 05 15:17:57 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/disk.config"/>
Dec 05 15:17:57 user nova-compute[75080]:       <target dev="hda" bus="ide"/>
Dec 05 15:17:57 user nova-compute[75080]:     </disk>
Dec 05 15:17:57 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:17:57 user nova-compute[75080]:       <mac address="fa:16:3e:68:6e:ba"/>
Dec 05 15:17:57 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:17:57 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:17:57 user nova-compute[75080]:       <target dev="tap3e2379bd-6e"/>
Dec 05 15:17:57 user nova-compute[75080]:     </interface>
Dec 05 15:17:57 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:17:57 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/console.log" append="off"/>
Dec 05 15:17:57 user nova-compute[75080]:     </serial>
Dec 05 15:17:57 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:17:57 user nova-compute[75080]:     <video>
Dec 05 15:17:57 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:17:57 user nova-compute[75080]:     </video>
Dec 05 15:17:57 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:17:57 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:17:57 user nova-compute[75080]:     </rng>
Dec 05 15:17:57 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:17:57 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:17:57 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:17:57 user nova-compute[75080]:     </memballoon>
Dec 05 15:17:57 user nova-compute[75080]:   </devices>
Dec 05 15:17:57 user nova-compute[75080]: </domain>
Dec 05 15:17:57 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-640774861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-640774861',id=4,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOcchwMQ/y1AsP3A0b3QpAgR94U3k1ch+DL7mOp5G4Jk3dTtQRet9PTuUq+tE9S2nFGwMJzhzoriFDCKnxJ67e/D1DfTAZHVMm0T9FYpXt1Eg6HZqWa1ZIEyx+Gye4eIQ==',key_name='tempest-keypair-1279310443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24e3fe3c0db24db598f947ebfe7a8b3d',ramdisk_id='',reservation_id='r-yuqxc4c9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1860660485',owner_user_name='tempest-TaggedAttachmentsTest-1860660485-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:17:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bd4a8e35eed47d1b156037a6dda5668',uuid=0259351f-617f-47be-bfb6-2fef1c35bf15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e2379bd-6e97-45dc-917b-e8e4478a3be0", "address": "fa:16:3e:68:6e:ba", "network": {"id": "1adc7b37-8fcb-4b25-92e7-e746874f778b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-490224437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24e3fe3c0db24db598f947ebfe7a8b3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2379bd-6e", "ovs_interfaceid": "3e2379bd-6e97-45dc-917b-e8e4478a3be0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Converting VIF {"id": "3e2379bd-6e97-45dc-917b-e8e4478a3be0", "address": "fa:16:3e:68:6e:ba", "network": {"id": "1adc7b37-8fcb-4b25-92e7-e746874f778b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-490224437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24e3fe3c0db24db598f947ebfe7a8b3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2379bd-6e", "ovs_interfaceid": "3e2379bd-6e97-45dc-917b-e8e4478a3be0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:6e:ba,bridge_name='br-int',has_traffic_filtering=True,id=3e2379bd-6e97-45dc-917b-e8e4478a3be0,network=Network(1adc7b37-8fcb-4b25-92e7-e746874f778b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e2379bd-6e') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG os_vif [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:6e:ba,bridge_name='br-int',has_traffic_filtering=True,id=3e2379bd-6e97-45dc-917b-e8e4478a3be0,network=Network(1adc7b37-8fcb-4b25-92e7-e746874f778b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e2379bd-6e') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:17:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1667564362',display_name='tempest-VolumesAdminNegativeTest-server-1667564362',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1667564362',id=3,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP84ajR7JlPz0n3dSjpDcYFR2MUC+ZKxgUqnM0aZwdALi+CuKwd54BTsH8/Lu4DU7cLK9cttGC5uWVIKI1z8hDZYzxM2qL58dSjkFlQVbwNxmgZpcyFJxlDypWxpl/z1Lg==',key_name='tempest-keypair-1497616147',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b74a9586932440678d59170e174336a1',ramdisk_id='',reservation_id='r-uc2i7fuy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-98453510',owner_user_name='tempest-VolumesAdminNegativeTest-98453510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:17:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5fa6ef27452432c8c1b6d57906b9de2',uuid=a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74eb53ef-5ba7-4bd5-81af-d6adede99fad", "address": "fa:16:3e:91:12:8c", "network": {"id": "ecbc1165-663e-47ca-87c7-ecda194bb3cc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-140281562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b74a9586932440678d59170e174336a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74eb53ef-5b", "ovs_interfaceid": "74eb53ef-5ba7-4bd5-81af-d6adede99fad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Converting VIF {"id": "74eb53ef-5ba7-4bd5-81af-d6adede99fad", "address": "fa:16:3e:91:12:8c", "network": {"id": "ecbc1165-663e-47ca-87c7-ecda194bb3cc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-140281562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b74a9586932440678d59170e174336a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74eb53ef-5b", "ovs_interfaceid": "74eb53ef-5ba7-4bd5-81af-d6adede99fad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:12:8c,bridge_name='br-int',has_traffic_filtering=True,id=74eb53ef-5ba7-4bd5-81af-d6adede99fad,network=Network(ecbc1165-663e-47ca-87c7-ecda194bb3cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74eb53ef-5b') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.objects.instance [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lazy-loading 'pci_devices' on Instance uuid a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9d80e893-7e86-513e-bb61-322835ce4915', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2065b70a707228fa5425420645de326baa55157b --force-share --output=json" returned: 0 in 0.259s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f3cdfe20-7429-476d-9914-8141ba8b7488/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3cdfe20-7429-476d-9914-8141ba8b7488/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:17:57 user nova-compute[75080]: INFO nova.compute.claims [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Claim successful on node user
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:17:57 user nova-compute[75080]:   <uuid>a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1</uuid>
Dec 05 15:17:57 user nova-compute[75080]:   <name>instance-00000003</name>
Dec 05 15:17:57 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:17:57 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:17:57 user nova-compute[75080]:   <metadata>
Dec 05 15:17:57 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:17:57 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:17:57 user nova-compute[75080]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1667564362</nova:name>
Dec 05 15:17:57 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:17:56</nova:creationTime>
Dec 05 15:17:57 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:17:57 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:17:57 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:17:57 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:17:57 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:17:57 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:17:57 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:17:57 user nova-compute[75080]:       <nova:owner>
Dec 05 15:17:57 user nova-compute[75080]:         <nova:user uuid="d5fa6ef27452432c8c1b6d57906b9de2">tempest-VolumesAdminNegativeTest-98453510-project-member</nova:user>
Dec 05 15:17:57 user nova-compute[75080]:         <nova:project uuid="b74a9586932440678d59170e174336a1">tempest-VolumesAdminNegativeTest-98453510</nova:project>
Dec 05 15:17:57 user nova-compute[75080]:       </nova:owner>
Dec 05 15:17:57 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:17:57 user nova-compute[75080]:       <nova:ports>
Dec 05 15:17:57 user nova-compute[75080]:         <nova:port uuid="74eb53ef-5ba7-4bd5-81af-d6adede99fad">
Dec 05 15:17:57 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 05 15:17:57 user nova-compute[75080]:         </nova:port>
Dec 05 15:17:57 user nova-compute[75080]:       </nova:ports>
Dec 05 15:17:57 user nova-compute[75080]:     </nova:instance>
Dec 05 15:17:57 user nova-compute[75080]:   </metadata>
Dec 05 15:17:57 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:17:57 user nova-compute[75080]:     <system>
Dec 05 15:17:57 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:17:57 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:17:57 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:17:57 user nova-compute[75080]:       <entry name="serial">a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1</entry>
Dec 05 15:17:57 user nova-compute[75080]:       <entry name="uuid">a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1</entry>
Dec 05 15:17:57 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:17:57 user nova-compute[75080]:     </system>
Dec 05 15:17:57 user nova-compute[75080]:   </sysinfo>
Dec 05 15:17:57 user nova-compute[75080]:   <os>
Dec 05 15:17:57 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:17:57 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:17:57 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:17:57 user nova-compute[75080]:   </os>
Dec 05 15:17:57 user nova-compute[75080]:   <features>
Dec 05 15:17:57 user nova-compute[75080]:     <acpi/>
Dec 05 15:17:57 user nova-compute[75080]:     <apic/>
Dec 05 15:17:57 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:17:57 user nova-compute[75080]:   </features>
Dec 05 15:17:57 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:17:57 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:17:57 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:17:57 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:17:57 user nova-compute[75080]:   </clock>
Dec 05 15:17:57 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:17:57 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:17:57 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:17:57 user nova-compute[75080]:   </cpu>
Dec 05 15:17:57 user nova-compute[75080]:   <devices>
Dec 05 15:17:57 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:17:57 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:17:57 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1/disk"/>
Dec 05 15:17:57 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:17:57 user nova-compute[75080]:     </disk>
Dec 05 15:17:57 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:17:57 user nova-compute[75080]:       <mac address="fa:16:3e:91:12:8c"/>
Dec 05 15:17:57 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:17:57 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:17:57 user nova-compute[75080]:       <target dev="tap74eb53ef-5b"/>
Dec 05 15:17:57 user nova-compute[75080]:     </interface>
Dec 05 15:17:57 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:17:57 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1/console.log" append="off"/>
Dec 05 15:17:57 user nova-compute[75080]:     </serial>
Dec 05 15:17:57 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:17:57 user nova-compute[75080]:     <video>
Dec 05 15:17:57 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:17:57 user nova-compute[75080]:     </video>
Dec 05 15:17:57 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:17:57 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:17:57 user nova-compute[75080]:     </rng>
Dec 05 15:17:57 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:17:57 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:17:57 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:17:57 user nova-compute[75080]:     </memballoon>
Dec 05 15:17:57 user nova-compute[75080]:   </devices>
Dec 05 15:17:57 user nova-compute[75080]: </domain>
Dec 05 15:17:57 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:17:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1667564362',display_name='tempest-VolumesAdminNegativeTest-server-1667564362',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1667564362',id=3,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP84ajR7JlPz0n3dSjpDcYFR2MUC+ZKxgUqnM0aZwdALi+CuKwd54BTsH8/Lu4DU7cLK9cttGC5uWVIKI1z8hDZYzxM2qL58dSjkFlQVbwNxmgZpcyFJxlDypWxpl/z1Lg==',key_name='tempest-keypair-1497616147',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b74a9586932440678d59170e174336a1',ramdisk_id='',reservation_id='r-uc2i7fuy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-98453510',owner_user_name='tempest-VolumesAdminNegativeTest-98453510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:17:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5fa6ef27452432c8c1b6d57906b9de2',uuid=a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74eb53ef-5ba7-4bd5-81af-d6adede99fad", "address": "fa:16:3e:91:12:8c", "network": {"id": "ecbc1165-663e-47ca-87c7-ecda194bb3cc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-140281562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b74a9586932440678d59170e174336a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74eb53ef-5b", "ovs_interfaceid": "74eb53ef-5ba7-4bd5-81af-d6adede99fad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Converting VIF {"id": "74eb53ef-5ba7-4bd5-81af-d6adede99fad", "address": "fa:16:3e:91:12:8c", "network": {"id": "ecbc1165-663e-47ca-87c7-ecda194bb3cc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-140281562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b74a9586932440678d59170e174336a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74eb53ef-5b", "ovs_interfaceid": "74eb53ef-5ba7-4bd5-81af-d6adede99fad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:12:8c,bridge_name='br-int',has_traffic_filtering=True,id=74eb53ef-5ba7-4bd5-81af-d6adede99fad,network=Network(ecbc1165-663e-47ca-87c7-ecda194bb3cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74eb53ef-5b') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG os_vif [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:12:8c,bridge_name='br-int',has_traffic_filtering=True,id=74eb53ef-5ba7-4bd5-81af-d6adede99fad,network=Network(ecbc1165-663e-47ca-87c7-ecda194bb3cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74eb53ef-5b') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '118ea6ed-a80f-54d1-9e14-4a1fd0b0e832', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e2379bd-6e, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3e2379bd-6e, col_values=(('qos', UUID('12581444-a5c8-47d6-88a1-13a3bf673f2c')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3e2379bd-6e, col_values=(('external_ids', {'iface-id': '3e2379bd-6e97-45dc-917b-e8e4478a3be0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:6e:ba', 'vm-uuid': '0259351f-617f-47be-bfb6-2fef1c35bf15'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:57 user nova-compute[75080]: INFO os_vif [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:6e:ba,bridge_name='br-int',has_traffic_filtering=True,id=3e2379bd-6e97-45dc-917b-e8e4478a3be0,network=Network(1adc7b37-8fcb-4b25-92e7-e746874f778b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e2379bd-6e')
Dec 05 15:17:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74eb53ef-5b, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap74eb53ef-5b, col_values=(('qos', UUID('7df76fe1-e4a6-4746-bca1-8b55668fd874')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap74eb53ef-5b, col_values=(('external_ids', {'iface-id': '74eb53ef-5ba7-4bd5-81af-d6adede99fad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:12:8c', 'vm-uuid': 'a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:57 user nova-compute[75080]: INFO os_vif [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:12:8c,bridge_name='br-int',has_traffic_filtering=True,id=74eb53ef-5ba7-4bd5-81af-d6adede99fad,network=Network(ecbc1165-663e-47ca-87c7-ecda194bb3cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74eb53ef-5b')
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] No BDM found with device name hda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] No VIF found with MAC fa:16:3e:68:6e:ba, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:17:57 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Using config drive
Dec 05 15:17:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3cdfe20-7429-476d-9914-8141ba8b7488/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Cannot resize image /opt/stack/data/nova/instances/f3cdfe20-7429-476d-9914-8141ba8b7488/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Ensure instance console log exists: /opt/stack/data/nova/instances/f3cdfe20-7429-476d-9914-8141ba8b7488/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] No VIF found with MAC fa:16:3e:91:12:8c, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.636s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:17:57 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.network.neutron [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Successfully updated port: a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347 {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Acquiring lock "refresh_cache-f3cdfe20-7429-476d-9914-8141ba8b7488" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Acquired lock "refresh_cache-f3cdfe20-7429-476d-9914-8141ba8b7488" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.network.neutron [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.network.neutron [req-079c7aac-55be-4327-9b26-0ee0288181b6 req-a6abcd4a-b3ae-41de-be79-3b65dd2cf2e2 service nova] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Updated VIF entry in instance network info cache for port 74eb53ef-5ba7-4bd5-81af-d6adede99fad. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.network.neutron [req-079c7aac-55be-4327-9b26-0ee0288181b6 req-a6abcd4a-b3ae-41de-be79-3b65dd2cf2e2 service nova] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Updating instance_info_cache with network_info: [{"id": "74eb53ef-5ba7-4bd5-81af-d6adede99fad", "address": "fa:16:3e:91:12:8c", "network": {"id": "ecbc1165-663e-47ca-87c7-ecda194bb3cc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-140281562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b74a9586932440678d59170e174336a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74eb53ef-5b", "ovs_interfaceid": "74eb53ef-5ba7-4bd5-81af-d6adede99fad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.policy [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e0ac495788b648378f17f70d42727ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e445361a61f44659ba229fd8c053d736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.compute.manager [req-a9075e33-99e4-4e24-8606-fc8db5c55211 req-27b5e4e1-47ca-4f96-a698-2423b71b6125 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Received event network-changed-3e2379bd-6e97-45dc-917b-e8e4478a3be0 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.compute.manager [req-a9075e33-99e4-4e24-8606-fc8db5c55211 req-27b5e4e1-47ca-4f96-a698-2423b71b6125 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Refreshing instance network info cache due to event network-changed-3e2379bd-6e97-45dc-917b-e8e4478a3be0. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a9075e33-99e4-4e24-8606-fc8db5c55211 req-27b5e4e1-47ca-4f96-a698-2423b71b6125 service nova] Acquiring lock "refresh_cache-0259351f-617f-47be-bfb6-2fef1c35bf15" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a9075e33-99e4-4e24-8606-fc8db5c55211 req-27b5e4e1-47ca-4f96-a698-2423b71b6125 service nova] Acquired lock "refresh_cache-0259351f-617f-47be-bfb6-2fef1c35bf15" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG nova.network.neutron [req-a9075e33-99e4-4e24-8606-fc8db5c55211 req-27b5e4e1-47ca-4f96-a698-2423b71b6125 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Refreshing network info cache for port 3e2379bd-6e97-45dc-917b-e8e4478a3be0 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:17:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-079c7aac-55be-4327-9b26-0ee0288181b6 req-a6abcd4a-b3ae-41de-be79-3b65dd2cf2e2 service nova] Releasing lock "refresh_cache-a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG nova.network.neutron [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:17:58 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Creating config drive at /opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/disk.config
Dec 05 15:17:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpb6yrjjg1 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:17:58 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Creating image(s)
Dec 05 15:17:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Acquiring lock "/opt/stack/data/nova/instances/1830878a-71e0-48f1-85b8-9ed83b1419cd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Lock "/opt/stack/data/nova/instances/1830878a-71e0-48f1-85b8-9ed83b1419cd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Lock "/opt/stack/data/nova/instances/1830878a-71e0-48f1-85b8-9ed83b1419cd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpb6yrjjg1" returned: 0 in 0.076s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG nova.compute.manager [req-271991b2-7785-481c-9d02-308e9427f4f4 req-18eaa8a2-a968-4adf-8b45-dc2d84c43145 service nova] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Received event network-vif-plugged-06f46569-efd3-4978-b954-cdbb51b09e30 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-271991b2-7785-481c-9d02-308e9427f4f4 req-18eaa8a2-a968-4adf-8b45-dc2d84c43145 service nova] Acquiring lock "bd75375a-8b70-4bc2-a72b-14213ebaa4e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-271991b2-7785-481c-9d02-308e9427f4f4 req-18eaa8a2-a968-4adf-8b45-dc2d84c43145 service nova] Lock "bd75375a-8b70-4bc2-a72b-14213ebaa4e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-271991b2-7785-481c-9d02-308e9427f4f4 req-18eaa8a2-a968-4adf-8b45-dc2d84c43145 service nova] Lock "bd75375a-8b70-4bc2-a72b-14213ebaa4e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG nova.compute.manager [req-271991b2-7785-481c-9d02-308e9427f4f4 req-18eaa8a2-a968-4adf-8b45-dc2d84c43145 service nova] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] No waiting events found dispatching network-vif-plugged-06f46569-efd3-4978-b954-cdbb51b09e30 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:17:58 user nova-compute[75080]: WARNING nova.compute.manager [req-271991b2-7785-481c-9d02-308e9427f4f4 req-18eaa8a2-a968-4adf-8b45-dc2d84c43145 service nova] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Received unexpected event network-vif-plugged-06f46569-efd3-4978-b954-cdbb51b09e30 for instance with vm_state active and task_state None.
Dec 05 15:17:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.204s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.221s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/1830878a-71e0-48f1-85b8-9ed83b1419cd/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG nova.network.neutron [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Updating instance_info_cache with network_info: [{"id": "a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347", "address": "fa:16:3e:cd:52:36", "network": {"id": "eed25aef-3f43-4c98-8113-f5720a304787", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1510992179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e2a6722602c4978b5eb12cdce13bb1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa66b89bf-3d", "ovs_interfaceid": "a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/1830878a-71e0-48f1-85b8-9ed83b1419cd/disk 1073741824" returned: 0 in 0.067s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Releasing lock "refresh_cache-f3cdfe20-7429-476d-9914-8141ba8b7488" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG nova.compute.manager [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Instance network_info: |[{"id": "a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347", "address": "fa:16:3e:cd:52:36", "network": {"id": "eed25aef-3f43-4c98-8113-f5720a304787", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1510992179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e2a6722602c4978b5eb12cdce13bb1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa66b89bf-3d", "ovs_interfaceid": "a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Start _get_guest_xml network_info=[{"id": "a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347", "address": "fa:16:3e:cd:52:36", "network": {"id": "eed25aef-3f43-4c98-8113-f5720a304787", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1510992179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e2a6722602c4978b5eb12cdce13bb1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa66b89bf-3d", "ovs_interfaceid": "a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:17:45Z,direct_url=<?>,disk_format='qcow2',id=d433c1b8-6238-4615-b3e0-770c9979eaa3,min_disk=0,min_ram=0,name='',owner='ac172255a8a74eeaae2b50ba6ef673ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:17:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'scsi', 'device_name': '/dev/sda', 'image_id': 'd433c1b8-6238-4615-b3e0-770c9979eaa3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:17:58 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:17:58 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:17:58 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:17:45Z,direct_url=<?>,disk_format='qcow2',id=d433c1b8-6238-4615-b3e0-770c9979eaa3,min_disk=0,min_ram=0,name='',owner='ac172255a8a74eeaae2b50ba6ef673ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:17:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:17:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1665648734',display_name='tempest-AttachSCSIVolumeTestJSON-server-1665648734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1665648734',id=5,image_ref='d433c1b8-6238-4615-b3e0-770c9979eaa3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3H7IrGvwJnVimVL3mSFLR4Ol5APRQWonNfqRxeQqo3RIzRkDUzcLtdZmolBIAkNis+VEu6VRYhkBV3Qowx1pDHyM4iaHjG2Rl0Tg9+bZQlw/cqLvUPQa3pYth9HwWPPA==',key_name='tempest-keypair-1114107675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e2a6722602c4978b5eb12cdce13bb1b',ramdisk_id='',reservation_id='r-qwvx6ck6',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d433c1b8-6238-4615-b3e0-770c9979eaa3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1974012192',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1974012192-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:17:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e7816a5ba3b4d0c91cd742070069bba',uuid=f3cdfe20-7429-476d-9914-8141ba8b7488,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347", "address": "fa:16:3e:cd:52:36", "network": {"id": "eed25aef-3f43-4c98-8113-f5720a304787", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1510992179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e2a6722602c4978b5eb12cdce13bb1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa66b89bf-3d", "ovs_interfaceid": "a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Converting VIF {"id": "a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347", "address": "fa:16:3e:cd:52:36", "network": {"id": "eed25aef-3f43-4c98-8113-f5720a304787", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1510992179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e2a6722602c4978b5eb12cdce13bb1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa66b89bf-3d", "ovs_interfaceid": "a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:52:36,bridge_name='br-int',has_traffic_filtering=True,id=a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347,network=Network(eed25aef-3f43-4c98-8113-f5720a304787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa66b89bf-3d') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:17:58 user nova-compute[75080]: DEBUG nova.objects.instance [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Lazy-loading 'pci_devices' on Instance uuid f3cdfe20-7429-476d-9914-8141ba8b7488 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:17:59 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:17:59 user nova-compute[75080]:   <uuid>f3cdfe20-7429-476d-9914-8141ba8b7488</uuid>
Dec 05 15:17:59 user nova-compute[75080]:   <name>instance-00000005</name>
Dec 05 15:17:59 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:17:59 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:17:59 user nova-compute[75080]:   <metadata>
Dec 05 15:17:59 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:17:59 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:17:59 user nova-compute[75080]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1665648734</nova:name>
Dec 05 15:17:59 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:17:58</nova:creationTime>
Dec 05 15:17:59 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:17:59 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:17:59 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:17:59 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:17:59 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:17:59 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:17:59 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:17:59 user nova-compute[75080]:       <nova:owner>
Dec 05 15:17:59 user nova-compute[75080]:         <nova:user uuid="6e7816a5ba3b4d0c91cd742070069bba">tempest-AttachSCSIVolumeTestJSON-1974012192-project-member</nova:user>
Dec 05 15:17:59 user nova-compute[75080]:         <nova:project uuid="5e2a6722602c4978b5eb12cdce13bb1b">tempest-AttachSCSIVolumeTestJSON-1974012192</nova:project>
Dec 05 15:17:59 user nova-compute[75080]:       </nova:owner>
Dec 05 15:17:59 user nova-compute[75080]:       <nova:root type="image" uuid="d433c1b8-6238-4615-b3e0-770c9979eaa3"/>
Dec 05 15:17:59 user nova-compute[75080]:       <nova:ports>
Dec 05 15:17:59 user nova-compute[75080]:         <nova:port uuid="a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347">
Dec 05 15:17:59 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 05 15:17:59 user nova-compute[75080]:         </nova:port>
Dec 05 15:17:59 user nova-compute[75080]:       </nova:ports>
Dec 05 15:17:59 user nova-compute[75080]:     </nova:instance>
Dec 05 15:17:59 user nova-compute[75080]:   </metadata>
Dec 05 15:17:59 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:17:59 user nova-compute[75080]:     <system>
Dec 05 15:17:59 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:17:59 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:17:59 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:17:59 user nova-compute[75080]:       <entry name="serial">f3cdfe20-7429-476d-9914-8141ba8b7488</entry>
Dec 05 15:17:59 user nova-compute[75080]:       <entry name="uuid">f3cdfe20-7429-476d-9914-8141ba8b7488</entry>
Dec 05 15:17:59 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:17:59 user nova-compute[75080]:     </system>
Dec 05 15:17:59 user nova-compute[75080]:   </sysinfo>
Dec 05 15:17:59 user nova-compute[75080]:   <os>
Dec 05 15:17:59 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:17:59 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:17:59 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:17:59 user nova-compute[75080]:   </os>
Dec 05 15:17:59 user nova-compute[75080]:   <features>
Dec 05 15:17:59 user nova-compute[75080]:     <acpi/>
Dec 05 15:17:59 user nova-compute[75080]:     <apic/>
Dec 05 15:17:59 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:17:59 user nova-compute[75080]:   </features>
Dec 05 15:17:59 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:17:59 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:17:59 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:17:59 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:17:59 user nova-compute[75080]:   </clock>
Dec 05 15:17:59 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:17:59 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:17:59 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:17:59 user nova-compute[75080]:   </cpu>
Dec 05 15:17:59 user nova-compute[75080]:   <devices>
Dec 05 15:17:59 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:17:59 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:17:59 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/f3cdfe20-7429-476d-9914-8141ba8b7488/disk"/>
Dec 05 15:17:59 user nova-compute[75080]:       <target dev="sda" bus="scsi"/>
Dec 05 15:17:59 user nova-compute[75080]:       <address type="drive" controller="0" unit="0"/>
Dec 05 15:17:59 user nova-compute[75080]:     </disk>
Dec 05 15:17:59 user nova-compute[75080]:     <disk type="file" device="cdrom">
Dec 05 15:17:59 user nova-compute[75080]:       <driver name="qemu" type="raw" cache="none"/>
Dec 05 15:17:59 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/f3cdfe20-7429-476d-9914-8141ba8b7488/disk.config"/>
Dec 05 15:17:59 user nova-compute[75080]:       <target dev="sdb" bus="scsi"/>
Dec 05 15:17:59 user nova-compute[75080]:       <address type="drive" controller="0" unit="1"/>
Dec 05 15:17:59 user nova-compute[75080]:     </disk>
Dec 05 15:17:59 user nova-compute[75080]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Dec 05 15:17:59 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:17:59 user nova-compute[75080]:       <mac address="fa:16:3e:cd:52:36"/>
Dec 05 15:17:59 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:17:59 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:17:59 user nova-compute[75080]:       <target dev="tapa66b89bf-3d"/>
Dec 05 15:17:59 user nova-compute[75080]:     </interface>
Dec 05 15:17:59 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:17:59 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/f3cdfe20-7429-476d-9914-8141ba8b7488/console.log" append="off"/>
Dec 05 15:17:59 user nova-compute[75080]:     </serial>
Dec 05 15:17:59 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:17:59 user nova-compute[75080]:     <video>
Dec 05 15:17:59 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:17:59 user nova-compute[75080]:     </video>
Dec 05 15:17:59 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:17:59 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:17:59 user nova-compute[75080]:     </rng>
Dec 05 15:17:59 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:17:59 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:17:59 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:17:59 user nova-compute[75080]:     </memballoon>
Dec 05 15:17:59 user nova-compute[75080]:   </devices>
Dec 05 15:17:59 user nova-compute[75080]: </domain>
Dec 05 15:17:59 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:17:59 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:17:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1665648734',display_name='tempest-AttachSCSIVolumeTestJSON-server-1665648734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1665648734',id=5,image_ref='d433c1b8-6238-4615-b3e0-770c9979eaa3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3H7IrGvwJnVimVL3mSFLR4Ol5APRQWonNfqRxeQqo3RIzRkDUzcLtdZmolBIAkNis+VEu6VRYhkBV3Qowx1pDHyM4iaHjG2Rl0Tg9+bZQlw/cqLvUPQa3pYth9HwWPPA==',key_name='tempest-keypair-1114107675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e2a6722602c4978b5eb12cdce13bb1b',ramdisk_id='',reservation_id='r-qwvx6ck6',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d433c1b8-6238-4615-b3e0-770c9979eaa3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1974012192',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1974012192-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:17:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e7816a5ba3b4d0c91cd742070069bba',uuid=f3cdfe20-7429-476d-9914-8141ba8b7488,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347", "address": "fa:16:3e:cd:52:36", "network": {"id": "eed25aef-3f43-4c98-8113-f5720a304787", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1510992179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e2a6722602c4978b5eb12cdce13bb1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa66b89bf-3d", "ovs_interfaceid": "a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:17:59 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Converting VIF {"id": "a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347", "address": "fa:16:3e:cd:52:36", "network": {"id": "eed25aef-3f43-4c98-8113-f5720a304787", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1510992179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e2a6722602c4978b5eb12cdce13bb1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa66b89bf-3d", "ovs_interfaceid": "a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:17:59 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:52:36,bridge_name='br-int',has_traffic_filtering=True,id=a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347,network=Network(eed25aef-3f43-4c98-8113-f5720a304787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa66b89bf-3d') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:17:59 user nova-compute[75080]: DEBUG os_vif [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:52:36,bridge_name='br-int',has_traffic_filtering=True,id=a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347,network=Network(eed25aef-3f43-4c98-8113-f5720a304787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa66b89bf-3d') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:17:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:17:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:17:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd51d6325-cdbc-51ed-9102-9f3251f0c9f5', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:17:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.259s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:17:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:17:59 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1830878a-71e0-48f1-85b8-9ed83b1419cd/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 15:17:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1830878a-71e0-48f1-85b8-9ed83b1419cd/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:17:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa66b89bf-3d, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:17:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa66b89bf-3d, col_values=(('qos', UUID('9e01b089-a337-4cb6-bc91-648f60c5b3fb')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:17:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa66b89bf-3d, col_values=(('external_ids', {'iface-id': 'a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:52:36', 'vm-uuid': 'f3cdfe20-7429-476d-9914-8141ba8b7488'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:17:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:17:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:59 user nova-compute[75080]: INFO os_vif [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:52:36,bridge_name='br-int',has_traffic_filtering=True,id=a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347,network=Network(eed25aef-3f43-4c98-8113-f5720a304787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa66b89bf-3d')
Dec 05 15:17:59 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Successfully created port: fe1ce7fc-22e0-4814-b15f-c3e9f82574b6 {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:17:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1830878a-71e0-48f1-85b8-9ed83b1419cd/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:17:59 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Cannot resize image /opt/stack/data/nova/instances/1830878a-71e0-48f1-85b8-9ed83b1419cd/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 15:17:59 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:17:59 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Ensure instance console log exists: /opt/stack/data/nova/instances/1830878a-71e0-48f1-85b8-9ed83b1419cd/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:17:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:17:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:17:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:17:59 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] No BDM found with device name sda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:17:59 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:17:59 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] No VIF found with MAC fa:16:3e:cd:52:36, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:17:59 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Using config drive
Dec 05 15:17:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:59 user nova-compute[75080]: DEBUG nova.network.neutron [req-a9075e33-99e4-4e24-8606-fc8db5c55211 req-27b5e4e1-47ca-4f96-a698-2423b71b6125 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Updated VIF entry in instance network info cache for port 3e2379bd-6e97-45dc-917b-e8e4478a3be0. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:17:59 user nova-compute[75080]: DEBUG nova.network.neutron [req-a9075e33-99e4-4e24-8606-fc8db5c55211 req-27b5e4e1-47ca-4f96-a698-2423b71b6125 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Updating instance_info_cache with network_info: [{"id": "3e2379bd-6e97-45dc-917b-e8e4478a3be0", "address": "fa:16:3e:68:6e:ba", "network": {"id": "1adc7b37-8fcb-4b25-92e7-e746874f778b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-490224437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24e3fe3c0db24db598f947ebfe7a8b3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2379bd-6e", "ovs_interfaceid": "3e2379bd-6e97-45dc-917b-e8e4478a3be0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:17:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:17:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a9075e33-99e4-4e24-8606-fc8db5c55211 req-27b5e4e1-47ca-4f96-a698-2423b71b6125 service nova] Releasing lock "refresh_cache-0259351f-617f-47be-bfb6-2fef1c35bf15" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:17:59 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Creating config drive at /opt/stack/data/nova/instances/f3cdfe20-7429-476d-9914-8141ba8b7488/disk.config
Dec 05 15:17:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f3cdfe20-7429-476d-9914-8141ba8b7488/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpn4tn_v2f {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:17:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f3cdfe20-7429-476d-9914-8141ba8b7488/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpn4tn_v2f" returned: 0 in 0.083s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:18:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:00 user nova-compute[75080]: DEBUG nova.compute.manager [req-67359cad-f052-4dbb-a12f-6e289e222124 req-911bb465-7d1f-4d21-a397-735747b91648 service nova] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Received event network-changed-a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:18:00 user nova-compute[75080]: DEBUG nova.compute.manager [req-67359cad-f052-4dbb-a12f-6e289e222124 req-911bb465-7d1f-4d21-a397-735747b91648 service nova] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Refreshing instance network info cache due to event network-changed-a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:18:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-67359cad-f052-4dbb-a12f-6e289e222124 req-911bb465-7d1f-4d21-a397-735747b91648 service nova] Acquiring lock "refresh_cache-f3cdfe20-7429-476d-9914-8141ba8b7488" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:18:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-67359cad-f052-4dbb-a12f-6e289e222124 req-911bb465-7d1f-4d21-a397-735747b91648 service nova] Acquired lock "refresh_cache-f3cdfe20-7429-476d-9914-8141ba8b7488" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:18:00 user nova-compute[75080]: DEBUG nova.network.neutron [req-67359cad-f052-4dbb-a12f-6e289e222124 req-911bb465-7d1f-4d21-a397-735747b91648 service nova] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Refreshing network info cache for port a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:18:01 user nova-compute[75080]: DEBUG nova.network.neutron [req-67359cad-f052-4dbb-a12f-6e289e222124 req-911bb465-7d1f-4d21-a397-735747b91648 service nova] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Updated VIF entry in instance network info cache for port a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:18:01 user nova-compute[75080]: DEBUG nova.network.neutron [req-67359cad-f052-4dbb-a12f-6e289e222124 req-911bb465-7d1f-4d21-a397-735747b91648 service nova] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Updating instance_info_cache with network_info: [{"id": "a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347", "address": "fa:16:3e:cd:52:36", "network": {"id": "eed25aef-3f43-4c98-8113-f5720a304787", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1510992179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e2a6722602c4978b5eb12cdce13bb1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa66b89bf-3d", "ovs_interfaceid": "a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:18:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-67359cad-f052-4dbb-a12f-6e289e222124 req-911bb465-7d1f-4d21-a397-735747b91648 service nova] Releasing lock "refresh_cache-f3cdfe20-7429-476d-9914-8141ba8b7488" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:18:01 user nova-compute[75080]: DEBUG nova.compute.manager [req-67359cad-f052-4dbb-a12f-6e289e222124 req-911bb465-7d1f-4d21-a397-735747b91648 service nova] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Received event network-vif-plugged-06f46569-efd3-4978-b954-cdbb51b09e30 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:18:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-67359cad-f052-4dbb-a12f-6e289e222124 req-911bb465-7d1f-4d21-a397-735747b91648 service nova] Acquiring lock "bd75375a-8b70-4bc2-a72b-14213ebaa4e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:18:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-67359cad-f052-4dbb-a12f-6e289e222124 req-911bb465-7d1f-4d21-a397-735747b91648 service nova] Lock "bd75375a-8b70-4bc2-a72b-14213ebaa4e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:18:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-67359cad-f052-4dbb-a12f-6e289e222124 req-911bb465-7d1f-4d21-a397-735747b91648 service nova] Lock "bd75375a-8b70-4bc2-a72b-14213ebaa4e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:18:01 user nova-compute[75080]: DEBUG nova.compute.manager [req-67359cad-f052-4dbb-a12f-6e289e222124 req-911bb465-7d1f-4d21-a397-735747b91648 service nova] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] No waiting events found dispatching network-vif-plugged-06f46569-efd3-4978-b954-cdbb51b09e30 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:18:01 user nova-compute[75080]: WARNING nova.compute.manager [req-67359cad-f052-4dbb-a12f-6e289e222124 req-911bb465-7d1f-4d21-a397-735747b91648 service nova] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Received unexpected event network-vif-plugged-06f46569-efd3-4978-b954-cdbb51b09e30 for instance with vm_state active and task_state None.
Dec 05 15:18:01 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Successfully updated port: fe1ce7fc-22e0-4814-b15f-c3e9f82574b6 {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:18:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Acquiring lock "refresh_cache-1830878a-71e0-48f1-85b8-9ed83b1419cd" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:18:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Acquired lock "refresh_cache-1830878a-71e0-48f1-85b8-9ed83b1419cd" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:18:01 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:18:01 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:01 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG nova.compute.manager [req-ec184803-e5bf-49dd-a12a-a3d402b4b4ac req-2780e653-2302-4877-b6ce-e1fa525661e5 service nova] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Received event network-changed-fe1ce7fc-22e0-4814-b15f-c3e9f82574b6 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG nova.compute.manager [req-ec184803-e5bf-49dd-a12a-a3d402b4b4ac req-2780e653-2302-4877-b6ce-e1fa525661e5 service nova] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Refreshing instance network info cache due to event network-changed-fe1ce7fc-22e0-4814-b15f-c3e9f82574b6. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-ec184803-e5bf-49dd-a12a-a3d402b4b4ac req-2780e653-2302-4877-b6ce-e1fa525661e5 service nova] Acquiring lock "refresh_cache-1830878a-71e0-48f1-85b8-9ed83b1419cd" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG nova.compute.manager [req-e694b645-21e3-4569-af68-57519e602331 req-b931b9fc-6511-4e6a-a022-506d07544021 service nova] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Received event network-vif-plugged-a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-e694b645-21e3-4569-af68-57519e602331 req-b931b9fc-6511-4e6a-a022-506d07544021 service nova] Acquiring lock "f3cdfe20-7429-476d-9914-8141ba8b7488-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-e694b645-21e3-4569-af68-57519e602331 req-b931b9fc-6511-4e6a-a022-506d07544021 service nova] Lock "f3cdfe20-7429-476d-9914-8141ba8b7488-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-e694b645-21e3-4569-af68-57519e602331 req-b931b9fc-6511-4e6a-a022-506d07544021 service nova] Lock "f3cdfe20-7429-476d-9914-8141ba8b7488-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG nova.compute.manager [req-e694b645-21e3-4569-af68-57519e602331 req-b931b9fc-6511-4e6a-a022-506d07544021 service nova] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] No waiting events found dispatching network-vif-plugged-a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:18:02 user nova-compute[75080]: WARNING nova.compute.manager [req-e694b645-21e3-4569-af68-57519e602331 req-b931b9fc-6511-4e6a-a022-506d07544021 service nova] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Received unexpected event network-vif-plugged-a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347 for instance with vm_state building and task_state spawning.
Dec 05 15:18:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Updating instance_info_cache with network_info: [{"id": "fe1ce7fc-22e0-4814-b15f-c3e9f82574b6", "address": "fa:16:3e:ad:48:50", "network": {"id": "ab471423-0f49-4695-a2d0-76abb88aec8e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-408483206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e445361a61f44659ba229fd8c053d736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1ce7fc-22", "ovs_interfaceid": "fe1ce7fc-22e0-4814-b15f-c3e9f82574b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Releasing lock "refresh_cache-1830878a-71e0-48f1-85b8-9ed83b1419cd" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Instance network_info: |[{"id": "fe1ce7fc-22e0-4814-b15f-c3e9f82574b6", "address": "fa:16:3e:ad:48:50", "network": {"id": "ab471423-0f49-4695-a2d0-76abb88aec8e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-408483206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e445361a61f44659ba229fd8c053d736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1ce7fc-22", "ovs_interfaceid": "fe1ce7fc-22e0-4814-b15f-c3e9f82574b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-ec184803-e5bf-49dd-a12a-a3d402b4b4ac req-2780e653-2302-4877-b6ce-e1fa525661e5 service nova] Acquired lock "refresh_cache-1830878a-71e0-48f1-85b8-9ed83b1419cd" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG nova.network.neutron [req-ec184803-e5bf-49dd-a12a-a3d402b4b4ac req-2780e653-2302-4877-b6ce-e1fa525661e5 service nova] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Refreshing network info cache for port fe1ce7fc-22e0-4814-b15f-c3e9f82574b6 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Start _get_guest_xml network_info=[{"id": "fe1ce7fc-22e0-4814-b15f-c3e9f82574b6", "address": "fa:16:3e:ad:48:50", "network": {"id": "ab471423-0f49-4695-a2d0-76abb88aec8e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-408483206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e445361a61f44659ba229fd8c053d736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1ce7fc-22", "ovs_interfaceid": "fe1ce7fc-22e0-4814-b15f-c3e9f82574b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:18:02 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:18:02 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:18:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-608458288',display_name='tempest-TestVolumeSwap-server-608458288',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-608458288',id=6,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4nKWT3kevLDzIEOokPsLWwjhxX/4JanSvTEXO4JVpCAZWeY9fq6fKYuCeo/fldiGMQ7P6pnqVv8PFcaH7ofpBcb2B6GGN33n4/haaH0wEbDn6b0etg+9HrPw7iWmOHFw==',key_name='tempest-keypair-948032841',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e445361a61f44659ba229fd8c053d736',ramdisk_id='',reservation_id='r-dj7hd7xv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1634269124',owner_user_name='tempest-TestVolumeSwap-1634269124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0ac495788b648378f17f70d42727ced',uuid=1830878a-71e0-48f1-85b8-9ed83b1419cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe1ce7fc-22e0-4814-b15f-c3e9f82574b6", "address": "fa:16:3e:ad:48:50", "network": {"id": "ab471423-0f49-4695-a2d0-76abb88aec8e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-408483206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e445361a61f44659ba229fd8c053d736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1ce7fc-22", "ovs_interfaceid": "fe1ce7fc-22e0-4814-b15f-c3e9f82574b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Converting VIF {"id": "fe1ce7fc-22e0-4814-b15f-c3e9f82574b6", "address": "fa:16:3e:ad:48:50", "network": {"id": "ab471423-0f49-4695-a2d0-76abb88aec8e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-408483206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e445361a61f44659ba229fd8c053d736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1ce7fc-22", "ovs_interfaceid": "fe1ce7fc-22e0-4814-b15f-c3e9f82574b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:48:50,bridge_name='br-int',has_traffic_filtering=True,id=fe1ce7fc-22e0-4814-b15f-c3e9f82574b6,network=Network(ab471423-0f49-4695-a2d0-76abb88aec8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe1ce7fc-22') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG nova.objects.instance [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Lazy-loading 'pci_devices' on Instance uuid 1830878a-71e0-48f1-85b8-9ed83b1419cd {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:18:02 user nova-compute[75080]:   <uuid>1830878a-71e0-48f1-85b8-9ed83b1419cd</uuid>
Dec 05 15:18:02 user nova-compute[75080]:   <name>instance-00000006</name>
Dec 05 15:18:02 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:18:02 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:18:02 user nova-compute[75080]:   <metadata>
Dec 05 15:18:02 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:18:02 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:18:02 user nova-compute[75080]:       <nova:name>tempest-TestVolumeSwap-server-608458288</nova:name>
Dec 05 15:18:02 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:18:02</nova:creationTime>
Dec 05 15:18:02 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:18:02 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:18:02 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:18:02 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:18:02 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:18:02 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:18:02 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:18:02 user nova-compute[75080]:       <nova:owner>
Dec 05 15:18:02 user nova-compute[75080]:         <nova:user uuid="e0ac495788b648378f17f70d42727ced">tempest-TestVolumeSwap-1634269124-project-member</nova:user>
Dec 05 15:18:02 user nova-compute[75080]:         <nova:project uuid="e445361a61f44659ba229fd8c053d736">tempest-TestVolumeSwap-1634269124</nova:project>
Dec 05 15:18:02 user nova-compute[75080]:       </nova:owner>
Dec 05 15:18:02 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:18:02 user nova-compute[75080]:       <nova:ports>
Dec 05 15:18:02 user nova-compute[75080]:         <nova:port uuid="fe1ce7fc-22e0-4814-b15f-c3e9f82574b6">
Dec 05 15:18:02 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 05 15:18:02 user nova-compute[75080]:         </nova:port>
Dec 05 15:18:02 user nova-compute[75080]:       </nova:ports>
Dec 05 15:18:02 user nova-compute[75080]:     </nova:instance>
Dec 05 15:18:02 user nova-compute[75080]:   </metadata>
Dec 05 15:18:02 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:18:02 user nova-compute[75080]:     <system>
Dec 05 15:18:02 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:18:02 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:18:02 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:18:02 user nova-compute[75080]:       <entry name="serial">1830878a-71e0-48f1-85b8-9ed83b1419cd</entry>
Dec 05 15:18:02 user nova-compute[75080]:       <entry name="uuid">1830878a-71e0-48f1-85b8-9ed83b1419cd</entry>
Dec 05 15:18:02 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:18:02 user nova-compute[75080]:     </system>
Dec 05 15:18:02 user nova-compute[75080]:   </sysinfo>
Dec 05 15:18:02 user nova-compute[75080]:   <os>
Dec 05 15:18:02 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:18:02 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:18:02 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:18:02 user nova-compute[75080]:   </os>
Dec 05 15:18:02 user nova-compute[75080]:   <features>
Dec 05 15:18:02 user nova-compute[75080]:     <acpi/>
Dec 05 15:18:02 user nova-compute[75080]:     <apic/>
Dec 05 15:18:02 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:18:02 user nova-compute[75080]:   </features>
Dec 05 15:18:02 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:18:02 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:18:02 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:18:02 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:18:02 user nova-compute[75080]:   </clock>
Dec 05 15:18:02 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:18:02 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:18:02 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:18:02 user nova-compute[75080]:   </cpu>
Dec 05 15:18:02 user nova-compute[75080]:   <devices>
Dec 05 15:18:02 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:18:02 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:18:02 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/1830878a-71e0-48f1-85b8-9ed83b1419cd/disk"/>
Dec 05 15:18:02 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:18:02 user nova-compute[75080]:     </disk>
Dec 05 15:18:02 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:18:02 user nova-compute[75080]:       <mac address="fa:16:3e:ad:48:50"/>
Dec 05 15:18:02 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:18:02 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:18:02 user nova-compute[75080]:       <target dev="tapfe1ce7fc-22"/>
Dec 05 15:18:02 user nova-compute[75080]:     </interface>
Dec 05 15:18:02 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:18:02 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/1830878a-71e0-48f1-85b8-9ed83b1419cd/console.log" append="off"/>
Dec 05 15:18:02 user nova-compute[75080]:     </serial>
Dec 05 15:18:02 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:18:02 user nova-compute[75080]:     <video>
Dec 05 15:18:02 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:18:02 user nova-compute[75080]:     </video>
Dec 05 15:18:02 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:18:02 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:18:02 user nova-compute[75080]:     </rng>
Dec 05 15:18:02 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:18:02 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:18:02 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:18:02 user nova-compute[75080]:     </memballoon>
Dec 05 15:18:02 user nova-compute[75080]:   </devices>
Dec 05 15:18:02 user nova-compute[75080]: </domain>
Dec 05 15:18:02 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-608458288',display_name='tempest-TestVolumeSwap-server-608458288',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-608458288',id=6,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4nKWT3kevLDzIEOokPsLWwjhxX/4JanSvTEXO4JVpCAZWeY9fq6fKYuCeo/fldiGMQ7P6pnqVv8PFcaH7ofpBcb2B6GGN33n4/haaH0wEbDn6b0etg+9HrPw7iWmOHFw==',key_name='tempest-keypair-948032841',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e445361a61f44659ba229fd8c053d736',ramdisk_id='',reservation_id='r-dj7hd7xv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1634269124',owner_user_name='tempest-TestVolumeSwap-1634269124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0ac495788b648378f17f70d42727ced',uuid=1830878a-71e0-48f1-85b8-9ed83b1419cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe1ce7fc-22e0-4814-b15f-c3e9f82574b6", "address": "fa:16:3e:ad:48:50", "network": {"id": "ab471423-0f49-4695-a2d0-76abb88aec8e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-408483206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e445361a61f44659ba229fd8c053d736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1ce7fc-22", "ovs_interfaceid": "fe1ce7fc-22e0-4814-b15f-c3e9f82574b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Converting VIF {"id": "fe1ce7fc-22e0-4814-b15f-c3e9f82574b6", "address": "fa:16:3e:ad:48:50", "network": {"id": "ab471423-0f49-4695-a2d0-76abb88aec8e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-408483206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e445361a61f44659ba229fd8c053d736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1ce7fc-22", "ovs_interfaceid": "fe1ce7fc-22e0-4814-b15f-c3e9f82574b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:48:50,bridge_name='br-int',has_traffic_filtering=True,id=fe1ce7fc-22e0-4814-b15f-c3e9f82574b6,network=Network(ab471423-0f49-4695-a2d0-76abb88aec8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe1ce7fc-22') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG os_vif [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:48:50,bridge_name='br-int',has_traffic_filtering=True,id=fe1ce7fc-22e0-4814-b15f-c3e9f82574b6,network=Network(ab471423-0f49-4695-a2d0-76abb88aec8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe1ce7fc-22') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '11706e8d-3b4e-5185-97bb-50a3f0e58d24', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe1ce7fc-22, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe1ce7fc-22, col_values=(('qos', UUID('d9dad0d2-079f-4a5b-8565-0ad164c0e756')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe1ce7fc-22, col_values=(('external_ids', {'iface-id': 'fe1ce7fc-22e0-4814-b15f-c3e9f82574b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:48:50', 'vm-uuid': '1830878a-71e0-48f1-85b8-9ed83b1419cd'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:02 user nova-compute[75080]: INFO os_vif [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:48:50,bridge_name='br-int',has_traffic_filtering=True,id=fe1ce7fc-22e0-4814-b15f-c3e9f82574b6,network=Network(ab471423-0f49-4695-a2d0-76abb88aec8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe1ce7fc-22')
Dec 05 15:18:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:18:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] No VIF found with MAC fa:16:3e:ad:48:50, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:18:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:03 user nova-compute[75080]: DEBUG nova.network.neutron [req-ec184803-e5bf-49dd-a12a-a3d402b4b4ac req-2780e653-2302-4877-b6ce-e1fa525661e5 service nova] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Updated VIF entry in instance network info cache for port fe1ce7fc-22e0-4814-b15f-c3e9f82574b6. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:18:03 user nova-compute[75080]: DEBUG nova.network.neutron [req-ec184803-e5bf-49dd-a12a-a3d402b4b4ac req-2780e653-2302-4877-b6ce-e1fa525661e5 service nova] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Updating instance_info_cache with network_info: [{"id": "fe1ce7fc-22e0-4814-b15f-c3e9f82574b6", "address": "fa:16:3e:ad:48:50", "network": {"id": "ab471423-0f49-4695-a2d0-76abb88aec8e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-408483206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e445361a61f44659ba229fd8c053d736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1ce7fc-22", "ovs_interfaceid": "fe1ce7fc-22e0-4814-b15f-c3e9f82574b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:18:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-ec184803-e5bf-49dd-a12a-a3d402b4b4ac req-2780e653-2302-4877-b6ce-e1fa525661e5 service nova] Releasing lock "refresh_cache-1830878a-71e0-48f1-85b8-9ed83b1419cd" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:18:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:04 user nova-compute[75080]: DEBUG nova.compute.manager [req-6a060028-f84b-4829-aa21-1efc329cab85 req-8c05ff10-2ba3-4d73-8c40-4d650427141c service nova] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Received event network-vif-plugged-f0094ba7-45c2-445b-bd35-d5c7aedd68bd {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:18:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-6a060028-f84b-4829-aa21-1efc329cab85 req-8c05ff10-2ba3-4d73-8c40-4d650427141c service nova] Acquiring lock "eedd1529-4feb-4f85-8625-0c20d8e0359d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:18:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-6a060028-f84b-4829-aa21-1efc329cab85 req-8c05ff10-2ba3-4d73-8c40-4d650427141c service nova] Lock "eedd1529-4feb-4f85-8625-0c20d8e0359d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:18:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-6a060028-f84b-4829-aa21-1efc329cab85 req-8c05ff10-2ba3-4d73-8c40-4d650427141c service nova] Lock "eedd1529-4feb-4f85-8625-0c20d8e0359d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:18:04 user nova-compute[75080]: DEBUG nova.compute.manager [req-6a060028-f84b-4829-aa21-1efc329cab85 req-8c05ff10-2ba3-4d73-8c40-4d650427141c service nova] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] No waiting events found dispatching network-vif-plugged-f0094ba7-45c2-445b-bd35-d5c7aedd68bd {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:18:04 user nova-compute[75080]: WARNING nova.compute.manager [req-6a060028-f84b-4829-aa21-1efc329cab85 req-8c05ff10-2ba3-4d73-8c40-4d650427141c service nova] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Received unexpected event network-vif-plugged-f0094ba7-45c2-445b-bd35-d5c7aedd68bd for instance with vm_state active and task_state None.
Dec 05 15:18:04 user nova-compute[75080]: DEBUG nova.compute.manager [req-93a49a0c-3c58-41cc-b87a-ab1884bee802 req-a62029c6-72aa-432c-a084-cf210ad85f07 service nova] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Received event network-vif-plugged-a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:18:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-93a49a0c-3c58-41cc-b87a-ab1884bee802 req-a62029c6-72aa-432c-a084-cf210ad85f07 service nova] Acquiring lock "f3cdfe20-7429-476d-9914-8141ba8b7488-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:18:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-93a49a0c-3c58-41cc-b87a-ab1884bee802 req-a62029c6-72aa-432c-a084-cf210ad85f07 service nova] Lock "f3cdfe20-7429-476d-9914-8141ba8b7488-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:18:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-93a49a0c-3c58-41cc-b87a-ab1884bee802 req-a62029c6-72aa-432c-a084-cf210ad85f07 service nova] Lock "f3cdfe20-7429-476d-9914-8141ba8b7488-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:18:04 user nova-compute[75080]: DEBUG nova.compute.manager [req-93a49a0c-3c58-41cc-b87a-ab1884bee802 req-a62029c6-72aa-432c-a084-cf210ad85f07 service nova] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] No waiting events found dispatching network-vif-plugged-a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:18:04 user nova-compute[75080]: WARNING nova.compute.manager [req-93a49a0c-3c58-41cc-b87a-ab1884bee802 req-a62029c6-72aa-432c-a084-cf210ad85f07 service nova] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Received unexpected event network-vif-plugged-a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347 for instance with vm_state building and task_state spawning.
Dec 05 15:18:04 user nova-compute[75080]: DEBUG nova.compute.manager [req-93a49a0c-3c58-41cc-b87a-ab1884bee802 req-a62029c6-72aa-432c-a084-cf210ad85f07 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Received event network-vif-plugged-3e2379bd-6e97-45dc-917b-e8e4478a3be0 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:18:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-93a49a0c-3c58-41cc-b87a-ab1884bee802 req-a62029c6-72aa-432c-a084-cf210ad85f07 service nova] Acquiring lock "0259351f-617f-47be-bfb6-2fef1c35bf15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:18:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-93a49a0c-3c58-41cc-b87a-ab1884bee802 req-a62029c6-72aa-432c-a084-cf210ad85f07 service nova] Lock "0259351f-617f-47be-bfb6-2fef1c35bf15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:18:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-93a49a0c-3c58-41cc-b87a-ab1884bee802 req-a62029c6-72aa-432c-a084-cf210ad85f07 service nova] Lock "0259351f-617f-47be-bfb6-2fef1c35bf15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:18:04 user nova-compute[75080]: DEBUG nova.compute.manager [req-93a49a0c-3c58-41cc-b87a-ab1884bee802 req-a62029c6-72aa-432c-a084-cf210ad85f07 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] No waiting events found dispatching network-vif-plugged-3e2379bd-6e97-45dc-917b-e8e4478a3be0 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:18:04 user nova-compute[75080]: WARNING nova.compute.manager [req-93a49a0c-3c58-41cc-b87a-ab1884bee802 req-a62029c6-72aa-432c-a084-cf210ad85f07 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Received unexpected event network-vif-plugged-3e2379bd-6e97-45dc-917b-e8e4478a3be0 for instance with vm_state building and task_state spawning.
Dec 05 15:18:04 user nova-compute[75080]: DEBUG nova.compute.manager [req-93a49a0c-3c58-41cc-b87a-ab1884bee802 req-a62029c6-72aa-432c-a084-cf210ad85f07 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Received event network-vif-plugged-3e2379bd-6e97-45dc-917b-e8e4478a3be0 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:18:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-93a49a0c-3c58-41cc-b87a-ab1884bee802 req-a62029c6-72aa-432c-a084-cf210ad85f07 service nova] Acquiring lock "0259351f-617f-47be-bfb6-2fef1c35bf15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:18:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-93a49a0c-3c58-41cc-b87a-ab1884bee802 req-a62029c6-72aa-432c-a084-cf210ad85f07 service nova] Lock "0259351f-617f-47be-bfb6-2fef1c35bf15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:18:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-93a49a0c-3c58-41cc-b87a-ab1884bee802 req-a62029c6-72aa-432c-a084-cf210ad85f07 service nova] Lock "0259351f-617f-47be-bfb6-2fef1c35bf15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:18:04 user nova-compute[75080]: DEBUG nova.compute.manager [req-93a49a0c-3c58-41cc-b87a-ab1884bee802 req-a62029c6-72aa-432c-a084-cf210ad85f07 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] No waiting events found dispatching network-vif-plugged-3e2379bd-6e97-45dc-917b-e8e4478a3be0 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:18:04 user nova-compute[75080]: WARNING nova.compute.manager [req-93a49a0c-3c58-41cc-b87a-ab1884bee802 req-a62029c6-72aa-432c-a084-cf210ad85f07 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Received unexpected event network-vif-plugged-3e2379bd-6e97-45dc-917b-e8e4478a3be0 for instance with vm_state building and task_state spawning.
Dec 05 15:18:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:06 user nova-compute[75080]: DEBUG nova.compute.manager [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:18:06 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:18:06 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Instance spawned successfully.
Dec 05 15:18:06 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:18:06 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:06 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:06 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:06 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:06 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:06 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:06 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:06 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:06 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:06 user nova-compute[75080]: INFO nova.compute.manager [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Took 14.23 seconds to spawn the instance on the hypervisor.
Dec 05 15:18:06 user nova-compute[75080]: DEBUG nova.compute.manager [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:18:06 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:06 user nova-compute[75080]: INFO nova.compute.manager [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Took 15.24 seconds to build instance.
Dec 05 15:18:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ed610651-0509-4d4b-a032-784bd60b1827 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.456s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-a41f2e2b-4f83-469a-bb6d-afa69a799dd2 req-83f5c21d-4f4d-440d-a9eb-e19187d96ddb service nova] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Received event network-vif-plugged-f0094ba7-45c2-445b-bd35-d5c7aedd68bd {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a41f2e2b-4f83-469a-bb6d-afa69a799dd2 req-83f5c21d-4f4d-440d-a9eb-e19187d96ddb service nova] Acquiring lock "eedd1529-4feb-4f85-8625-0c20d8e0359d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a41f2e2b-4f83-469a-bb6d-afa69a799dd2 req-83f5c21d-4f4d-440d-a9eb-e19187d96ddb service nova] Lock "eedd1529-4feb-4f85-8625-0c20d8e0359d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a41f2e2b-4f83-469a-bb6d-afa69a799dd2 req-83f5c21d-4f4d-440d-a9eb-e19187d96ddb service nova] Lock "eedd1529-4feb-4f85-8625-0c20d8e0359d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-a41f2e2b-4f83-469a-bb6d-afa69a799dd2 req-83f5c21d-4f4d-440d-a9eb-e19187d96ddb service nova] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] No waiting events found dispatching network-vif-plugged-f0094ba7-45c2-445b-bd35-d5c7aedd68bd {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:18:07 user nova-compute[75080]: WARNING nova.compute.manager [req-a41f2e2b-4f83-469a-bb6d-afa69a799dd2 req-83f5c21d-4f4d-440d-a9eb-e19187d96ddb service nova] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Received unexpected event network-vif-plugged-f0094ba7-45c2-445b-bd35-d5c7aedd68bd for instance with vm_state active and task_state None.
Dec 05 15:18:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-a41f2e2b-4f83-469a-bb6d-afa69a799dd2 req-83f5c21d-4f4d-440d-a9eb-e19187d96ddb service nova] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Received event network-vif-plugged-74eb53ef-5ba7-4bd5-81af-d6adede99fad {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a41f2e2b-4f83-469a-bb6d-afa69a799dd2 req-83f5c21d-4f4d-440d-a9eb-e19187d96ddb service nova] Acquiring lock "a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a41f2e2b-4f83-469a-bb6d-afa69a799dd2 req-83f5c21d-4f4d-440d-a9eb-e19187d96ddb service nova] Lock "a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a41f2e2b-4f83-469a-bb6d-afa69a799dd2 req-83f5c21d-4f4d-440d-a9eb-e19187d96ddb service nova] Lock "a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-a41f2e2b-4f83-469a-bb6d-afa69a799dd2 req-83f5c21d-4f4d-440d-a9eb-e19187d96ddb service nova] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] No waiting events found dispatching network-vif-plugged-74eb53ef-5ba7-4bd5-81af-d6adede99fad {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:18:07 user nova-compute[75080]: WARNING nova.compute.manager [req-a41f2e2b-4f83-469a-bb6d-afa69a799dd2 req-83f5c21d-4f4d-440d-a9eb-e19187d96ddb service nova] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Received unexpected event network-vif-plugged-74eb53ef-5ba7-4bd5-81af-d6adede99fad for instance with vm_state active and task_state None.
Dec 05 15:18:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-a41f2e2b-4f83-469a-bb6d-afa69a799dd2 req-83f5c21d-4f4d-440d-a9eb-e19187d96ddb service nova] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Received event network-vif-plugged-74eb53ef-5ba7-4bd5-81af-d6adede99fad {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a41f2e2b-4f83-469a-bb6d-afa69a799dd2 req-83f5c21d-4f4d-440d-a9eb-e19187d96ddb service nova] Acquiring lock "a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a41f2e2b-4f83-469a-bb6d-afa69a799dd2 req-83f5c21d-4f4d-440d-a9eb-e19187d96ddb service nova] Lock "a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a41f2e2b-4f83-469a-bb6d-afa69a799dd2 req-83f5c21d-4f4d-440d-a9eb-e19187d96ddb service nova] Lock "a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-a41f2e2b-4f83-469a-bb6d-afa69a799dd2 req-83f5c21d-4f4d-440d-a9eb-e19187d96ddb service nova] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] No waiting events found dispatching network-vif-plugged-74eb53ef-5ba7-4bd5-81af-d6adede99fad {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:18:07 user nova-compute[75080]: WARNING nova.compute.manager [req-a41f2e2b-4f83-469a-bb6d-afa69a799dd2 req-83f5c21d-4f4d-440d-a9eb-e19187d96ddb service nova] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Received unexpected event network-vif-plugged-74eb53ef-5ba7-4bd5-81af-d6adede99fad for instance with vm_state active and task_state None.
Dec 05 15:18:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-a41f2e2b-4f83-469a-bb6d-afa69a799dd2 req-83f5c21d-4f4d-440d-a9eb-e19187d96ddb service nova] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Received event network-vif-plugged-fe1ce7fc-22e0-4814-b15f-c3e9f82574b6 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a41f2e2b-4f83-469a-bb6d-afa69a799dd2 req-83f5c21d-4f4d-440d-a9eb-e19187d96ddb service nova] Acquiring lock "1830878a-71e0-48f1-85b8-9ed83b1419cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a41f2e2b-4f83-469a-bb6d-afa69a799dd2 req-83f5c21d-4f4d-440d-a9eb-e19187d96ddb service nova] Lock "1830878a-71e0-48f1-85b8-9ed83b1419cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a41f2e2b-4f83-469a-bb6d-afa69a799dd2 req-83f5c21d-4f4d-440d-a9eb-e19187d96ddb service nova] Lock "1830878a-71e0-48f1-85b8-9ed83b1419cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-a41f2e2b-4f83-469a-bb6d-afa69a799dd2 req-83f5c21d-4f4d-440d-a9eb-e19187d96ddb service nova] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] No waiting events found dispatching network-vif-plugged-fe1ce7fc-22e0-4814-b15f-c3e9f82574b6 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:18:07 user nova-compute[75080]: WARNING nova.compute.manager [req-a41f2e2b-4f83-469a-bb6d-afa69a799dd2 req-83f5c21d-4f4d-440d-a9eb-e19187d96ddb service nova] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Received unexpected event network-vif-plugged-fe1ce7fc-22e0-4814-b15f-c3e9f82574b6 for instance with vm_state building and task_state spawning.
Dec 05 15:18:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-a41f2e2b-4f83-469a-bb6d-afa69a799dd2 req-83f5c21d-4f4d-440d-a9eb-e19187d96ddb service nova] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Received event network-vif-plugged-fe1ce7fc-22e0-4814-b15f-c3e9f82574b6 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a41f2e2b-4f83-469a-bb6d-afa69a799dd2 req-83f5c21d-4f4d-440d-a9eb-e19187d96ddb service nova] Acquiring lock "1830878a-71e0-48f1-85b8-9ed83b1419cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a41f2e2b-4f83-469a-bb6d-afa69a799dd2 req-83f5c21d-4f4d-440d-a9eb-e19187d96ddb service nova] Lock "1830878a-71e0-48f1-85b8-9ed83b1419cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a41f2e2b-4f83-469a-bb6d-afa69a799dd2 req-83f5c21d-4f4d-440d-a9eb-e19187d96ddb service nova] Lock "1830878a-71e0-48f1-85b8-9ed83b1419cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-a41f2e2b-4f83-469a-bb6d-afa69a799dd2 req-83f5c21d-4f4d-440d-a9eb-e19187d96ddb service nova] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] No waiting events found dispatching network-vif-plugged-fe1ce7fc-22e0-4814-b15f-c3e9f82574b6 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:18:07 user nova-compute[75080]: WARNING nova.compute.manager [req-a41f2e2b-4f83-469a-bb6d-afa69a799dd2 req-83f5c21d-4f4d-440d-a9eb-e19187d96ddb service nova] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Received unexpected event network-vif-plugged-fe1ce7fc-22e0-4814-b15f-c3e9f82574b6 for instance with vm_state building and task_state spawning.
Dec 05 15:18:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Acquiring lock "33078a88-4858-4c6b-bfa9-c3d9b83cf78b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Lock "33078a88-4858-4c6b-bfa9-c3d9b83cf78b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG nova.compute.manager [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG nova.compute.manager [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG nova.compute.manager [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:18:07 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Instance spawned successfully.
Dec 05 15:18:07 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:18:07 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Instance spawned successfully.
Dec 05 15:18:07 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:07 user nova-compute[75080]: INFO nova.compute.manager [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Took 13.09 seconds to spawn the instance on the hypervisor.
Dec 05 15:18:07 user nova-compute[75080]: DEBUG nova.compute.manager [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:18:07 user nova-compute[75080]: INFO nova.compute.manager [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Took 14.94 seconds to spawn the instance on the hypervisor.
Dec 05 15:18:07 user nova-compute[75080]: DEBUG nova.compute.manager [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:18:07 user nova-compute[75080]: INFO nova.compute.claims [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Claim successful on node user
Dec 05 15:18:07 user nova-compute[75080]: INFO nova.compute.manager [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Took 14.44 seconds to build instance.
Dec 05 15:18:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-61fd5772-13f4-4310-818d-e89d4adda5cd tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Lock "f3cdfe20-7429-476d-9914-8141ba8b7488" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.641s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:18:07 user nova-compute[75080]: INFO nova.compute.manager [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Took 16.42 seconds to build instance.
Dec 05 15:18:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-91aecc98-3d83-44b4-9f8f-c1bf49884a92 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lock "0259351f-617f-47be-bfb6-2fef1c35bf15" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.616s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:18:07 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:18:07 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Instance spawned successfully.
Dec 05 15:18:07 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:18:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:08 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:18:08 user nova-compute[75080]: INFO nova.compute.manager [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Took 10.00 seconds to spawn the instance on the hypervisor.
Dec 05 15:18:08 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:18:08 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:18:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.708s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:18:08 user nova-compute[75080]: DEBUG nova.compute.manager [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:18:08 user nova-compute[75080]: DEBUG nova.compute.manager [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:18:08 user nova-compute[75080]: DEBUG nova.network.neutron [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:18:08 user nova-compute[75080]: INFO nova.compute.manager [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Took 11.57 seconds to build instance.
Dec 05 15:18:08 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:18:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e00e4752-90ed-441d-9ef8-5a9cdd428aef tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Lock "1830878a-71e0-48f1-85b8-9ed83b1419cd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.786s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:18:08 user nova-compute[75080]: DEBUG nova.policy [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc8e44dad1cd499693a674a6f5c2f180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2b129bb5af4ea9844c6eb1ac0e892b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:18:08 user nova-compute[75080]: DEBUG nova.compute.manager [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:18:08 user nova-compute[75080]: DEBUG nova.compute.manager [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:18:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:18:08 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Creating image(s)
Dec 05 15:18:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Acquiring lock "/opt/stack/data/nova/instances/33078a88-4858-4c6b-bfa9-c3d9b83cf78b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:18:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Lock "/opt/stack/data/nova/instances/33078a88-4858-4c6b-bfa9-c3d9b83cf78b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:18:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Lock "/opt/stack/data/nova/instances/33078a88-4858-4c6b-bfa9-c3d9b83cf78b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:18:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:18:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.261s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:18:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:18:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:18:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:18:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.237s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:18:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/33078a88-4858-4c6b-bfa9-c3d9b83cf78b/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:18:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/33078a88-4858-4c6b-bfa9-c3d9b83cf78b/disk 1073741824" returned: 0 in 0.110s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:18:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.360s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:18:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:18:09 user nova-compute[75080]: DEBUG nova.network.neutron [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Successfully created port: 1ba3c430-69cf-40e7-bfe4-f12fb016fcc6 {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:18:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.279s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:18:09 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Checking if we can resize image /opt/stack/data/nova/instances/33078a88-4858-4c6b-bfa9-c3d9b83cf78b/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 15:18:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33078a88-4858-4c6b-bfa9-c3d9b83cf78b/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:18:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33078a88-4858-4c6b-bfa9-c3d9b83cf78b/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:18:10 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Cannot resize image /opt/stack/data/nova/instances/33078a88-4858-4c6b-bfa9-c3d9b83cf78b/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 15:18:10 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:18:10 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Ensure instance console log exists: /opt/stack/data/nova/instances/33078a88-4858-4c6b-bfa9-c3d9b83cf78b/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:18:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:18:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:18:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:18:10 user nova-compute[75080]: DEBUG nova.network.neutron [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Successfully updated port: 1ba3c430-69cf-40e7-bfe4-f12fb016fcc6 {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:18:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Acquiring lock "refresh_cache-33078a88-4858-4c6b-bfa9-c3d9b83cf78b" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:18:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Acquired lock "refresh_cache-33078a88-4858-4c6b-bfa9-c3d9b83cf78b" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:18:10 user nova-compute[75080]: DEBUG nova.network.neutron [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:18:10 user nova-compute[75080]: DEBUG nova.compute.manager [req-42747102-1c89-4a6e-afbe-f604f17aeb43 req-aa0e3f47-dc75-4030-80e0-68b2923ee6c4 service nova] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Received event network-changed-1ba3c430-69cf-40e7-bfe4-f12fb016fcc6 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:18:10 user nova-compute[75080]: DEBUG nova.compute.manager [req-42747102-1c89-4a6e-afbe-f604f17aeb43 req-aa0e3f47-dc75-4030-80e0-68b2923ee6c4 service nova] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Refreshing instance network info cache due to event network-changed-1ba3c430-69cf-40e7-bfe4-f12fb016fcc6. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:18:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-42747102-1c89-4a6e-afbe-f604f17aeb43 req-aa0e3f47-dc75-4030-80e0-68b2923ee6c4 service nova] Acquiring lock "refresh_cache-33078a88-4858-4c6b-bfa9-c3d9b83cf78b" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:18:10 user nova-compute[75080]: DEBUG nova.network.neutron [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG nova.network.neutron [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Updating instance_info_cache with network_info: [{"id": "1ba3c430-69cf-40e7-bfe4-f12fb016fcc6", "address": "fa:16:3e:35:a9:ee", "network": {"id": "c3560d36-b0b7-4e66-a452-fd50e56003f9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1825133181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc2b129bb5af4ea9844c6eb1ac0e892b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ba3c430-69", "ovs_interfaceid": "1ba3c430-69cf-40e7-bfe4-f12fb016fcc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Releasing lock "refresh_cache-33078a88-4858-4c6b-bfa9-c3d9b83cf78b" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG nova.compute.manager [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Instance network_info: |[{"id": "1ba3c430-69cf-40e7-bfe4-f12fb016fcc6", "address": "fa:16:3e:35:a9:ee", "network": {"id": "c3560d36-b0b7-4e66-a452-fd50e56003f9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1825133181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc2b129bb5af4ea9844c6eb1ac0e892b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ba3c430-69", "ovs_interfaceid": "1ba3c430-69cf-40e7-bfe4-f12fb016fcc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-42747102-1c89-4a6e-afbe-f604f17aeb43 req-aa0e3f47-dc75-4030-80e0-68b2923ee6c4 service nova] Acquired lock "refresh_cache-33078a88-4858-4c6b-bfa9-c3d9b83cf78b" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG nova.network.neutron [req-42747102-1c89-4a6e-afbe-f604f17aeb43 req-aa0e3f47-dc75-4030-80e0-68b2923ee6c4 service nova] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Refreshing network info cache for port 1ba3c430-69cf-40e7-bfe4-f12fb016fcc6 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Start _get_guest_xml network_info=[{"id": "1ba3c430-69cf-40e7-bfe4-f12fb016fcc6", "address": "fa:16:3e:35:a9:ee", "network": {"id": "c3560d36-b0b7-4e66-a452-fd50e56003f9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1825133181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc2b129bb5af4ea9844c6eb1ac0e892b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ba3c430-69", "ovs_interfaceid": "1ba3c430-69cf-40e7-bfe4-f12fb016fcc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:18:11 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:18:11 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:18:11 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:18:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-154587334',display_name='tempest-VolumesAssistedSnapshotsTest-server-154587334',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-154587334',id=7,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4C238xmF5WUomXV6hZsLKdqbPNAUYpY5jlCm/Wj8b73CCTd+HNGY3q49HF01W+P8wXjfutnpCL8CNEb1ZJ1WntrL1Tk1zNGH3iN80ktAoA+74E5cocWsqZUv3sI5sTQQ==',key_name='tempest-keypair-983423462',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc2b129bb5af4ea9844c6eb1ac0e892b',ramdisk_id='',reservation_id='r-7ulqypb1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-339249874',owner_user_name='tempest-VolumesAssistedSnapshotsTest-339249874-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:18:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc8e44dad1cd499693a674a6f5c2f180',uuid=33078a88-4858-4c6b-bfa9-c3d9b83cf78b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ba3c430-69cf-40e7-bfe4-f12fb016fcc6", "address": "fa:16:3e:35:a9:ee", "network": {"id": "c3560d36-b0b7-4e66-a452-fd50e56003f9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1825133181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc2b129bb5af4ea9844c6eb1ac0e892b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ba3c430-69", "ovs_interfaceid": "1ba3c430-69cf-40e7-bfe4-f12fb016fcc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Converting VIF {"id": "1ba3c430-69cf-40e7-bfe4-f12fb016fcc6", "address": "fa:16:3e:35:a9:ee", "network": {"id": "c3560d36-b0b7-4e66-a452-fd50e56003f9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1825133181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc2b129bb5af4ea9844c6eb1ac0e892b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ba3c430-69", "ovs_interfaceid": "1ba3c430-69cf-40e7-bfe4-f12fb016fcc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:a9:ee,bridge_name='br-int',has_traffic_filtering=True,id=1ba3c430-69cf-40e7-bfe4-f12fb016fcc6,network=Network(c3560d36-b0b7-4e66-a452-fd50e56003f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ba3c430-69') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG nova.objects.instance [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Lazy-loading 'pci_devices' on Instance uuid 33078a88-4858-4c6b-bfa9-c3d9b83cf78b {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:18:11 user nova-compute[75080]:   <uuid>33078a88-4858-4c6b-bfa9-c3d9b83cf78b</uuid>
Dec 05 15:18:11 user nova-compute[75080]:   <name>instance-00000007</name>
Dec 05 15:18:11 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:18:11 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:18:11 user nova-compute[75080]:   <metadata>
Dec 05 15:18:11 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:18:11 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:18:11 user nova-compute[75080]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-154587334</nova:name>
Dec 05 15:18:11 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:18:11</nova:creationTime>
Dec 05 15:18:11 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:18:11 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:18:11 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:18:11 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:18:11 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:18:11 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:18:11 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:18:11 user nova-compute[75080]:       <nova:owner>
Dec 05 15:18:11 user nova-compute[75080]:         <nova:user uuid="bc8e44dad1cd499693a674a6f5c2f180">tempest-VolumesAssistedSnapshotsTest-339249874-project-member</nova:user>
Dec 05 15:18:11 user nova-compute[75080]:         <nova:project uuid="cc2b129bb5af4ea9844c6eb1ac0e892b">tempest-VolumesAssistedSnapshotsTest-339249874</nova:project>
Dec 05 15:18:11 user nova-compute[75080]:       </nova:owner>
Dec 05 15:18:11 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:18:11 user nova-compute[75080]:       <nova:ports>
Dec 05 15:18:11 user nova-compute[75080]:         <nova:port uuid="1ba3c430-69cf-40e7-bfe4-f12fb016fcc6">
Dec 05 15:18:11 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 05 15:18:11 user nova-compute[75080]:         </nova:port>
Dec 05 15:18:11 user nova-compute[75080]:       </nova:ports>
Dec 05 15:18:11 user nova-compute[75080]:     </nova:instance>
Dec 05 15:18:11 user nova-compute[75080]:   </metadata>
Dec 05 15:18:11 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:18:11 user nova-compute[75080]:     <system>
Dec 05 15:18:11 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:18:11 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:18:11 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:18:11 user nova-compute[75080]:       <entry name="serial">33078a88-4858-4c6b-bfa9-c3d9b83cf78b</entry>
Dec 05 15:18:11 user nova-compute[75080]:       <entry name="uuid">33078a88-4858-4c6b-bfa9-c3d9b83cf78b</entry>
Dec 05 15:18:11 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:18:11 user nova-compute[75080]:     </system>
Dec 05 15:18:11 user nova-compute[75080]:   </sysinfo>
Dec 05 15:18:11 user nova-compute[75080]:   <os>
Dec 05 15:18:11 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:18:11 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:18:11 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:18:11 user nova-compute[75080]:   </os>
Dec 05 15:18:11 user nova-compute[75080]:   <features>
Dec 05 15:18:11 user nova-compute[75080]:     <acpi/>
Dec 05 15:18:11 user nova-compute[75080]:     <apic/>
Dec 05 15:18:11 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:18:11 user nova-compute[75080]:   </features>
Dec 05 15:18:11 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:18:11 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:18:11 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:18:11 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:18:11 user nova-compute[75080]:   </clock>
Dec 05 15:18:11 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:18:11 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:18:11 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:18:11 user nova-compute[75080]:   </cpu>
Dec 05 15:18:11 user nova-compute[75080]:   <devices>
Dec 05 15:18:11 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:18:11 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:18:11 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/33078a88-4858-4c6b-bfa9-c3d9b83cf78b/disk"/>
Dec 05 15:18:11 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:18:11 user nova-compute[75080]:     </disk>
Dec 05 15:18:11 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:18:11 user nova-compute[75080]:       <mac address="fa:16:3e:35:a9:ee"/>
Dec 05 15:18:11 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:18:11 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:18:11 user nova-compute[75080]:       <target dev="tap1ba3c430-69"/>
Dec 05 15:18:11 user nova-compute[75080]:     </interface>
Dec 05 15:18:11 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:18:11 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/33078a88-4858-4c6b-bfa9-c3d9b83cf78b/console.log" append="off"/>
Dec 05 15:18:11 user nova-compute[75080]:     </serial>
Dec 05 15:18:11 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:18:11 user nova-compute[75080]:     <video>
Dec 05 15:18:11 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:18:11 user nova-compute[75080]:     </video>
Dec 05 15:18:11 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:18:11 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:18:11 user nova-compute[75080]:     </rng>
Dec 05 15:18:11 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:18:11 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:18:11 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:18:11 user nova-compute[75080]:     </memballoon>
Dec 05 15:18:11 user nova-compute[75080]:   </devices>
Dec 05 15:18:11 user nova-compute[75080]: </domain>
Dec 05 15:18:11 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:18:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-154587334',display_name='tempest-VolumesAssistedSnapshotsTest-server-154587334',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-154587334',id=7,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4C238xmF5WUomXV6hZsLKdqbPNAUYpY5jlCm/Wj8b73CCTd+HNGY3q49HF01W+P8wXjfutnpCL8CNEb1ZJ1WntrL1Tk1zNGH3iN80ktAoA+74E5cocWsqZUv3sI5sTQQ==',key_name='tempest-keypair-983423462',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc2b129bb5af4ea9844c6eb1ac0e892b',ramdisk_id='',reservation_id='r-7ulqypb1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-339249874',owner_user_name='tempest-VolumesAssistedSnapshotsTest-339249874-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:18:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc8e44dad1cd499693a674a6f5c2f180',uuid=33078a88-4858-4c6b-bfa9-c3d9b83cf78b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ba3c430-69cf-40e7-bfe4-f12fb016fcc6", "address": "fa:16:3e:35:a9:ee", "network": {"id": "c3560d36-b0b7-4e66-a452-fd50e56003f9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1825133181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc2b129bb5af4ea9844c6eb1ac0e892b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ba3c430-69", "ovs_interfaceid": "1ba3c430-69cf-40e7-bfe4-f12fb016fcc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Converting VIF {"id": "1ba3c430-69cf-40e7-bfe4-f12fb016fcc6", "address": "fa:16:3e:35:a9:ee", "network": {"id": "c3560d36-b0b7-4e66-a452-fd50e56003f9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1825133181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc2b129bb5af4ea9844c6eb1ac0e892b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ba3c430-69", "ovs_interfaceid": "1ba3c430-69cf-40e7-bfe4-f12fb016fcc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:a9:ee,bridge_name='br-int',has_traffic_filtering=True,id=1ba3c430-69cf-40e7-bfe4-f12fb016fcc6,network=Network(c3560d36-b0b7-4e66-a452-fd50e56003f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ba3c430-69') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG os_vif [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:a9:ee,bridge_name='br-int',has_traffic_filtering=True,id=1ba3c430-69cf-40e7-bfe4-f12fb016fcc6,network=Network(c3560d36-b0b7-4e66-a452-fd50e56003f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ba3c430-69') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6af1ba3f-82c6-5c54-b9ce-9c5d14d0fca7', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ba3c430-69, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1ba3c430-69, col_values=(('qos', UUID('c1958a60-25b3-4531-be45-86b8daf3aada')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1ba3c430-69, col_values=(('external_ids', {'iface-id': '1ba3c430-69cf-40e7-bfe4-f12fb016fcc6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:a9:ee', 'vm-uuid': '33078a88-4858-4c6b-bfa9-c3d9b83cf78b'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:11 user nova-compute[75080]: INFO os_vif [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:a9:ee,bridge_name='br-int',has_traffic_filtering=True,id=1ba3c430-69cf-40e7-bfe4-f12fb016fcc6,network=Network(c3560d36-b0b7-4e66-a452-fd50e56003f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ba3c430-69')
Dec 05 15:18:11 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] No VIF found with MAC fa:16:3e:35:a9:ee, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG nova.network.neutron [req-42747102-1c89-4a6e-afbe-f604f17aeb43 req-aa0e3f47-dc75-4030-80e0-68b2923ee6c4 service nova] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Updated VIF entry in instance network info cache for port 1ba3c430-69cf-40e7-bfe4-f12fb016fcc6. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG nova.network.neutron [req-42747102-1c89-4a6e-afbe-f604f17aeb43 req-aa0e3f47-dc75-4030-80e0-68b2923ee6c4 service nova] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Updating instance_info_cache with network_info: [{"id": "1ba3c430-69cf-40e7-bfe4-f12fb016fcc6", "address": "fa:16:3e:35:a9:ee", "network": {"id": "c3560d36-b0b7-4e66-a452-fd50e56003f9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1825133181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc2b129bb5af4ea9844c6eb1ac0e892b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ba3c430-69", "ovs_interfaceid": "1ba3c430-69cf-40e7-bfe4-f12fb016fcc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:18:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-42747102-1c89-4a6e-afbe-f604f17aeb43 req-aa0e3f47-dc75-4030-80e0-68b2923ee6c4 service nova] Releasing lock "refresh_cache-33078a88-4858-4c6b-bfa9-c3d9b83cf78b" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:18:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:14 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:14 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:14 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:14 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:14 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:14 user nova-compute[75080]: DEBUG nova.compute.manager [req-9145b224-9b08-4c70-b3ab-56acc53f74c0 req-88801fce-6d1b-4641-9711-cc417e6a0e1a service nova] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Received event network-vif-plugged-1ba3c430-69cf-40e7-bfe4-f12fb016fcc6 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:18:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9145b224-9b08-4c70-b3ab-56acc53f74c0 req-88801fce-6d1b-4641-9711-cc417e6a0e1a service nova] Acquiring lock "33078a88-4858-4c6b-bfa9-c3d9b83cf78b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:18:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9145b224-9b08-4c70-b3ab-56acc53f74c0 req-88801fce-6d1b-4641-9711-cc417e6a0e1a service nova] Lock "33078a88-4858-4c6b-bfa9-c3d9b83cf78b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:18:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9145b224-9b08-4c70-b3ab-56acc53f74c0 req-88801fce-6d1b-4641-9711-cc417e6a0e1a service nova] Lock "33078a88-4858-4c6b-bfa9-c3d9b83cf78b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:18:14 user nova-compute[75080]: DEBUG nova.compute.manager [req-9145b224-9b08-4c70-b3ab-56acc53f74c0 req-88801fce-6d1b-4641-9711-cc417e6a0e1a service nova] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] No waiting events found dispatching network-vif-plugged-1ba3c430-69cf-40e7-bfe4-f12fb016fcc6 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:18:14 user nova-compute[75080]: WARNING nova.compute.manager [req-9145b224-9b08-4c70-b3ab-56acc53f74c0 req-88801fce-6d1b-4641-9711-cc417e6a0e1a service nova] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Received unexpected event network-vif-plugged-1ba3c430-69cf-40e7-bfe4-f12fb016fcc6 for instance with vm_state building and task_state spawning.
Dec 05 15:18:15 user nova-compute[75080]: DEBUG nova.compute.manager [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:18:15 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:18:15 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Instance spawned successfully.
Dec 05 15:18:15 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:18:15 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:15 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:15 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:15 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:15 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:15 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:16 user nova-compute[75080]: INFO nova.compute.manager [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Took 7.23 seconds to spawn the instance on the hypervisor.
Dec 05 15:18:16 user nova-compute[75080]: DEBUG nova.compute.manager [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:18:16 user nova-compute[75080]: INFO nova.compute.manager [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Took 8.62 seconds to build instance.
Dec 05 15:18:16 user nova-compute[75080]: DEBUG nova.compute.manager [req-90ddbfb7-10c1-4d20-a198-cdd107938fe8 req-6bc0bcb9-1da6-4e4e-887c-7a93541d3acc service nova] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Received event network-vif-plugged-1ba3c430-69cf-40e7-bfe4-f12fb016fcc6 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:18:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-90ddbfb7-10c1-4d20-a198-cdd107938fe8 req-6bc0bcb9-1da6-4e4e-887c-7a93541d3acc service nova] Acquiring lock "33078a88-4858-4c6b-bfa9-c3d9b83cf78b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:18:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-90ddbfb7-10c1-4d20-a198-cdd107938fe8 req-6bc0bcb9-1da6-4e4e-887c-7a93541d3acc service nova] Lock "33078a88-4858-4c6b-bfa9-c3d9b83cf78b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:18:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-90ddbfb7-10c1-4d20-a198-cdd107938fe8 req-6bc0bcb9-1da6-4e4e-887c-7a93541d3acc service nova] Lock "33078a88-4858-4c6b-bfa9-c3d9b83cf78b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:18:16 user nova-compute[75080]: DEBUG nova.compute.manager [req-90ddbfb7-10c1-4d20-a198-cdd107938fe8 req-6bc0bcb9-1da6-4e4e-887c-7a93541d3acc service nova] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] No waiting events found dispatching network-vif-plugged-1ba3c430-69cf-40e7-bfe4-f12fb016fcc6 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:18:16 user nova-compute[75080]: WARNING nova.compute.manager [req-90ddbfb7-10c1-4d20-a198-cdd107938fe8 req-6bc0bcb9-1da6-4e4e-887c-7a93541d3acc service nova] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Received unexpected event network-vif-plugged-1ba3c430-69cf-40e7-bfe4-f12fb016fcc6 for instance with vm_state active and task_state None.
Dec 05 15:18:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9969d975-89a3-4779-b02f-0042253c910f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Lock "33078a88-4858-4c6b-bfa9-c3d9b83cf78b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.942s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:18:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:18 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:18:18 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Cleaning up deleted instances {{(pid=75080) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 05 15:18:18 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] There are 0 instances to clean {{(pid=75080) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 05 15:18:18 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:18:18 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75080) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 05 15:18:18 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:18:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:19 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:18:20 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:18:20 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:18:20 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Rebuilding the list of instances to heal {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 15:18:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-bd75375a-8b70-4bc2-a72b-14213ebaa4e9" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:18:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-bd75375a-8b70-4bc2-a72b-14213ebaa4e9" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:18:20 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 15:18:20 user nova-compute[75080]: DEBUG nova.objects.instance [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lazy-loading 'info_cache' on Instance uuid bd75375a-8b70-4bc2-a72b-14213ebaa4e9 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:18:21 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:21 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Updating instance_info_cache with network_info: [{"id": "06f46569-efd3-4978-b954-cdbb51b09e30", "address": "fa:16:3e:8e:cb:88", "network": {"id": "05b09885-a021-44b4-b8d6-1504a4c2dfeb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1903039338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e73fbf2c414f32bcdeef4bae598b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f46569-ef", "ovs_interfaceid": "06f46569-efd3-4978-b954-cdbb51b09e30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:18:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-bd75375a-8b70-4bc2-a72b-14213ebaa4e9" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:18:21 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 15:18:21 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:18:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:18:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:18:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:18:22 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:18:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:18:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:18:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:18:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:18:22 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:18:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:18:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Acquiring lock "d69bc0bc-b6e8-447b-b529-54031fc78ce1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:18:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "d69bc0bc-b6e8-447b-b529-54031fc78ce1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.009s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:18:22 user nova-compute[75080]: DEBUG nova.compute.manager [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:18:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:18:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:18:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:18:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:18:23 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:18:23 user nova-compute[75080]: INFO nova.compute.claims [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Claim successful on node user
Dec 05 15:18:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:18:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:18:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:18:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:18:23 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:18:23 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:18:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.746s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:18:23 user nova-compute[75080]: DEBUG nova.compute.manager [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:18:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json" returned: 0 in 0.352s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:18:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:18:23 user nova-compute[75080]: DEBUG nova.compute.manager [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:18:23 user nova-compute[75080]: DEBUG nova.network.neutron [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:18:23 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:18:24 user nova-compute[75080]: DEBUG nova.compute.manager [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:18:24 user nova-compute[75080]: DEBUG nova.policy [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73fc83883fde496180489f170285d97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '787d8b299b8b4940b04446b4189fdf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:18:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:18:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:18:24 user nova-compute[75080]: DEBUG nova.compute.manager [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:18:24 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:18:24 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Creating image(s)
Dec 05 15:18:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Acquiring lock "/opt/stack/data/nova/instances/d69bc0bc-b6e8-447b-b529-54031fc78ce1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:18:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "/opt/stack/data/nova/instances/d69bc0bc-b6e8-447b-b529-54031fc78ce1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:18:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "/opt/stack/data/nova/instances/d69bc0bc-b6e8-447b-b529-54031fc78ce1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:18:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:18:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:18:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:18:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.196s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:18:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:18:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:18:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:18:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:18:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:18:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.233s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:18:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/d69bc0bc-b6e8-447b-b529-54031fc78ce1/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:18:24 user nova-compute[75080]: DEBUG nova.network.neutron [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Successfully created port: 1c52a0de-1054-487a-9f4b-467d9151f1b0 {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:18:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:18:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/d69bc0bc-b6e8-447b-b529-54031fc78ce1/disk 1073741824" returned: 0 in 0.151s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:18:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.397s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:18:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:18:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3cdfe20-7429-476d-9914-8141ba8b7488/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:18:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.233s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:18:25 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d69bc0bc-b6e8-447b-b529-54031fc78ce1/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 15:18:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69bc0bc-b6e8-447b-b529-54031fc78ce1/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:18:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3cdfe20-7429-476d-9914-8141ba8b7488/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:18:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3cdfe20-7429-476d-9914-8141ba8b7488/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:18:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69bc0bc-b6e8-447b-b529-54031fc78ce1/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:18:25 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Cannot resize image /opt/stack/data/nova/instances/d69bc0bc-b6e8-447b-b529-54031fc78ce1/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 15:18:25 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:18:25 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Ensure instance console log exists: /opt/stack/data/nova/instances/d69bc0bc-b6e8-447b-b529-54031fc78ce1/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:18:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:18:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:18:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:18:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3cdfe20-7429-476d-9914-8141ba8b7488/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:18:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33078a88-4858-4c6b-bfa9-c3d9b83cf78b/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:18:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33078a88-4858-4c6b-bfa9-c3d9b83cf78b/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:18:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33078a88-4858-4c6b-bfa9-c3d9b83cf78b/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:18:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33078a88-4858-4c6b-bfa9-c3d9b83cf78b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:18:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1830878a-71e0-48f1-85b8-9ed83b1419cd/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:18:26 user nova-compute[75080]: DEBUG nova.network.neutron [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Successfully updated port: 1c52a0de-1054-487a-9f4b-467d9151f1b0 {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:18:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1830878a-71e0-48f1-85b8-9ed83b1419cd/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:18:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1830878a-71e0-48f1-85b8-9ed83b1419cd/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:18:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Acquiring lock "refresh_cache-d69bc0bc-b6e8-447b-b529-54031fc78ce1" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:18:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Acquired lock "refresh_cache-d69bc0bc-b6e8-447b-b529-54031fc78ce1" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:18:26 user nova-compute[75080]: DEBUG nova.network.neutron [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:18:26 user nova-compute[75080]: DEBUG nova.compute.manager [req-f7036268-d6eb-4378-adb4-83879bbc9009 req-743863bf-62d7-4ddf-baab-04b1bcbd977e service nova] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Received event network-changed-1c52a0de-1054-487a-9f4b-467d9151f1b0 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:18:26 user nova-compute[75080]: DEBUG nova.compute.manager [req-f7036268-d6eb-4378-adb4-83879bbc9009 req-743863bf-62d7-4ddf-baab-04b1bcbd977e service nova] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Refreshing instance network info cache due to event network-changed-1c52a0de-1054-487a-9f4b-467d9151f1b0. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:18:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f7036268-d6eb-4378-adb4-83879bbc9009 req-743863bf-62d7-4ddf-baab-04b1bcbd977e service nova] Acquiring lock "refresh_cache-d69bc0bc-b6e8-447b-b529-54031fc78ce1" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:18:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:26 user nova-compute[75080]: DEBUG nova.network.neutron [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:18:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1830878a-71e0-48f1-85b8-9ed83b1419cd/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:18:26 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:18:26 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:18:26 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=7870MB free_disk=25.623443603515625GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:18:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:18:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.network.neutron [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Updating instance_info_cache with network_info: [{"id": "1c52a0de-1054-487a-9f4b-467d9151f1b0", "address": "fa:16:3e:b4:f4:d6", "network": {"id": "73bdb098-8c6b-4af3-b3f5-5fb4b213a0ab", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1357180398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "787d8b299b8b4940b04446b4189fdf05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c52a0de-10", "ovs_interfaceid": "1c52a0de-1054-487a-9f4b-467d9151f1b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Releasing lock "refresh_cache-d69bc0bc-b6e8-447b-b529-54031fc78ce1" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.compute.manager [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Instance network_info: |[{"id": "1c52a0de-1054-487a-9f4b-467d9151f1b0", "address": "fa:16:3e:b4:f4:d6", "network": {"id": "73bdb098-8c6b-4af3-b3f5-5fb4b213a0ab", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1357180398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "787d8b299b8b4940b04446b4189fdf05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c52a0de-10", "ovs_interfaceid": "1c52a0de-1054-487a-9f4b-467d9151f1b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f7036268-d6eb-4378-adb4-83879bbc9009 req-743863bf-62d7-4ddf-baab-04b1bcbd977e service nova] Acquired lock "refresh_cache-d69bc0bc-b6e8-447b-b529-54031fc78ce1" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.network.neutron [req-f7036268-d6eb-4378-adb4-83879bbc9009 req-743863bf-62d7-4ddf-baab-04b1bcbd977e service nova] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Refreshing network info cache for port 1c52a0de-1054-487a-9f4b-467d9151f1b0 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Start _get_guest_xml network_info=[{"id": "1c52a0de-1054-487a-9f4b-467d9151f1b0", "address": "fa:16:3e:b4:f4:d6", "network": {"id": "73bdb098-8c6b-4af3-b3f5-5fb4b213a0ab", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1357180398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "787d8b299b8b4940b04446b4189fdf05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c52a0de-10", "ovs_interfaceid": "1c52a0de-1054-487a-9f4b-467d9151f1b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:18:27 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:18:27 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:18:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-783074315',display_name='tempest-TestServerVolumeAttachmentScenario-server-783074315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-783074315',id=8,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5zNy+1ow33S20RcKvu1jD4khVEugsbpHZP0w5gwoHui4slwMVZuggEneoxgHpzG9XxLj0Ox43tVuGV/dMq8xnA87LiYq7FAbpkRDpapW42sRtTn6Fz7mT3cBHuJNGGwA==',key_name='tempest-keypair-1191671367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='787d8b299b8b4940b04446b4189fdf05',ramdisk_id='',reservation_id='r-yep2vq2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-291896938',owner_user_name='tempest-TestServerVolumeAttachmentScenario-291896938-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:18:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73fc83883fde496180489f170285d97f',uuid=d69bc0bc-b6e8-447b-b529-54031fc78ce1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c52a0de-1054-487a-9f4b-467d9151f1b0", "address": "fa:16:3e:b4:f4:d6", "network": {"id": "73bdb098-8c6b-4af3-b3f5-5fb4b213a0ab", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1357180398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "787d8b299b8b4940b04446b4189fdf05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c52a0de-10", "ovs_interfaceid": "1c52a0de-1054-487a-9f4b-467d9151f1b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Converting VIF {"id": "1c52a0de-1054-487a-9f4b-467d9151f1b0", "address": "fa:16:3e:b4:f4:d6", "network": {"id": "73bdb098-8c6b-4af3-b3f5-5fb4b213a0ab", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1357180398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "787d8b299b8b4940b04446b4189fdf05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c52a0de-10", "ovs_interfaceid": "1c52a0de-1054-487a-9f4b-467d9151f1b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:f4:d6,bridge_name='br-int',has_traffic_filtering=True,id=1c52a0de-1054-487a-9f4b-467d9151f1b0,network=Network(73bdb098-8c6b-4af3-b3f5-5fb4b213a0ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c52a0de-10') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.objects.instance [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lazy-loading 'pci_devices' on Instance uuid d69bc0bc-b6e8-447b-b529-54031fc78ce1 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:18:27 user nova-compute[75080]:   <uuid>d69bc0bc-b6e8-447b-b529-54031fc78ce1</uuid>
Dec 05 15:18:27 user nova-compute[75080]:   <name>instance-00000008</name>
Dec 05 15:18:27 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:18:27 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:18:27 user nova-compute[75080]:   <metadata>
Dec 05 15:18:27 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:18:27 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:18:27 user nova-compute[75080]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-783074315</nova:name>
Dec 05 15:18:27 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:18:27</nova:creationTime>
Dec 05 15:18:27 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:18:27 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:18:27 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:18:27 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:18:27 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:18:27 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:18:27 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:18:27 user nova-compute[75080]:       <nova:owner>
Dec 05 15:18:27 user nova-compute[75080]:         <nova:user uuid="73fc83883fde496180489f170285d97f">tempest-TestServerVolumeAttachmentScenario-291896938-project-member</nova:user>
Dec 05 15:18:27 user nova-compute[75080]:         <nova:project uuid="787d8b299b8b4940b04446b4189fdf05">tempest-TestServerVolumeAttachmentScenario-291896938</nova:project>
Dec 05 15:18:27 user nova-compute[75080]:       </nova:owner>
Dec 05 15:18:27 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:18:27 user nova-compute[75080]:       <nova:ports>
Dec 05 15:18:27 user nova-compute[75080]:         <nova:port uuid="1c52a0de-1054-487a-9f4b-467d9151f1b0">
Dec 05 15:18:27 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 05 15:18:27 user nova-compute[75080]:         </nova:port>
Dec 05 15:18:27 user nova-compute[75080]:       </nova:ports>
Dec 05 15:18:27 user nova-compute[75080]:     </nova:instance>
Dec 05 15:18:27 user nova-compute[75080]:   </metadata>
Dec 05 15:18:27 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:18:27 user nova-compute[75080]:     <system>
Dec 05 15:18:27 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:18:27 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:18:27 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:18:27 user nova-compute[75080]:       <entry name="serial">d69bc0bc-b6e8-447b-b529-54031fc78ce1</entry>
Dec 05 15:18:27 user nova-compute[75080]:       <entry name="uuid">d69bc0bc-b6e8-447b-b529-54031fc78ce1</entry>
Dec 05 15:18:27 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:18:27 user nova-compute[75080]:     </system>
Dec 05 15:18:27 user nova-compute[75080]:   </sysinfo>
Dec 05 15:18:27 user nova-compute[75080]:   <os>
Dec 05 15:18:27 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:18:27 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:18:27 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:18:27 user nova-compute[75080]:   </os>
Dec 05 15:18:27 user nova-compute[75080]:   <features>
Dec 05 15:18:27 user nova-compute[75080]:     <acpi/>
Dec 05 15:18:27 user nova-compute[75080]:     <apic/>
Dec 05 15:18:27 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:18:27 user nova-compute[75080]:   </features>
Dec 05 15:18:27 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:18:27 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:18:27 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:18:27 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:18:27 user nova-compute[75080]:   </clock>
Dec 05 15:18:27 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:18:27 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:18:27 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:18:27 user nova-compute[75080]:   </cpu>
Dec 05 15:18:27 user nova-compute[75080]:   <devices>
Dec 05 15:18:27 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:18:27 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:18:27 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/d69bc0bc-b6e8-447b-b529-54031fc78ce1/disk"/>
Dec 05 15:18:27 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:18:27 user nova-compute[75080]:     </disk>
Dec 05 15:18:27 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:18:27 user nova-compute[75080]:       <mac address="fa:16:3e:b4:f4:d6"/>
Dec 05 15:18:27 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:18:27 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:18:27 user nova-compute[75080]:       <target dev="tap1c52a0de-10"/>
Dec 05 15:18:27 user nova-compute[75080]:     </interface>
Dec 05 15:18:27 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:18:27 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/d69bc0bc-b6e8-447b-b529-54031fc78ce1/console.log" append="off"/>
Dec 05 15:18:27 user nova-compute[75080]:     </serial>
Dec 05 15:18:27 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:18:27 user nova-compute[75080]:     <video>
Dec 05 15:18:27 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:18:27 user nova-compute[75080]:     </video>
Dec 05 15:18:27 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:18:27 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:18:27 user nova-compute[75080]:     </rng>
Dec 05 15:18:27 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:18:27 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:18:27 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:18:27 user nova-compute[75080]:     </memballoon>
Dec 05 15:18:27 user nova-compute[75080]:   </devices>
Dec 05 15:18:27 user nova-compute[75080]: </domain>
Dec 05 15:18:27 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:18:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-783074315',display_name='tempest-TestServerVolumeAttachmentScenario-server-783074315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-783074315',id=8,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5zNy+1ow33S20RcKvu1jD4khVEugsbpHZP0w5gwoHui4slwMVZuggEneoxgHpzG9XxLj0Ox43tVuGV/dMq8xnA87LiYq7FAbpkRDpapW42sRtTn6Fz7mT3cBHuJNGGwA==',key_name='tempest-keypair-1191671367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='787d8b299b8b4940b04446b4189fdf05',ramdisk_id='',reservation_id='r-yep2vq2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-291896938',owner_user_name='tempest-TestServerVolumeAttachmentScenario-291896938-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:18:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73fc83883fde496180489f170285d97f',uuid=d69bc0bc-b6e8-447b-b529-54031fc78ce1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c52a0de-1054-487a-9f4b-467d9151f1b0", "address": "fa:16:3e:b4:f4:d6", "network": {"id": "73bdb098-8c6b-4af3-b3f5-5fb4b213a0ab", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1357180398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "787d8b299b8b4940b04446b4189fdf05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c52a0de-10", "ovs_interfaceid": "1c52a0de-1054-487a-9f4b-467d9151f1b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Converting VIF {"id": "1c52a0de-1054-487a-9f4b-467d9151f1b0", "address": "fa:16:3e:b4:f4:d6", "network": {"id": "73bdb098-8c6b-4af3-b3f5-5fb4b213a0ab", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1357180398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "787d8b299b8b4940b04446b4189fdf05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c52a0de-10", "ovs_interfaceid": "1c52a0de-1054-487a-9f4b-467d9151f1b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:f4:d6,bridge_name='br-int',has_traffic_filtering=True,id=1c52a0de-1054-487a-9f4b-467d9151f1b0,network=Network(73bdb098-8c6b-4af3-b3f5-5fb4b213a0ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c52a0de-10') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG os_vif [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:f4:d6,bridge_name='br-int',has_traffic_filtering=True,id=1c52a0de-1054-487a-9f4b-467d9151f1b0,network=Network(73bdb098-8c6b-4af3-b3f5-5fb4b213a0ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c52a0de-10') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '902a3eac-939d-5a27-879d-9783e2d8c582', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c52a0de-10, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1c52a0de-10, col_values=(('qos', UUID('625cbe16-0aef-48e6-b5fa-88ac5377cf54')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1c52a0de-10, col_values=(('external_ids', {'iface-id': '1c52a0de-1054-487a-9f4b-467d9151f1b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:f4:d6', 'vm-uuid': 'd69bc0bc-b6e8-447b-b529-54031fc78ce1'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:27 user nova-compute[75080]: INFO os_vif [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:f4:d6,bridge_name='br-int',has_traffic_filtering=True,id=1c52a0de-1054-487a-9f4b-467d9151f1b0,network=Network(73bdb098-8c6b-4af3-b3f5-5fb4b213a0ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c52a0de-10')
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] No VIF found with MAC fa:16:3e:b4:f4:d6, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance bd75375a-8b70-4bc2-a72b-14213ebaa4e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance eedd1529-4feb-4f85-8625-0c20d8e0359d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 0259351f-617f-47be-bfb6-2fef1c35bf15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance f3cdfe20-7429-476d-9914-8141ba8b7488 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 1830878a-71e0-48f1-85b8-9ed83b1419cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 33078a88-4858-4c6b-bfa9-c3d9b83cf78b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance d69bc0bc-b6e8-447b-b529-54031fc78ce1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing inventories for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Updating ProviderTree inventory for provider 21b770fa-b774-46c9-9415-db26064ccd0f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Updating inventory in ProviderTree for provider 21b770fa-b774-46c9-9415-db26064ccd0f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing aggregate associations for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f, aggregates: None {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.network.neutron [req-f7036268-d6eb-4378-adb4-83879bbc9009 req-743863bf-62d7-4ddf-baab-04b1bcbd977e service nova] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Updated VIF entry in instance network info cache for port 1c52a0de-1054-487a-9f4b-467d9151f1b0. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.network.neutron [req-f7036268-d6eb-4378-adb4-83879bbc9009 req-743863bf-62d7-4ddf-baab-04b1bcbd977e service nova] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Updating instance_info_cache with network_info: [{"id": "1c52a0de-1054-487a-9f4b-467d9151f1b0", "address": "fa:16:3e:b4:f4:d6", "network": {"id": "73bdb098-8c6b-4af3-b3f5-5fb4b213a0ab", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1357180398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "787d8b299b8b4940b04446b4189fdf05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c52a0de-10", "ovs_interfaceid": "1c52a0de-1054-487a-9f4b-467d9151f1b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing trait associations for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f, traits: COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f7036268-d6eb-4378-adb4-83879bbc9009 req-743863bf-62d7-4ddf-baab-04b1bcbd977e service nova] Releasing lock "refresh_cache-d69bc0bc-b6e8-447b-b529-54031fc78ce1" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:18:27 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:18:28 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:18:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.081s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:18:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:29 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:18:29 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:18:29 user nova-compute[75080]: DEBUG nova.compute.manager [req-e002b980-608e-4382-b61a-f677e3e09454 req-8e72ea20-883a-4a0b-8582-f9d39acd0ccb service nova] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Received event network-vif-plugged-1c52a0de-1054-487a-9f4b-467d9151f1b0 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:18:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-e002b980-608e-4382-b61a-f677e3e09454 req-8e72ea20-883a-4a0b-8582-f9d39acd0ccb service nova] Acquiring lock "d69bc0bc-b6e8-447b-b529-54031fc78ce1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:18:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-e002b980-608e-4382-b61a-f677e3e09454 req-8e72ea20-883a-4a0b-8582-f9d39acd0ccb service nova] Lock "d69bc0bc-b6e8-447b-b529-54031fc78ce1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:18:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-e002b980-608e-4382-b61a-f677e3e09454 req-8e72ea20-883a-4a0b-8582-f9d39acd0ccb service nova] Lock "d69bc0bc-b6e8-447b-b529-54031fc78ce1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:18:29 user nova-compute[75080]: DEBUG nova.compute.manager [req-e002b980-608e-4382-b61a-f677e3e09454 req-8e72ea20-883a-4a0b-8582-f9d39acd0ccb service nova] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] No waiting events found dispatching network-vif-plugged-1c52a0de-1054-487a-9f4b-467d9151f1b0 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:18:29 user nova-compute[75080]: WARNING nova.compute.manager [req-e002b980-608e-4382-b61a-f677e3e09454 req-8e72ea20-883a-4a0b-8582-f9d39acd0ccb service nova] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Received unexpected event network-vif-plugged-1c52a0de-1054-487a-9f4b-467d9151f1b0 for instance with vm_state building and task_state spawning.
Dec 05 15:18:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:31 user nova-compute[75080]: DEBUG nova.compute.manager [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:18:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:18:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:31 user nova-compute[75080]: DEBUG nova.compute.manager [req-d1deb236-c2e6-48f1-b1d8-4ee6363ae958 req-1fa12817-e4ee-404f-8600-b53ca35570e9 service nova] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Received event network-vif-plugged-1c52a0de-1054-487a-9f4b-467d9151f1b0 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:18:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d1deb236-c2e6-48f1-b1d8-4ee6363ae958 req-1fa12817-e4ee-404f-8600-b53ca35570e9 service nova] Acquiring lock "d69bc0bc-b6e8-447b-b529-54031fc78ce1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:18:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d1deb236-c2e6-48f1-b1d8-4ee6363ae958 req-1fa12817-e4ee-404f-8600-b53ca35570e9 service nova] Lock "d69bc0bc-b6e8-447b-b529-54031fc78ce1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:18:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d1deb236-c2e6-48f1-b1d8-4ee6363ae958 req-1fa12817-e4ee-404f-8600-b53ca35570e9 service nova] Lock "d69bc0bc-b6e8-447b-b529-54031fc78ce1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:18:31 user nova-compute[75080]: DEBUG nova.compute.manager [req-d1deb236-c2e6-48f1-b1d8-4ee6363ae958 req-1fa12817-e4ee-404f-8600-b53ca35570e9 service nova] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] No waiting events found dispatching network-vif-plugged-1c52a0de-1054-487a-9f4b-467d9151f1b0 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:18:31 user nova-compute[75080]: WARNING nova.compute.manager [req-d1deb236-c2e6-48f1-b1d8-4ee6363ae958 req-1fa12817-e4ee-404f-8600-b53ca35570e9 service nova] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Received unexpected event network-vif-plugged-1c52a0de-1054-487a-9f4b-467d9151f1b0 for instance with vm_state building and task_state spawning.
Dec 05 15:18:31 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Instance spawned successfully.
Dec 05 15:18:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:18:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:31 user nova-compute[75080]: INFO nova.compute.manager [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Took 7.24 seconds to spawn the instance on the hypervisor.
Dec 05 15:18:31 user nova-compute[75080]: DEBUG nova.compute.manager [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:18:31 user nova-compute[75080]: INFO nova.compute.manager [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Took 8.71 seconds to build instance.
Dec 05 15:18:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d3e062d9-8f8a-4975-962f-4c53189768fd tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "d69bc0bc-b6e8-447b-b529-54031fc78ce1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.839s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:18:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Acquiring lock "63b86f43-a8f7-4b1d-a2e2-e0f614e6d764" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:18:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Lock "63b86f43-a8f7-4b1d-a2e2-e0f614e6d764" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:18:45 user nova-compute[75080]: DEBUG nova.compute.manager [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:18:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:18:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:18:45 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:18:45 user nova-compute[75080]: INFO nova.compute.claims [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Claim successful on node user
Dec 05 15:18:45 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:18:45 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:18:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:18:45 user nova-compute[75080]: DEBUG nova.compute.manager [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:18:45 user nova-compute[75080]: DEBUG nova.compute.manager [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:18:45 user nova-compute[75080]: DEBUG nova.network.neutron [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:18:45 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:18:45 user nova-compute[75080]: DEBUG nova.compute.manager [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:18:45 user nova-compute[75080]: DEBUG nova.policy [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc3019c10eb549e984490b34eee7814e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902ae7a7ca524dfa83b98c3baebc42eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:18:45 user nova-compute[75080]: DEBUG nova.compute.manager [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:18:45 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:18:45 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Creating image(s)
Dec 05 15:18:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Acquiring lock "/opt/stack/data/nova/instances/63b86f43-a8f7-4b1d-a2e2-e0f614e6d764/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:18:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Lock "/opt/stack/data/nova/instances/63b86f43-a8f7-4b1d-a2e2-e0f614e6d764/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:18:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Lock "/opt/stack/data/nova/instances/63b86f43-a8f7-4b1d-a2e2-e0f614e6d764/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:18:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:18:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.188s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:18:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:18:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:18:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:18:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.186s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:18:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/63b86f43-a8f7-4b1d-a2e2-e0f614e6d764/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:18:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/63b86f43-a8f7-4b1d-a2e2-e0f614e6d764/disk 1073741824" returned: 0 in 0.134s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:18:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.325s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:18:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:18:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.249s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:18:46 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Checking if we can resize image /opt/stack/data/nova/instances/63b86f43-a8f7-4b1d-a2e2-e0f614e6d764/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 15:18:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b86f43-a8f7-4b1d-a2e2-e0f614e6d764/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:18:46 user nova-compute[75080]: DEBUG nova.network.neutron [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Successfully created port: 367c561b-8d85-4af4-9abb-3e020c3b3cea {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:18:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b86f43-a8f7-4b1d-a2e2-e0f614e6d764/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:18:46 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Cannot resize image /opt/stack/data/nova/instances/63b86f43-a8f7-4b1d-a2e2-e0f614e6d764/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 15:18:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:18:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Ensure instance console log exists: /opt/stack/data/nova/instances/63b86f43-a8f7-4b1d-a2e2-e0f614e6d764/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:18:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:18:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:18:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:18:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:47 user nova-compute[75080]: DEBUG nova.network.neutron [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Successfully updated port: 367c561b-8d85-4af4-9abb-3e020c3b3cea {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:18:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Acquiring lock "refresh_cache-63b86f43-a8f7-4b1d-a2e2-e0f614e6d764" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:18:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Acquired lock "refresh_cache-63b86f43-a8f7-4b1d-a2e2-e0f614e6d764" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:18:47 user nova-compute[75080]: DEBUG nova.network.neutron [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:18:47 user nova-compute[75080]: DEBUG nova.compute.manager [req-88634e71-7cec-4777-adbb-33499cf77f80 req-e24fceab-ea6c-40ff-9356-935abfbee83f service nova] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Received event network-changed-367c561b-8d85-4af4-9abb-3e020c3b3cea {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:18:47 user nova-compute[75080]: DEBUG nova.compute.manager [req-88634e71-7cec-4777-adbb-33499cf77f80 req-e24fceab-ea6c-40ff-9356-935abfbee83f service nova] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Refreshing instance network info cache due to event network-changed-367c561b-8d85-4af4-9abb-3e020c3b3cea. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:18:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-88634e71-7cec-4777-adbb-33499cf77f80 req-e24fceab-ea6c-40ff-9356-935abfbee83f service nova] Acquiring lock "refresh_cache-63b86f43-a8f7-4b1d-a2e2-e0f614e6d764" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:18:47 user nova-compute[75080]: DEBUG nova.network.neutron [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG nova.network.neutron [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Updating instance_info_cache with network_info: [{"id": "367c561b-8d85-4af4-9abb-3e020c3b3cea", "address": "fa:16:3e:b4:73:45", "network": {"id": "6d5934bf-c431-4a09-8065-8928349e88a0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-238283929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "902ae7a7ca524dfa83b98c3baebc42eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap367c561b-8d", "ovs_interfaceid": "367c561b-8d85-4af4-9abb-3e020c3b3cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Releasing lock "refresh_cache-63b86f43-a8f7-4b1d-a2e2-e0f614e6d764" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG nova.compute.manager [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Instance network_info: |[{"id": "367c561b-8d85-4af4-9abb-3e020c3b3cea", "address": "fa:16:3e:b4:73:45", "network": {"id": "6d5934bf-c431-4a09-8065-8928349e88a0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-238283929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "902ae7a7ca524dfa83b98c3baebc42eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap367c561b-8d", "ovs_interfaceid": "367c561b-8d85-4af4-9abb-3e020c3b3cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-88634e71-7cec-4777-adbb-33499cf77f80 req-e24fceab-ea6c-40ff-9356-935abfbee83f service nova] Acquired lock "refresh_cache-63b86f43-a8f7-4b1d-a2e2-e0f614e6d764" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG nova.network.neutron [req-88634e71-7cec-4777-adbb-33499cf77f80 req-e24fceab-ea6c-40ff-9356-935abfbee83f service nova] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Refreshing network info cache for port 367c561b-8d85-4af4-9abb-3e020c3b3cea {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Start _get_guest_xml network_info=[{"id": "367c561b-8d85-4af4-9abb-3e020c3b3cea", "address": "fa:16:3e:b4:73:45", "network": {"id": "6d5934bf-c431-4a09-8065-8928349e88a0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-238283929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "902ae7a7ca524dfa83b98c3baebc42eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap367c561b-8d", "ovs_interfaceid": "367c561b-8d85-4af4-9abb-3e020c3b3cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:48 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:18:48 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:18:48 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:18:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1812956123',display_name='tempest-VolumesActionsTest-instance-1812956123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1812956123',id=9,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='902ae7a7ca524dfa83b98c3baebc42eb',ramdisk_id='',reservation_id='r-x6g6xe7v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-10205127',owner_user_name='tempest-VolumesActionsTest-10205127-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:18:46Z,user_data=None,user_id='fc3019c10eb549e984490b34eee7814e',uuid=63b86f43-a8f7-4b1d-a2e2-e0f614e6d764,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "367c561b-8d85-4af4-9abb-3e020c3b3cea", "address": "fa:16:3e:b4:73:45", "network": {"id": "6d5934bf-c431-4a09-8065-8928349e88a0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-238283929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "902ae7a7ca524dfa83b98c3baebc42eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap367c561b-8d", "ovs_interfaceid": "367c561b-8d85-4af4-9abb-3e020c3b3cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Converting VIF {"id": "367c561b-8d85-4af4-9abb-3e020c3b3cea", "address": "fa:16:3e:b4:73:45", "network": {"id": "6d5934bf-c431-4a09-8065-8928349e88a0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-238283929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "902ae7a7ca524dfa83b98c3baebc42eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap367c561b-8d", "ovs_interfaceid": "367c561b-8d85-4af4-9abb-3e020c3b3cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:73:45,bridge_name='br-int',has_traffic_filtering=True,id=367c561b-8d85-4af4-9abb-3e020c3b3cea,network=Network(6d5934bf-c431-4a09-8065-8928349e88a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap367c561b-8d') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG nova.objects.instance [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Lazy-loading 'pci_devices' on Instance uuid 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:18:48 user nova-compute[75080]:   <uuid>63b86f43-a8f7-4b1d-a2e2-e0f614e6d764</uuid>
Dec 05 15:18:48 user nova-compute[75080]:   <name>instance-00000009</name>
Dec 05 15:18:48 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:18:48 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:18:48 user nova-compute[75080]:   <metadata>
Dec 05 15:18:48 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:18:48 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:18:48 user nova-compute[75080]:       <nova:name>tempest-VolumesActionsTest-instance-1812956123</nova:name>
Dec 05 15:18:48 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:18:48</nova:creationTime>
Dec 05 15:18:48 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:18:48 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:18:48 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:18:48 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:18:48 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:18:48 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:18:48 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:18:48 user nova-compute[75080]:       <nova:owner>
Dec 05 15:18:48 user nova-compute[75080]:         <nova:user uuid="fc3019c10eb549e984490b34eee7814e">tempest-VolumesActionsTest-10205127-project-member</nova:user>
Dec 05 15:18:48 user nova-compute[75080]:         <nova:project uuid="902ae7a7ca524dfa83b98c3baebc42eb">tempest-VolumesActionsTest-10205127</nova:project>
Dec 05 15:18:48 user nova-compute[75080]:       </nova:owner>
Dec 05 15:18:48 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:18:48 user nova-compute[75080]:       <nova:ports>
Dec 05 15:18:48 user nova-compute[75080]:         <nova:port uuid="367c561b-8d85-4af4-9abb-3e020c3b3cea">
Dec 05 15:18:48 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 05 15:18:48 user nova-compute[75080]:         </nova:port>
Dec 05 15:18:48 user nova-compute[75080]:       </nova:ports>
Dec 05 15:18:48 user nova-compute[75080]:     </nova:instance>
Dec 05 15:18:48 user nova-compute[75080]:   </metadata>
Dec 05 15:18:48 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:18:48 user nova-compute[75080]:     <system>
Dec 05 15:18:48 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:18:48 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:18:48 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:18:48 user nova-compute[75080]:       <entry name="serial">63b86f43-a8f7-4b1d-a2e2-e0f614e6d764</entry>
Dec 05 15:18:48 user nova-compute[75080]:       <entry name="uuid">63b86f43-a8f7-4b1d-a2e2-e0f614e6d764</entry>
Dec 05 15:18:48 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:18:48 user nova-compute[75080]:     </system>
Dec 05 15:18:48 user nova-compute[75080]:   </sysinfo>
Dec 05 15:18:48 user nova-compute[75080]:   <os>
Dec 05 15:18:48 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:18:48 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:18:48 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:18:48 user nova-compute[75080]:   </os>
Dec 05 15:18:48 user nova-compute[75080]:   <features>
Dec 05 15:18:48 user nova-compute[75080]:     <acpi/>
Dec 05 15:18:48 user nova-compute[75080]:     <apic/>
Dec 05 15:18:48 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:18:48 user nova-compute[75080]:   </features>
Dec 05 15:18:48 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:18:48 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:18:48 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:18:48 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:18:48 user nova-compute[75080]:   </clock>
Dec 05 15:18:48 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:18:48 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:18:48 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:18:48 user nova-compute[75080]:   </cpu>
Dec 05 15:18:48 user nova-compute[75080]:   <devices>
Dec 05 15:18:48 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:18:48 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:18:48 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/63b86f43-a8f7-4b1d-a2e2-e0f614e6d764/disk"/>
Dec 05 15:18:48 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:18:48 user nova-compute[75080]:     </disk>
Dec 05 15:18:48 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:18:48 user nova-compute[75080]:       <mac address="fa:16:3e:b4:73:45"/>
Dec 05 15:18:48 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:18:48 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:18:48 user nova-compute[75080]:       <target dev="tap367c561b-8d"/>
Dec 05 15:18:48 user nova-compute[75080]:     </interface>
Dec 05 15:18:48 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:18:48 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/63b86f43-a8f7-4b1d-a2e2-e0f614e6d764/console.log" append="off"/>
Dec 05 15:18:48 user nova-compute[75080]:     </serial>
Dec 05 15:18:48 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:18:48 user nova-compute[75080]:     <video>
Dec 05 15:18:48 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:18:48 user nova-compute[75080]:     </video>
Dec 05 15:18:48 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:18:48 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:18:48 user nova-compute[75080]:     </rng>
Dec 05 15:18:48 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:18:48 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:18:48 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:18:48 user nova-compute[75080]:     </memballoon>
Dec 05 15:18:48 user nova-compute[75080]:   </devices>
Dec 05 15:18:48 user nova-compute[75080]: </domain>
Dec 05 15:18:48 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:18:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1812956123',display_name='tempest-VolumesActionsTest-instance-1812956123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1812956123',id=9,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='902ae7a7ca524dfa83b98c3baebc42eb',ramdisk_id='',reservation_id='r-x6g6xe7v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-10205127',owner_user_name='tempest-VolumesActionsTest-10205127-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:18:46Z,user_data=None,user_id='fc3019c10eb549e984490b34eee7814e',uuid=63b86f43-a8f7-4b1d-a2e2-e0f614e6d764,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "367c561b-8d85-4af4-9abb-3e020c3b3cea", "address": "fa:16:3e:b4:73:45", "network": {"id": "6d5934bf-c431-4a09-8065-8928349e88a0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-238283929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "902ae7a7ca524dfa83b98c3baebc42eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap367c561b-8d", "ovs_interfaceid": "367c561b-8d85-4af4-9abb-3e020c3b3cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Converting VIF {"id": "367c561b-8d85-4af4-9abb-3e020c3b3cea", "address": "fa:16:3e:b4:73:45", "network": {"id": "6d5934bf-c431-4a09-8065-8928349e88a0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-238283929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "902ae7a7ca524dfa83b98c3baebc42eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap367c561b-8d", "ovs_interfaceid": "367c561b-8d85-4af4-9abb-3e020c3b3cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:73:45,bridge_name='br-int',has_traffic_filtering=True,id=367c561b-8d85-4af4-9abb-3e020c3b3cea,network=Network(6d5934bf-c431-4a09-8065-8928349e88a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap367c561b-8d') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG os_vif [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:73:45,bridge_name='br-int',has_traffic_filtering=True,id=367c561b-8d85-4af4-9abb-3e020c3b3cea,network=Network(6d5934bf-c431-4a09-8065-8928349e88a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap367c561b-8d') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e9c7e873-6b06-5025-b52d-1fff5dac19be', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap367c561b-8d, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap367c561b-8d, col_values=(('qos', UUID('98e9d71c-f0d9-4bac-9a3d-8d5bafbff2d7')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap367c561b-8d, col_values=(('external_ids', {'iface-id': '367c561b-8d85-4af4-9abb-3e020c3b3cea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:73:45', 'vm-uuid': '63b86f43-a8f7-4b1d-a2e2-e0f614e6d764'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:48 user nova-compute[75080]: INFO os_vif [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:73:45,bridge_name='br-int',has_traffic_filtering=True,id=367c561b-8d85-4af4-9abb-3e020c3b3cea,network=Network(6d5934bf-c431-4a09-8065-8928349e88a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap367c561b-8d')
Dec 05 15:18:48 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] No VIF found with MAC fa:16:3e:b4:73:45, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG nova.network.neutron [req-88634e71-7cec-4777-adbb-33499cf77f80 req-e24fceab-ea6c-40ff-9356-935abfbee83f service nova] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Updated VIF entry in instance network info cache for port 367c561b-8d85-4af4-9abb-3e020c3b3cea. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG nova.network.neutron [req-88634e71-7cec-4777-adbb-33499cf77f80 req-e24fceab-ea6c-40ff-9356-935abfbee83f service nova] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Updating instance_info_cache with network_info: [{"id": "367c561b-8d85-4af4-9abb-3e020c3b3cea", "address": "fa:16:3e:b4:73:45", "network": {"id": "6d5934bf-c431-4a09-8065-8928349e88a0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-238283929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "902ae7a7ca524dfa83b98c3baebc42eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap367c561b-8d", "ovs_interfaceid": "367c561b-8d85-4af4-9abb-3e020c3b3cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:18:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-88634e71-7cec-4777-adbb-33499cf77f80 req-e24fceab-ea6c-40ff-9356-935abfbee83f service nova] Releasing lock "refresh_cache-63b86f43-a8f7-4b1d-a2e2-e0f614e6d764" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:18:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:50 user nova-compute[75080]: DEBUG nova.compute.manager [req-6c3596ea-bd5c-4cdd-9be8-068bf52291f8 req-cb610ec3-ecd4-44c0-92ea-093daf90b1e8 service nova] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Received event network-vif-plugged-367c561b-8d85-4af4-9abb-3e020c3b3cea {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:18:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-6c3596ea-bd5c-4cdd-9be8-068bf52291f8 req-cb610ec3-ecd4-44c0-92ea-093daf90b1e8 service nova] Acquiring lock "63b86f43-a8f7-4b1d-a2e2-e0f614e6d764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:18:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-6c3596ea-bd5c-4cdd-9be8-068bf52291f8 req-cb610ec3-ecd4-44c0-92ea-093daf90b1e8 service nova] Lock "63b86f43-a8f7-4b1d-a2e2-e0f614e6d764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:18:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-6c3596ea-bd5c-4cdd-9be8-068bf52291f8 req-cb610ec3-ecd4-44c0-92ea-093daf90b1e8 service nova] Lock "63b86f43-a8f7-4b1d-a2e2-e0f614e6d764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:18:50 user nova-compute[75080]: DEBUG nova.compute.manager [req-6c3596ea-bd5c-4cdd-9be8-068bf52291f8 req-cb610ec3-ecd4-44c0-92ea-093daf90b1e8 service nova] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] No waiting events found dispatching network-vif-plugged-367c561b-8d85-4af4-9abb-3e020c3b3cea {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:18:50 user nova-compute[75080]: WARNING nova.compute.manager [req-6c3596ea-bd5c-4cdd-9be8-068bf52291f8 req-cb610ec3-ecd4-44c0-92ea-093daf90b1e8 service nova] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Received unexpected event network-vif-plugged-367c561b-8d85-4af4-9abb-3e020c3b3cea for instance with vm_state building and task_state spawning.
Dec 05 15:18:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:52 user nova-compute[75080]: DEBUG nova.compute.manager [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:18:52 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:18:52 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Instance spawned successfully.
Dec 05 15:18:52 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:18:52 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:52 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:52 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:52 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:52 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:52 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:18:52 user nova-compute[75080]: INFO nova.compute.manager [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Took 6.51 seconds to spawn the instance on the hypervisor.
Dec 05 15:18:52 user nova-compute[75080]: DEBUG nova.compute.manager [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:18:52 user nova-compute[75080]: INFO nova.compute.manager [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Took 7.35 seconds to build instance.
Dec 05 15:18:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-257a09fc-ede3-4516-ab78-dbdeab99d3c5 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Lock "63b86f43-a8f7-4b1d-a2e2-e0f614e6d764" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.465s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:18:52 user nova-compute[75080]: DEBUG nova.compute.manager [req-20a31115-d19d-4ed0-931f-f9cae8a00ab7 req-2864da63-37c4-4bcf-946c-5e64f0fc7651 service nova] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Received event network-vif-plugged-367c561b-8d85-4af4-9abb-3e020c3b3cea {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:18:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-20a31115-d19d-4ed0-931f-f9cae8a00ab7 req-2864da63-37c4-4bcf-946c-5e64f0fc7651 service nova] Acquiring lock "63b86f43-a8f7-4b1d-a2e2-e0f614e6d764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:18:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-20a31115-d19d-4ed0-931f-f9cae8a00ab7 req-2864da63-37c4-4bcf-946c-5e64f0fc7651 service nova] Lock "63b86f43-a8f7-4b1d-a2e2-e0f614e6d764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:18:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-20a31115-d19d-4ed0-931f-f9cae8a00ab7 req-2864da63-37c4-4bcf-946c-5e64f0fc7651 service nova] Lock "63b86f43-a8f7-4b1d-a2e2-e0f614e6d764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:18:52 user nova-compute[75080]: DEBUG nova.compute.manager [req-20a31115-d19d-4ed0-931f-f9cae8a00ab7 req-2864da63-37c4-4bcf-946c-5e64f0fc7651 service nova] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] No waiting events found dispatching network-vif-plugged-367c561b-8d85-4af4-9abb-3e020c3b3cea {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:18:52 user nova-compute[75080]: WARNING nova.compute.manager [req-20a31115-d19d-4ed0-931f-f9cae8a00ab7 req-2864da63-37c4-4bcf-946c-5e64f0fc7651 service nova] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Received unexpected event network-vif-plugged-367c561b-8d85-4af4-9abb-3e020c3b3cea for instance with vm_state active and task_state None.
Dec 05 15:18:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Acquiring lock "912b0528-be16-427f-84fc-8a6cf89d5000" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:18:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Lock "912b0528-be16-427f-84fc-8a6cf89d5000" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:18:54 user nova-compute[75080]: DEBUG nova.compute.manager [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:18:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:18:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:18:54 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:18:54 user nova-compute[75080]: INFO nova.compute.claims [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Claim successful on node user
Dec 05 15:18:55 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:18:55 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:18:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.418s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:18:55 user nova-compute[75080]: DEBUG nova.compute.manager [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:18:55 user nova-compute[75080]: DEBUG nova.compute.manager [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:18:55 user nova-compute[75080]: DEBUG nova.network.neutron [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:18:55 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:18:55 user nova-compute[75080]: DEBUG nova.compute.manager [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:18:55 user nova-compute[75080]: INFO nova.virt.block_device [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Booting with volume 7dcf2180-a9e8-4068-825b-1d71c9ec54ed at /dev/vda
Dec 05 15:18:55 user nova-compute[75080]: DEBUG nova.policy [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05a2411551904db193548223ad5e3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bd42ae707642a09acd3c394fd36a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:18:55 user nova-compute[75080]: DEBUG os_brick.utils [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:18:55 user nova-compute[75080]: INFO oslo.privsep.daemon [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpmcapu4ws/privsep.sock']
Dec 05 15:18:55 user sudo[86237]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpmcapu4ws/privsep.sock
Dec 05 15:18:55 user sudo[86237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Dec 05 15:18:56 user nova-compute[75080]: DEBUG nova.network.neutron [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Successfully created port: 6fc199c0-dcfd-4c56-a910-37478f4c85bb {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:18:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:56 user nova-compute[75080]: DEBUG nova.network.neutron [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Successfully created port: b5f4ea2a-ca87-42b4-a7fe-0234b8567230 {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:18:57 user sudo[86237]: pam_unix(sudo:session): session closed for user root
Dec 05 15:18:57 user nova-compute[75080]: INFO oslo.privsep.daemon [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Spawned new privsep daemon via rootwrap
Dec 05 15:18:57 user nova-compute[75080]: INFO oslo.privsep.daemon [-] privsep daemon starting
Dec 05 15:18:57 user nova-compute[75080]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Dec 05 15:18:57 user nova-compute[75080]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Dec 05 15:18:57 user nova-compute[75080]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86242
Dec 05 15:18:57 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9377b60d-65cc-495f-a285-b4286f2781fb]: (2,) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:18:57 user nova-compute[75080]: DEBUG nova.network.neutron [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Successfully created port: 08064378-9b0c-4b96-a818-6bbd4e31b553 {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:18:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:18:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:18:57 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2221f0-9385-475a-b4e5-5939d3e3e62e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:18:57 user nova-compute[75080]: WARNING os_brick.initiator.connectors.nvmeof [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Dec 05 15:18:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:18:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:18:57 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[157ef1fe-7727-41e2-9467-8221779d10b0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:18:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:18:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:18:57 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ed3ece-469d-4897-8197-970aa7565a15]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:18:57 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[98977da5-8018-484e-a3de-c3c9c65f11b8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:18:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:18:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:18:57 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:18:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:18:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:18:57 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:18:57 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b04c053-ee02-4f12-81b0-1e707452b240]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:18:57 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:18:57 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:18:57 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:18:57 user nova-compute[75080]: DEBUG os_brick.utils [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] <== get_connector_properties: return (1962ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:18:57 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Updating existing volume attachment record: 0ac8ff63-f15e-43fd-9359-e7c727743779 {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:18:57 user nova-compute[75080]: DEBUG nova.network.neutron [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Successfully created port: d89c793b-d55a-47b5-a857-bfb4b02d9781 {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:18:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:18:58 user nova-compute[75080]: DEBUG nova.network.neutron [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Successfully created port: eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:18:58 user nova-compute[75080]: DEBUG nova.network.neutron [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Successfully updated port: 6fc199c0-dcfd-4c56-a910-37478f4c85bb {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:18:59 user nova-compute[75080]: DEBUG nova.compute.manager [req-1b02ea00-1d0d-4c3e-bab6-49643786bf3c req-d35b32f4-58a7-4a66-bcb1-307a0effb091 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-changed-6fc199c0-dcfd-4c56-a910-37478f4c85bb {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:18:59 user nova-compute[75080]: DEBUG nova.compute.manager [req-1b02ea00-1d0d-4c3e-bab6-49643786bf3c req-d35b32f4-58a7-4a66-bcb1-307a0effb091 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Refreshing instance network info cache due to event network-changed-6fc199c0-dcfd-4c56-a910-37478f4c85bb. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:18:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-1b02ea00-1d0d-4c3e-bab6-49643786bf3c req-d35b32f4-58a7-4a66-bcb1-307a0effb091 service nova] Acquiring lock "refresh_cache-912b0528-be16-427f-84fc-8a6cf89d5000" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:18:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-1b02ea00-1d0d-4c3e-bab6-49643786bf3c req-d35b32f4-58a7-4a66-bcb1-307a0effb091 service nova] Acquired lock "refresh_cache-912b0528-be16-427f-84fc-8a6cf89d5000" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:18:59 user nova-compute[75080]: DEBUG nova.network.neutron [req-1b02ea00-1d0d-4c3e-bab6-49643786bf3c req-d35b32f4-58a7-4a66-bcb1-307a0effb091 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Refreshing network info cache for port 6fc199c0-dcfd-4c56-a910-37478f4c85bb {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:18:59 user nova-compute[75080]: DEBUG nova.network.neutron [req-1b02ea00-1d0d-4c3e-bab6-49643786bf3c req-d35b32f4-58a7-4a66-bcb1-307a0effb091 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:18:59 user nova-compute[75080]: DEBUG nova.network.neutron [req-1b02ea00-1d0d-4c3e-bab6-49643786bf3c req-d35b32f4-58a7-4a66-bcb1-307a0effb091 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:18:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-1b02ea00-1d0d-4c3e-bab6-49643786bf3c req-d35b32f4-58a7-4a66-bcb1-307a0effb091 service nova] Releasing lock "refresh_cache-912b0528-be16-427f-84fc-8a6cf89d5000" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:18:59 user nova-compute[75080]: DEBUG nova.network.neutron [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Successfully updated port: 4ac602c3-db8c-42fd-a71f-1664e7a33d9a {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:19:00 user nova-compute[75080]: DEBUG nova.network.neutron [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Successfully updated port: 05511460-e0ce-4cd0-9d83-f61d776230e3 {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:19:01 user nova-compute[75080]: DEBUG nova.compute.manager [req-4a8a37f9-e592-4cde-babd-a6246016874d req-88166cab-a76c-499a-b3f0-9e9665e49b01 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-changed-4ac602c3-db8c-42fd-a71f-1664e7a33d9a {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:19:01 user nova-compute[75080]: DEBUG nova.compute.manager [req-4a8a37f9-e592-4cde-babd-a6246016874d req-88166cab-a76c-499a-b3f0-9e9665e49b01 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Refreshing instance network info cache due to event network-changed-4ac602c3-db8c-42fd-a71f-1664e7a33d9a. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:19:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4a8a37f9-e592-4cde-babd-a6246016874d req-88166cab-a76c-499a-b3f0-9e9665e49b01 service nova] Acquiring lock "refresh_cache-912b0528-be16-427f-84fc-8a6cf89d5000" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:19:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4a8a37f9-e592-4cde-babd-a6246016874d req-88166cab-a76c-499a-b3f0-9e9665e49b01 service nova] Acquired lock "refresh_cache-912b0528-be16-427f-84fc-8a6cf89d5000" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:19:01 user nova-compute[75080]: DEBUG nova.network.neutron [req-4a8a37f9-e592-4cde-babd-a6246016874d req-88166cab-a76c-499a-b3f0-9e9665e49b01 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Refreshing network info cache for port 4ac602c3-db8c-42fd-a71f-1664e7a33d9a {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:19:01 user nova-compute[75080]: DEBUG nova.network.neutron [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Successfully updated port: b5f4ea2a-ca87-42b4-a7fe-0234b8567230 {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:19:01 user nova-compute[75080]: DEBUG nova.network.neutron [req-4a8a37f9-e592-4cde-babd-a6246016874d req-88166cab-a76c-499a-b3f0-9e9665e49b01 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:19:01 user nova-compute[75080]: DEBUG nova.network.neutron [req-4a8a37f9-e592-4cde-babd-a6246016874d req-88166cab-a76c-499a-b3f0-9e9665e49b01 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:19:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4a8a37f9-e592-4cde-babd-a6246016874d req-88166cab-a76c-499a-b3f0-9e9665e49b01 service nova] Releasing lock "refresh_cache-912b0528-be16-427f-84fc-8a6cf89d5000" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:19:01 user nova-compute[75080]: DEBUG nova.compute.manager [req-4a8a37f9-e592-4cde-babd-a6246016874d req-88166cab-a76c-499a-b3f0-9e9665e49b01 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-changed-05511460-e0ce-4cd0-9d83-f61d776230e3 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:19:01 user nova-compute[75080]: DEBUG nova.compute.manager [req-4a8a37f9-e592-4cde-babd-a6246016874d req-88166cab-a76c-499a-b3f0-9e9665e49b01 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Refreshing instance network info cache due to event network-changed-05511460-e0ce-4cd0-9d83-f61d776230e3. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:19:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4a8a37f9-e592-4cde-babd-a6246016874d req-88166cab-a76c-499a-b3f0-9e9665e49b01 service nova] Acquiring lock "refresh_cache-912b0528-be16-427f-84fc-8a6cf89d5000" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:19:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4a8a37f9-e592-4cde-babd-a6246016874d req-88166cab-a76c-499a-b3f0-9e9665e49b01 service nova] Acquired lock "refresh_cache-912b0528-be16-427f-84fc-8a6cf89d5000" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:19:01 user nova-compute[75080]: DEBUG nova.network.neutron [req-4a8a37f9-e592-4cde-babd-a6246016874d req-88166cab-a76c-499a-b3f0-9e9665e49b01 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Refreshing network info cache for port 05511460-e0ce-4cd0-9d83-f61d776230e3 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:19:01 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:01 user nova-compute[75080]: DEBUG nova.network.neutron [req-4a8a37f9-e592-4cde-babd-a6246016874d req-88166cab-a76c-499a-b3f0-9e9665e49b01 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:19:01 user nova-compute[75080]: DEBUG nova.network.neutron [req-4a8a37f9-e592-4cde-babd-a6246016874d req-88166cab-a76c-499a-b3f0-9e9665e49b01 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:19:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4a8a37f9-e592-4cde-babd-a6246016874d req-88166cab-a76c-499a-b3f0-9e9665e49b01 service nova] Releasing lock "refresh_cache-912b0528-be16-427f-84fc-8a6cf89d5000" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:19:01 user nova-compute[75080]: DEBUG nova.network.neutron [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Successfully updated port: 08064378-9b0c-4b96-a818-6bbd4e31b553 {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:19:02 user nova-compute[75080]: DEBUG nova.network.neutron [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Successfully updated port: d89c793b-d55a-47b5-a857-bfb4b02d9781 {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:19:03 user nova-compute[75080]: DEBUG nova.network.neutron [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Successfully updated port: eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:19:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Acquiring lock "refresh_cache-912b0528-be16-427f-84fc-8a6cf89d5000" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:19:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Acquired lock "refresh_cache-912b0528-be16-427f-84fc-8a6cf89d5000" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:19:03 user nova-compute[75080]: DEBUG nova.network.neutron [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:19:03 user nova-compute[75080]: DEBUG nova.compute.manager [req-9e50de89-f052-4435-8e5c-5fbc9f9b5e99 req-b6f4457b-f59c-48d8-8f5f-f1fbb398e2dd service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-changed-b5f4ea2a-ca87-42b4-a7fe-0234b8567230 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:19:03 user nova-compute[75080]: DEBUG nova.compute.manager [req-9e50de89-f052-4435-8e5c-5fbc9f9b5e99 req-b6f4457b-f59c-48d8-8f5f-f1fbb398e2dd service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Refreshing instance network info cache due to event network-changed-b5f4ea2a-ca87-42b4-a7fe-0234b8567230. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:19:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9e50de89-f052-4435-8e5c-5fbc9f9b5e99 req-b6f4457b-f59c-48d8-8f5f-f1fbb398e2dd service nova] Acquiring lock "refresh_cache-912b0528-be16-427f-84fc-8a6cf89d5000" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:19:03 user nova-compute[75080]: DEBUG nova.network.neutron [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:19:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:04 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:19:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:04 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:19:04 user nova-compute[75080]: INFO nova.compute.claims [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Claim successful on node user
Dec 05 15:19:05 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:19:05 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:19:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.539s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:19:05 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:19:05 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:19:05 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:19:05 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:19:05 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:19:05 user nova-compute[75080]: DEBUG nova.policy [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '15be5b54cc8346bb86683e4ed2fbba9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11227acd507347ae9c5a3bc710707f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:19:05 user nova-compute[75080]: DEBUG nova.network.neutron [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Updating instance_info_cache with network_info: [{"id": "6fc199c0-dcfd-4c56-a910-37478f4c85bb", "address": "fa:16:3e:74:76:f4", "network": {"id": "a9446f1c-bd4f-47f6-a76d-8e479fe32437", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-273850890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fc199c0-dc", "ovs_interfaceid": "6fc199c0-dcfd-4c56-a910-37478f4c85bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ac602c3-db8c-42fd-a71f-1664e7a33d9a", "address": "fa:16:3e:4a:ae:17", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac602c3-db", "ovs_interfaceid": "4ac602c3-db8c-42fd-a71f-1664e7a33d9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "05511460-e0ce-4cd0-9d83-f61d776230e3", "address": "fa:16:3e:4c:56:ff", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05511460-e0", "ovs_interfaceid": "05511460-e0ce-4cd0-9d83-f61d776230e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b5f4ea2a-ca87-42b4-a7fe-0234b8567230", "address": "fa:16:3e:86:2e:34", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f4ea2a-ca", "ovs_interfaceid": "b5f4ea2a-ca87-42b4-a7fe-0234b8567230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08064378-9b0c-4b96-a818-6bbd4e31b553", "address": "fa:16:3e:58:dc:50", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08064378-9b", "ovs_interfaceid": "08064378-9b0c-4b96-a818-6bbd4e31b553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d89c793b-d55a-47b5-a857-bfb4b02d9781", "address": "fa:16:3e:38:ba:63", "network": {"id": "552adb39-e03e-4478-ac90-a3ca91fdce4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1038445196", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd89c793b-d5", "ovs_interfaceid": "d89c793b-d55a-47b5-a857-bfb4b02d9781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c", "address": "fa:16:3e:4a:8d:8f", "network": {"id": "552adb39-e03e-4478-ac90-a3ca91fdce4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1038445196", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac25d6a-4e", "ovs_interfaceid": "eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:19:05 user nova-compute[75080]: INFO nova.virt.block_device [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Booting with volume snapshot 841bf2cf-779d-449f-ad47-b677237fec8c at /dev/vda
Dec 05 15:19:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Releasing lock "refresh_cache-912b0528-be16-427f-84fc-8a6cf89d5000" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:19:05 user nova-compute[75080]: DEBUG nova.compute.manager [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Instance network_info: |[{"id": "6fc199c0-dcfd-4c56-a910-37478f4c85bb", "address": "fa:16:3e:74:76:f4", "network": {"id": "a9446f1c-bd4f-47f6-a76d-8e479fe32437", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-273850890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fc199c0-dc", "ovs_interfaceid": "6fc199c0-dcfd-4c56-a910-37478f4c85bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ac602c3-db8c-42fd-a71f-1664e7a33d9a", "address": "fa:16:3e:4a:ae:17", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac602c3-db", "ovs_interfaceid": "4ac602c3-db8c-42fd-a71f-1664e7a33d9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "05511460-e0ce-4cd0-9d83-f61d776230e3", "address": "fa:16:3e:4c:56:ff", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05511460-e0", "ovs_interfaceid": "05511460-e0ce-4cd0-9d83-f61d776230e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b5f4ea2a-ca87-42b4-a7fe-0234b8567230", "address": "fa:16:3e:86:2e:34", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f4ea2a-ca", "ovs_interfaceid": "b5f4ea2a-ca87-42b4-a7fe-0234b8567230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08064378-9b0c-4b96-a818-6bbd4e31b553", "address": "fa:16:3e:58:dc:50", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08064378-9b", "ovs_interfaceid": "08064378-9b0c-4b96-a818-6bbd4e31b553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d89c793b-d55a-47b5-a857-bfb4b02d9781", "address": "fa:16:3e:38:ba:63", "network": {"id": "552adb39-e03e-4478-ac90-a3ca91fdce4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1038445196", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd89c793b-d5", "ovs_interfaceid": "d89c793b-d55a-47b5-a857-bfb4b02d9781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c", "address": "fa:16:3e:4a:8d:8f", "network": {"id": "552adb39-e03e-4478-ac90-a3ca91fdce4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1038445196", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac25d6a-4e", "ovs_interfaceid": "eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:19:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9e50de89-f052-4435-8e5c-5fbc9f9b5e99 req-b6f4457b-f59c-48d8-8f5f-f1fbb398e2dd service nova] Acquired lock "refresh_cache-912b0528-be16-427f-84fc-8a6cf89d5000" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:19:05 user nova-compute[75080]: DEBUG nova.network.neutron [req-9e50de89-f052-4435-8e5c-5fbc9f9b5e99 req-b6f4457b-f59c-48d8-8f5f-f1fbb398e2dd service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Refreshing network info cache for port b5f4ea2a-ca87-42b4-a7fe-0234b8567230 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:19:06 user nova-compute[75080]: DEBUG nova.network.neutron [req-9e50de89-f052-4435-8e5c-5fbc9f9b5e99 req-b6f4457b-f59c-48d8-8f5f-f1fbb398e2dd service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Updated VIF entry in instance network info cache for port b5f4ea2a-ca87-42b4-a7fe-0234b8567230. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:19:06 user nova-compute[75080]: DEBUG nova.network.neutron [req-9e50de89-f052-4435-8e5c-5fbc9f9b5e99 req-b6f4457b-f59c-48d8-8f5f-f1fbb398e2dd service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Updating instance_info_cache with network_info: [{"id": "6fc199c0-dcfd-4c56-a910-37478f4c85bb", "address": "fa:16:3e:74:76:f4", "network": {"id": "a9446f1c-bd4f-47f6-a76d-8e479fe32437", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-273850890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fc199c0-dc", "ovs_interfaceid": "6fc199c0-dcfd-4c56-a910-37478f4c85bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ac602c3-db8c-42fd-a71f-1664e7a33d9a", "address": "fa:16:3e:4a:ae:17", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac602c3-db", "ovs_interfaceid": "4ac602c3-db8c-42fd-a71f-1664e7a33d9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "05511460-e0ce-4cd0-9d83-f61d776230e3", "address": "fa:16:3e:4c:56:ff", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05511460-e0", "ovs_interfaceid": "05511460-e0ce-4cd0-9d83-f61d776230e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b5f4ea2a-ca87-42b4-a7fe-0234b8567230", "address": "fa:16:3e:86:2e:34", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f4ea2a-ca", "ovs_interfaceid": "b5f4ea2a-ca87-42b4-a7fe-0234b8567230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08064378-9b0c-4b96-a818-6bbd4e31b553", "address": "fa:16:3e:58:dc:50", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08064378-9b", "ovs_interfaceid": "08064378-9b0c-4b96-a818-6bbd4e31b553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d89c793b-d55a-47b5-a857-bfb4b02d9781", "address": "fa:16:3e:38:ba:63", "network": {"id": "552adb39-e03e-4478-ac90-a3ca91fdce4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1038445196", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd89c793b-d5", "ovs_interfaceid": "d89c793b-d55a-47b5-a857-bfb4b02d9781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c", "address": "fa:16:3e:4a:8d:8f", "network": {"id": "552adb39-e03e-4478-ac90-a3ca91fdce4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1038445196", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac25d6a-4e", "ovs_interfaceid": "eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:19:06 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Successfully created port: a78e717e-684a-4255-b220-15faa1145a1e {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:19:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9e50de89-f052-4435-8e5c-5fbc9f9b5e99 req-b6f4457b-f59c-48d8-8f5f-f1fbb398e2dd service nova] Releasing lock "refresh_cache-912b0528-be16-427f-84fc-8a6cf89d5000" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:19:06 user nova-compute[75080]: DEBUG nova.compute.manager [req-9e50de89-f052-4435-8e5c-5fbc9f9b5e99 req-b6f4457b-f59c-48d8-8f5f-f1fbb398e2dd service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-changed-08064378-9b0c-4b96-a818-6bbd4e31b553 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:19:06 user nova-compute[75080]: DEBUG nova.compute.manager [req-9e50de89-f052-4435-8e5c-5fbc9f9b5e99 req-b6f4457b-f59c-48d8-8f5f-f1fbb398e2dd service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Refreshing instance network info cache due to event network-changed-08064378-9b0c-4b96-a818-6bbd4e31b553. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:19:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9e50de89-f052-4435-8e5c-5fbc9f9b5e99 req-b6f4457b-f59c-48d8-8f5f-f1fbb398e2dd service nova] Acquiring lock "refresh_cache-912b0528-be16-427f-84fc-8a6cf89d5000" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:19:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9e50de89-f052-4435-8e5c-5fbc9f9b5e99 req-b6f4457b-f59c-48d8-8f5f-f1fbb398e2dd service nova] Acquired lock "refresh_cache-912b0528-be16-427f-84fc-8a6cf89d5000" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:19:06 user nova-compute[75080]: DEBUG nova.network.neutron [req-9e50de89-f052-4435-8e5c-5fbc9f9b5e99 req-b6f4457b-f59c-48d8-8f5f-f1fbb398e2dd service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Refreshing network info cache for port 08064378-9b0c-4b96-a818-6bbd4e31b553 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:19:06 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:06 user nova-compute[75080]: DEBUG nova.network.neutron [req-9e50de89-f052-4435-8e5c-5fbc9f9b5e99 req-b6f4457b-f59c-48d8-8f5f-f1fbb398e2dd service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Updated VIF entry in instance network info cache for port 08064378-9b0c-4b96-a818-6bbd4e31b553. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:19:06 user nova-compute[75080]: DEBUG nova.network.neutron [req-9e50de89-f052-4435-8e5c-5fbc9f9b5e99 req-b6f4457b-f59c-48d8-8f5f-f1fbb398e2dd service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Updating instance_info_cache with network_info: [{"id": "6fc199c0-dcfd-4c56-a910-37478f4c85bb", "address": "fa:16:3e:74:76:f4", "network": {"id": "a9446f1c-bd4f-47f6-a76d-8e479fe32437", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-273850890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fc199c0-dc", "ovs_interfaceid": "6fc199c0-dcfd-4c56-a910-37478f4c85bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ac602c3-db8c-42fd-a71f-1664e7a33d9a", "address": "fa:16:3e:4a:ae:17", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac602c3-db", "ovs_interfaceid": "4ac602c3-db8c-42fd-a71f-1664e7a33d9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "05511460-e0ce-4cd0-9d83-f61d776230e3", "address": "fa:16:3e:4c:56:ff", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05511460-e0", "ovs_interfaceid": "05511460-e0ce-4cd0-9d83-f61d776230e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b5f4ea2a-ca87-42b4-a7fe-0234b8567230", "address": "fa:16:3e:86:2e:34", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f4ea2a-ca", "ovs_interfaceid": "b5f4ea2a-ca87-42b4-a7fe-0234b8567230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08064378-9b0c-4b96-a818-6bbd4e31b553", "address": "fa:16:3e:58:dc:50", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08064378-9b", "ovs_interfaceid": "08064378-9b0c-4b96-a818-6bbd4e31b553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d89c793b-d55a-47b5-a857-bfb4b02d9781", "address": "fa:16:3e:38:ba:63", "network": {"id": "552adb39-e03e-4478-ac90-a3ca91fdce4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1038445196", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd89c793b-d5", "ovs_interfaceid": "d89c793b-d55a-47b5-a857-bfb4b02d9781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c", "address": "fa:16:3e:4a:8d:8f", "network": {"id": "552adb39-e03e-4478-ac90-a3ca91fdce4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1038445196", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac25d6a-4e", "ovs_interfaceid": "eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:19:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9e50de89-f052-4435-8e5c-5fbc9f9b5e99 req-b6f4457b-f59c-48d8-8f5f-f1fbb398e2dd service nova] Releasing lock "refresh_cache-912b0528-be16-427f-84fc-8a6cf89d5000" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:19:06 user nova-compute[75080]: DEBUG nova.compute.manager [req-9e50de89-f052-4435-8e5c-5fbc9f9b5e99 req-b6f4457b-f59c-48d8-8f5f-f1fbb398e2dd service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-changed-d89c793b-d55a-47b5-a857-bfb4b02d9781 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:19:06 user nova-compute[75080]: DEBUG nova.compute.manager [req-9e50de89-f052-4435-8e5c-5fbc9f9b5e99 req-b6f4457b-f59c-48d8-8f5f-f1fbb398e2dd service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Refreshing instance network info cache due to event network-changed-d89c793b-d55a-47b5-a857-bfb4b02d9781. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:19:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9e50de89-f052-4435-8e5c-5fbc9f9b5e99 req-b6f4457b-f59c-48d8-8f5f-f1fbb398e2dd service nova] Acquiring lock "refresh_cache-912b0528-be16-427f-84fc-8a6cf89d5000" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:19:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9e50de89-f052-4435-8e5c-5fbc9f9b5e99 req-b6f4457b-f59c-48d8-8f5f-f1fbb398e2dd service nova] Acquired lock "refresh_cache-912b0528-be16-427f-84fc-8a6cf89d5000" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:19:06 user nova-compute[75080]: DEBUG nova.network.neutron [req-9e50de89-f052-4435-8e5c-5fbc9f9b5e99 req-b6f4457b-f59c-48d8-8f5f-f1fbb398e2dd service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Refreshing network info cache for port d89c793b-d55a-47b5-a857-bfb4b02d9781 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:19:07 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Successfully updated port: a78e717e-684a-4255-b220-15faa1145a1e {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:19:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "refresh_cache-e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:19:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquired lock "refresh_cache-e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:19:07 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:19:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-43b63cc1-daf8-47ac-b34c-ea1b06a91bce req-c8460725-1141-4526-933b-a42e1798373a service nova] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Received event network-changed-a78e717e-684a-4255-b220-15faa1145a1e {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:19:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-43b63cc1-daf8-47ac-b34c-ea1b06a91bce req-c8460725-1141-4526-933b-a42e1798373a service nova] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Refreshing instance network info cache due to event network-changed-a78e717e-684a-4255-b220-15faa1145a1e. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:19:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-43b63cc1-daf8-47ac-b34c-ea1b06a91bce req-c8460725-1141-4526-933b-a42e1798373a service nova] Acquiring lock "refresh_cache-e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:19:07 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:19:07 user nova-compute[75080]: DEBUG nova.network.neutron [req-9e50de89-f052-4435-8e5c-5fbc9f9b5e99 req-b6f4457b-f59c-48d8-8f5f-f1fbb398e2dd service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Updated VIF entry in instance network info cache for port d89c793b-d55a-47b5-a857-bfb4b02d9781. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:19:07 user nova-compute[75080]: DEBUG nova.network.neutron [req-9e50de89-f052-4435-8e5c-5fbc9f9b5e99 req-b6f4457b-f59c-48d8-8f5f-f1fbb398e2dd service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Updating instance_info_cache with network_info: [{"id": "6fc199c0-dcfd-4c56-a910-37478f4c85bb", "address": "fa:16:3e:74:76:f4", "network": {"id": "a9446f1c-bd4f-47f6-a76d-8e479fe32437", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-273850890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fc199c0-dc", "ovs_interfaceid": "6fc199c0-dcfd-4c56-a910-37478f4c85bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ac602c3-db8c-42fd-a71f-1664e7a33d9a", "address": "fa:16:3e:4a:ae:17", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac602c3-db", "ovs_interfaceid": "4ac602c3-db8c-42fd-a71f-1664e7a33d9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "05511460-e0ce-4cd0-9d83-f61d776230e3", "address": "fa:16:3e:4c:56:ff", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05511460-e0", "ovs_interfaceid": "05511460-e0ce-4cd0-9d83-f61d776230e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b5f4ea2a-ca87-42b4-a7fe-0234b8567230", "address": "fa:16:3e:86:2e:34", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f4ea2a-ca", "ovs_interfaceid": "b5f4ea2a-ca87-42b4-a7fe-0234b8567230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08064378-9b0c-4b96-a818-6bbd4e31b553", "address": "fa:16:3e:58:dc:50", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08064378-9b", "ovs_interfaceid": "08064378-9b0c-4b96-a818-6bbd4e31b553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d89c793b-d55a-47b5-a857-bfb4b02d9781", "address": "fa:16:3e:38:ba:63", "network": {"id": "552adb39-e03e-4478-ac90-a3ca91fdce4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1038445196", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd89c793b-d5", "ovs_interfaceid": "d89c793b-d55a-47b5-a857-bfb4b02d9781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c", "address": "fa:16:3e:4a:8d:8f", "network": {"id": "552adb39-e03e-4478-ac90-a3ca91fdce4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1038445196", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac25d6a-4e", "ovs_interfaceid": "eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:19:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9e50de89-f052-4435-8e5c-5fbc9f9b5e99 req-b6f4457b-f59c-48d8-8f5f-f1fbb398e2dd service nova] Releasing lock "refresh_cache-912b0528-be16-427f-84fc-8a6cf89d5000" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:19:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-9e50de89-f052-4435-8e5c-5fbc9f9b5e99 req-b6f4457b-f59c-48d8-8f5f-f1fbb398e2dd service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-changed-eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:19:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-9e50de89-f052-4435-8e5c-5fbc9f9b5e99 req-b6f4457b-f59c-48d8-8f5f-f1fbb398e2dd service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Refreshing instance network info cache due to event network-changed-eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:19:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9e50de89-f052-4435-8e5c-5fbc9f9b5e99 req-b6f4457b-f59c-48d8-8f5f-f1fbb398e2dd service nova] Acquiring lock "refresh_cache-912b0528-be16-427f-84fc-8a6cf89d5000" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:19:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9e50de89-f052-4435-8e5c-5fbc9f9b5e99 req-b6f4457b-f59c-48d8-8f5f-f1fbb398e2dd service nova] Acquired lock "refresh_cache-912b0528-be16-427f-84fc-8a6cf89d5000" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:19:07 user nova-compute[75080]: DEBUG nova.network.neutron [req-9e50de89-f052-4435-8e5c-5fbc9f9b5e99 req-b6f4457b-f59c-48d8-8f5f-f1fbb398e2dd service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Refreshing network info cache for port eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:19:07 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Updating instance_info_cache with network_info: [{"id": "a78e717e-684a-4255-b220-15faa1145a1e", "address": "fa:16:3e:0d:b5:d5", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa78e717e-68", "ovs_interfaceid": "a78e717e-684a-4255-b220-15faa1145a1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:19:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Releasing lock "refresh_cache-e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:19:07 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Instance network_info: |[{"id": "a78e717e-684a-4255-b220-15faa1145a1e", "address": "fa:16:3e:0d:b5:d5", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa78e717e-68", "ovs_interfaceid": "a78e717e-684a-4255-b220-15faa1145a1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:19:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-43b63cc1-daf8-47ac-b34c-ea1b06a91bce req-c8460725-1141-4526-933b-a42e1798373a service nova] Acquired lock "refresh_cache-e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:19:07 user nova-compute[75080]: DEBUG nova.network.neutron [req-43b63cc1-daf8-47ac-b34c-ea1b06a91bce req-c8460725-1141-4526-933b-a42e1798373a service nova] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Refreshing network info cache for port a78e717e-684a-4255-b220-15faa1145a1e {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:19:07 user nova-compute[75080]: DEBUG nova.network.neutron [req-9e50de89-f052-4435-8e5c-5fbc9f9b5e99 req-b6f4457b-f59c-48d8-8f5f-f1fbb398e2dd service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Updated VIF entry in instance network info cache for port eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:19:07 user nova-compute[75080]: DEBUG nova.network.neutron [req-9e50de89-f052-4435-8e5c-5fbc9f9b5e99 req-b6f4457b-f59c-48d8-8f5f-f1fbb398e2dd service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Updating instance_info_cache with network_info: [{"id": "6fc199c0-dcfd-4c56-a910-37478f4c85bb", "address": "fa:16:3e:74:76:f4", "network": {"id": "a9446f1c-bd4f-47f6-a76d-8e479fe32437", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-273850890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fc199c0-dc", "ovs_interfaceid": "6fc199c0-dcfd-4c56-a910-37478f4c85bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ac602c3-db8c-42fd-a71f-1664e7a33d9a", "address": "fa:16:3e:4a:ae:17", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac602c3-db", "ovs_interfaceid": "4ac602c3-db8c-42fd-a71f-1664e7a33d9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "05511460-e0ce-4cd0-9d83-f61d776230e3", "address": "fa:16:3e:4c:56:ff", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05511460-e0", "ovs_interfaceid": "05511460-e0ce-4cd0-9d83-f61d776230e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b5f4ea2a-ca87-42b4-a7fe-0234b8567230", "address": "fa:16:3e:86:2e:34", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f4ea2a-ca", "ovs_interfaceid": "b5f4ea2a-ca87-42b4-a7fe-0234b8567230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08064378-9b0c-4b96-a818-6bbd4e31b553", "address": "fa:16:3e:58:dc:50", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08064378-9b", "ovs_interfaceid": "08064378-9b0c-4b96-a818-6bbd4e31b553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d89c793b-d55a-47b5-a857-bfb4b02d9781", "address": "fa:16:3e:38:ba:63", "network": {"id": "552adb39-e03e-4478-ac90-a3ca91fdce4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1038445196", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd89c793b-d5", "ovs_interfaceid": "d89c793b-d55a-47b5-a857-bfb4b02d9781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c", "address": "fa:16:3e:4a:8d:8f", "network": {"id": "552adb39-e03e-4478-ac90-a3ca91fdce4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1038445196", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac25d6a-4e", "ovs_interfaceid": "eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:19:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9e50de89-f052-4435-8e5c-5fbc9f9b5e99 req-b6f4457b-f59c-48d8-8f5f-f1fbb398e2dd service nova] Releasing lock "refresh_cache-912b0528-be16-427f-84fc-8a6cf89d5000" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:19:07 user nova-compute[75080]: DEBUG nova.network.neutron [req-43b63cc1-daf8-47ac-b34c-ea1b06a91bce req-c8460725-1141-4526-933b-a42e1798373a service nova] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Updated VIF entry in instance network info cache for port a78e717e-684a-4255-b220-15faa1145a1e. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:19:07 user nova-compute[75080]: DEBUG nova.network.neutron [req-43b63cc1-daf8-47ac-b34c-ea1b06a91bce req-c8460725-1141-4526-933b-a42e1798373a service nova] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Updating instance_info_cache with network_info: [{"id": "a78e717e-684a-4255-b220-15faa1145a1e", "address": "fa:16:3e:0d:b5:d5", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa78e717e-68", "ovs_interfaceid": "a78e717e-684a-4255-b220-15faa1145a1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:19:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-43b63cc1-daf8-47ac-b34c-ea1b06a91bce req-c8460725-1141-4526-933b-a42e1798373a service nova] Releasing lock "refresh_cache-e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:19:08 user nova-compute[75080]: INFO nova.virt.block_device [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Booting with volume b5c4e8fc-305e-4461-b96c-43cff51cf25f at /dev/vdb
Dec 05 15:19:08 user nova-compute[75080]: DEBUG os_brick.utils [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:19:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4022d0-0a6f-4253-b588-ed807b093fde]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b017054f-65e6-4c05-a594-fcb1e1ca5300]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f8c015-555d-4a58-8df2-796da5f71b7a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[20736541-18c6-42dc-b3dc-1efc4189b625]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:19:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:19:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:19:08 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:19:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f393ab-9300-47e6-868f-f7ee2b1eb35e]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:19:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:19:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:19:08 user nova-compute[75080]: DEBUG os_brick.utils [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:19:08 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Updating existing volume attachment record: 2d4ae6db-3783-4a00-bb9e-9d0e4103e68b {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:19:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:11 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:11 user nova-compute[75080]: DEBUG os_brick.utils [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:19:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:11 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12c75f9-a152-4fb4-bde3-5adba13fc1fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:11 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e3352b-d757-4914-94d1-a62f0be18511]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:11 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a988db-74a7-4d0d-969a-bedff731e19f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:11 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[443cbe48-2aa7-429b-a2b1-610fbef7fb2b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:19:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:19:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:19:11 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:19:11 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7201e0c-b672-4196-9185-38252c085311]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:19:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:19:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:19:11 user nova-compute[75080]: DEBUG os_brick.utils [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:19:11 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Updating existing volume attachment record: d1afa197-8099-43ce-9d5a-7cb6664e4750 {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:19:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:17 user nova-compute[75080]: INFO nova.virt.block_device [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Booting with volume 5b31e078-8572-43ca-8a7a-337916550058 at /dev/vdc
Dec 05 15:19:17 user nova-compute[75080]: DEBUG os_brick.utils [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:19:17 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:17 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:17 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[59274607-de7b-457f-a8bf-cf5258b62aef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:17 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:17 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:17 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[67952de8-996c-4fbf-a5bd-34d7261a69f9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:17 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:17 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:17 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf39e776-bfc7-4b18-86fd-2af513be103f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:17 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11578b3-5ac0-452a-ba06-344519791688]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:17 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:17 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:19:17 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:19:17 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:17 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:19:17 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:19:17 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d5dc3e-6db3-437c-9dc8-98a34b6f77b6]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:17 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:19:17 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:19:17 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:19:17 user nova-compute[75080]: DEBUG os_brick.utils [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:19:17 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Updating existing volume attachment record: ba823fee-9325-45dc-a011-ed2619a494ac {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:19:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:19 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:19:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Acquiring lock "31688583-6336-4e34-8df5-6947402c39ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Lock "31688583-6336-4e34-8df5-6947402c39ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:19 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:19:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:19 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:19:19 user nova-compute[75080]: INFO nova.compute.claims [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Claim successful on node user
Dec 05 15:19:20 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:19:20 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:19:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.586s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:19:20 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:19:20 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:19:20 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: 31688583-6336-4e34-8df5-6947402c39ef] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:19:20 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:19:20 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:19:20 user nova-compute[75080]: DEBUG nova.policy [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e06d18d33aaa442dba24fbd214a49f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e73fbf2c414f32bcdeef4bae598b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:19:20 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:19:20 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:19:20 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Creating image(s)
Dec 05 15:19:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Acquiring lock "/opt/stack/data/nova/instances/31688583-6336-4e34-8df5-6947402c39ef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Lock "/opt/stack/data/nova/instances/31688583-6336-4e34-8df5-6947402c39ef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Lock "/opt/stack/data/nova/instances/31688583-6336-4e34-8df5-6947402c39ef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.054s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:19:20 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:20 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.190s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:20 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:20 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.214s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:20 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/31688583-6336-4e34-8df5-6947402c39ef/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:20 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Successfully created port: 6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:19:20 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/31688583-6336-4e34-8df5-6947402c39ef/disk 1073741824" returned: 0 in 0.050s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:19:20 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.238s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Checking if we can resize image /opt/stack/data/nova/instances/31688583-6336-4e34-8df5-6947402c39ef/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31688583-6336-4e34-8df5-6947402c39ef/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31688583-6336-4e34-8df5-6947402c39ef/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Cannot resize image /opt/stack/data/nova/instances/31688583-6336-4e34-8df5-6947402c39ef/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Ensure instance console log exists: /opt/stack/data/nova/instances/31688583-6336-4e34-8df5-6947402c39ef/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Successfully updated port: 6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Acquiring lock "refresh_cache-31688583-6336-4e34-8df5-6947402c39ef" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Acquired lock "refresh_cache-31688583-6336-4e34-8df5-6947402c39ef" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG nova.compute.manager [req-aed1a001-53d1-4c58-96c6-36ef2f810fe9 req-dff65ee1-b086-4ff1-b867-8d96a6c5fc60 service nova] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Received event network-changed-6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG nova.compute.manager [req-aed1a001-53d1-4c58-96c6-36ef2f810fe9 req-dff65ee1-b086-4ff1-b867-8d96a6c5fc60 service nova] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Refreshing instance network info cache due to event network-changed-6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-aed1a001-53d1-4c58-96c6-36ef2f810fe9 req-dff65ee1-b086-4ff1-b867-8d96a6c5fc60 service nova] Acquiring lock "refresh_cache-31688583-6336-4e34-8df5-6947402c39ef" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:19:21 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Creating image(s)
Dec 05 15:19:21 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Did not create local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Ensure instance console log exists: /opt/stack/data/nova/instances/e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Start _get_guest_xml network_info=[{"id": "a78e717e-684a-4255-b220-15faa1145a1e", "address": "fa:16:3e:0d:b5:d5", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa78e717e-68", "ovs_interfaceid": "a78e717e-684a-4255-b220-15faa1145a1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbzCFnNm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40', 'attached_at': '', 'detached_at': '', 'volume_id': '7e285c4b-6267-4c48-9b43-f344783b2d6a', 'serial': '7e285c4b-6267-4c48-9b43-f344783b2d6a'}, 'device_type': 'disk', 'attachment_id': 'd1afa197-8099-43ce-9d5a-7cb6664e4750', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:19:21 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:19:21 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:19:21 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG os_brick.initiator.connector [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Factory for ISCSI on None {{(pid=75080) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbzCFnNm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:19:21 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:19:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:19:21 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:19:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:19:21 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:19:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c29548f-c393-411c-974e-b051b70aeba8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:19:21 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc63aabd-9d02-4447-893b-959b6fede20b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a] added
Dec 05 15:19:21 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fdcacd-d6bd-428a-afd6-2f3f52b339e9]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb735f0-eef6-4ce9-a773-6e29439c811e]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AbzCFnNm {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AbzCFnNm" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7a4489-f392-483b-a587-10dce3846edd]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AbzCFnNm'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Updating instance_info_cache with network_info: [{"id": "6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b", "address": "fa:16:3e:bb:85:d6", "network": {"id": "05b09885-a021-44b4-b8d6-1504a4c2dfeb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1903039338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e73fbf2c414f32bcdeef4bae598b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d3a7f08-5f", "ovs_interfaceid": "6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3402c3-d036-4443-b75d-6f6de6dfb1d8]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Releasing lock "refresh_cache-31688583-6336-4e34-8df5-6947402c39ef" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Instance network_info: |[{"id": "6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b", "address": "fa:16:3e:bb:85:d6", "network": {"id": "05b09885-a021-44b4-b8d6-1504a4c2dfeb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1903039338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e73fbf2c414f32bcdeef4bae598b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d3a7f08-5f", "ovs_interfaceid": "6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-aed1a001-53d1-4c58-96c6-36ef2f810fe9 req-dff65ee1-b086-4ff1-b867-8d96a6c5fc60 service nova] Acquired lock "refresh_cache-31688583-6336-4e34-8df5-6947402c39ef" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG nova.network.neutron [req-aed1a001-53d1-4c58-96c6-36ef2f810fe9 req-dff65ee1-b086-4ff1-b867-8d96a6c5fc60 service nova] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Refreshing network info cache for port 6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Start _get_guest_xml network_info=[{"id": "6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b", "address": "fa:16:3e:bb:85:d6", "network": {"id": "05b09885-a021-44b4-b8d6-1504a4c2dfeb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1903039338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e73fbf2c414f32bcdeef4bae598b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d3a7f08-5f", "ovs_interfaceid": "6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9eb576f-a09c-4b7c-8ada-c1f85727a0b1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 05 15:19:21 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:19:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 05 15:19:21 user nova-compute[75080]:  {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:19:21 user nova-compute[75080]: WARNING os_brick.initiator.connectors.iscsi [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 05 15:19:21 user nova-compute[75080]: 
Dec 05 15:19:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:22 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:19:22 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:19:22 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:19:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1021807627',display_name='tempest-ServersNegativeTestJSON-server-1021807627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1021807627',id=12,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48e73fbf2c414f32bcdeef4bae598b2f',ramdisk_id='',reservation_id='r-px5xgc0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-32084328',owner_user_name='tempest-ServersNegativeTestJSON-32084328-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:19:20Z,user_data=None,user_id='e06d18d33aaa442dba24fbd214a49f9d',uuid=31688583-6336-4e34-8df5-6947402c39ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b", "address": "fa:16:3e:bb:85:d6", "network": {"id": "05b09885-a021-44b4-b8d6-1504a4c2dfeb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1903039338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e73fbf2c414f32bcdeef4bae598b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d3a7f08-5f", "ovs_interfaceid": "6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Converting VIF {"id": "6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b", "address": "fa:16:3e:bb:85:d6", "network": {"id": "05b09885-a021-44b4-b8d6-1504a4c2dfeb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1903039338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e73fbf2c414f32bcdeef4bae598b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d3a7f08-5f", "ovs_interfaceid": "6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:85:d6,bridge_name='br-int',has_traffic_filtering=True,id=6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b,network=Network(05b09885-a021-44b4-b8d6-1504a4c2dfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d3a7f08-5f') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG nova.objects.instance [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Lazy-loading 'pci_devices' on Instance uuid 31688583-6336-4e34-8df5-6947402c39ef {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f4696d-7474-441e-8d6c-9fc9f515d2c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a, portal: 172.16.0.220,3260]
Dec 05 15:19:22 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a, portal: 172.16.0.220,3260] successful.
Dec 05 15:19:22 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: 31688583-6336-4e34-8df5-6947402c39ef] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:19:22 user nova-compute[75080]:   <uuid>31688583-6336-4e34-8df5-6947402c39ef</uuid>
Dec 05 15:19:22 user nova-compute[75080]:   <name>instance-0000000c</name>
Dec 05 15:19:22 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:19:22 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:19:22 user nova-compute[75080]:   <metadata>
Dec 05 15:19:22 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:19:22 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:19:22 user nova-compute[75080]:       <nova:name>tempest-ServersNegativeTestJSON-server-1021807627</nova:name>
Dec 05 15:19:22 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:19:22</nova:creationTime>
Dec 05 15:19:22 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:19:22 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:19:22 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:19:22 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:19:22 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:19:22 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:19:22 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:19:22 user nova-compute[75080]:       <nova:owner>
Dec 05 15:19:22 user nova-compute[75080]:         <nova:user uuid="e06d18d33aaa442dba24fbd214a49f9d">tempest-ServersNegativeTestJSON-32084328-project-member</nova:user>
Dec 05 15:19:22 user nova-compute[75080]:         <nova:project uuid="48e73fbf2c414f32bcdeef4bae598b2f">tempest-ServersNegativeTestJSON-32084328</nova:project>
Dec 05 15:19:22 user nova-compute[75080]:       </nova:owner>
Dec 05 15:19:22 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:19:22 user nova-compute[75080]:       <nova:ports>
Dec 05 15:19:22 user nova-compute[75080]:         <nova:port uuid="6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b">
Dec 05 15:19:22 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 05 15:19:22 user nova-compute[75080]:         </nova:port>
Dec 05 15:19:22 user nova-compute[75080]:       </nova:ports>
Dec 05 15:19:22 user nova-compute[75080]:     </nova:instance>
Dec 05 15:19:22 user nova-compute[75080]:   </metadata>
Dec 05 15:19:22 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:19:22 user nova-compute[75080]:     <system>
Dec 05 15:19:22 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:19:22 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:19:22 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:19:22 user nova-compute[75080]:       <entry name="serial">31688583-6336-4e34-8df5-6947402c39ef</entry>
Dec 05 15:19:22 user nova-compute[75080]:       <entry name="uuid">31688583-6336-4e34-8df5-6947402c39ef</entry>
Dec 05 15:19:22 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:19:22 user nova-compute[75080]:     </system>
Dec 05 15:19:22 user nova-compute[75080]:   </sysinfo>
Dec 05 15:19:22 user nova-compute[75080]:   <os>
Dec 05 15:19:22 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:19:22 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:19:22 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:19:22 user nova-compute[75080]:   </os>
Dec 05 15:19:22 user nova-compute[75080]:   <features>
Dec 05 15:19:22 user nova-compute[75080]:     <acpi/>
Dec 05 15:19:22 user nova-compute[75080]:     <apic/>
Dec 05 15:19:22 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:19:22 user nova-compute[75080]:   </features>
Dec 05 15:19:22 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:19:22 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:19:22 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:19:22 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:19:22 user nova-compute[75080]:   </clock>
Dec 05 15:19:22 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:19:22 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:19:22 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:19:22 user nova-compute[75080]:   </cpu>
Dec 05 15:19:22 user nova-compute[75080]:   <devices>
Dec 05 15:19:22 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:19:22 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:19:22 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/31688583-6336-4e34-8df5-6947402c39ef/disk"/>
Dec 05 15:19:22 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:19:22 user nova-compute[75080]:     </disk>
Dec 05 15:19:22 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:19:22 user nova-compute[75080]:       <mac address="fa:16:3e:bb:85:d6"/>
Dec 05 15:19:22 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:19:22 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:19:22 user nova-compute[75080]:       <target dev="tap6d3a7f08-5f"/>
Dec 05 15:19:22 user nova-compute[75080]:     </interface>
Dec 05 15:19:22 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:19:22 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/31688583-6336-4e34-8df5-6947402c39ef/console.log" append="off"/>
Dec 05 15:19:22 user nova-compute[75080]:     </serial>
Dec 05 15:19:22 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:19:22 user nova-compute[75080]:     <video>
Dec 05 15:19:22 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:19:22 user nova-compute[75080]:     </video>
Dec 05 15:19:22 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:19:22 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:19:22 user nova-compute[75080]:     </rng>
Dec 05 15:19:22 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:19:22 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:19:22 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:19:22 user nova-compute[75080]:     </memballoon>
Dec 05 15:19:22 user nova-compute[75080]:   </devices>
Dec 05 15:19:22 user nova-compute[75080]: </domain>
Dec 05 15:19:22 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:19:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1021807627',display_name='tempest-ServersNegativeTestJSON-server-1021807627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1021807627',id=12,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48e73fbf2c414f32bcdeef4bae598b2f',ramdisk_id='',reservation_id='r-px5xgc0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-32084328',owner_user_name='tempest-ServersNegativeTestJSON-32084328-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:19:20Z,user_data=None,user_id='e06d18d33aaa442dba24fbd214a49f9d',uuid=31688583-6336-4e34-8df5-6947402c39ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b", "address": "fa:16:3e:bb:85:d6", "network": {"id": "05b09885-a021-44b4-b8d6-1504a4c2dfeb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1903039338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e73fbf2c414f32bcdeef4bae598b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d3a7f08-5f", "ovs_interfaceid": "6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Converting VIF {"id": "6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b", "address": "fa:16:3e:bb:85:d6", "network": {"id": "05b09885-a021-44b4-b8d6-1504a4c2dfeb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1903039338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e73fbf2c414f32bcdeef4bae598b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d3a7f08-5f", "ovs_interfaceid": "6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:85:d6,bridge_name='br-int',has_traffic_filtering=True,id=6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b,network=Network(05b09885-a021-44b4-b8d6-1504a4c2dfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d3a7f08-5f') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG os_vif [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:85:d6,bridge_name='br-int',has_traffic_filtering=True,id=6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b,network=Network(05b09885-a021-44b4-b8d6-1504a4c2dfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d3a7f08-5f') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea51d23e-ba7a-4add-ac73-94a0e67206c1]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '06c1ac33-5dbb-5d4d-88ae-97523fe058f2', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d3a7f08-5f, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6d3a7f08-5f, col_values=(('qos', UUID('6188aeb6-606d-4c1a-ae13-cc4d6392d235')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6d3a7f08-5f, col_values=(('external_ids', {'iface-id': '6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:85:d6', 'vm-uuid': '31688583-6336-4e34-8df5-6947402c39ef'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b789d14-1c0b-4ba6-be4b-fdca3d749c5a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:19:22 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:19:22 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:22 user nova-compute[75080]: INFO os_vif [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:85:d6,bridge_name='br-int',has_traffic_filtering=True,id=6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b,network=Network(05b09885-a021-44b4-b8d6-1504a4c2dfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d3a7f08-5f')
Dec 05 15:19:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8b1547-cbbd-4cc2-9646-bb68060fabd3]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbzCFnNm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] No VIF found with MAC fa:16:3e:bb:85:d6, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG nova.network.neutron [req-aed1a001-53d1-4c58-96c6-36ef2f810fe9 req-dff65ee1-b086-4ff1-b867-8d96a6c5fc60 service nova] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Updated VIF entry in instance network info cache for port 6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG nova.network.neutron [req-aed1a001-53d1-4c58-96c6-36ef2f810fe9 req-dff65ee1-b086-4ff1-b867-8d96a6c5fc60 service nova] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Updating instance_info_cache with network_info: [{"id": "6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b", "address": "fa:16:3e:bb:85:d6", "network": {"id": "05b09885-a021-44b4-b8d6-1504a4c2dfeb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1903039338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e73fbf2c414f32bcdeef4bae598b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d3a7f08-5f", "ovs_interfaceid": "6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-aed1a001-53d1-4c58-96c6-36ef2f810fe9 req-dff65ee1-b086-4ff1-b867-8d96a6c5fc60 service nova] Releasing lock "refresh_cache-31688583-6336-4e34-8df5-6947402c39ef" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-eedd1529-4feb-4f85-8625-0c20d8e0359d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-eedd1529-4feb-4f85-8625-0c20d8e0359d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Updating instance_info_cache with network_info: [{"id": "f0094ba7-45c2-445b-bd35-d5c7aedd68bd", "address": "fa:16:3e:f9:84:93", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0094ba7-45", "ovs_interfaceid": "f0094ba7-45c2-445b-bd35-d5c7aedd68bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-eedd1529-4feb-4f85-8625-0c20d8e0359d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:19:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26261303634656435', 'path': '/dev/sdb'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261303634656435', 'path': '/dev/sdb'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:19:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1823276450',display_name='tempest-TestVolumeBootPattern-server-1823276450',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1823276450',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11227acd507347ae9c5a3bc710707f84',ramdisk_id='',reservation_id='r-yootenq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-23416231',owner_user_name='tempest-TestVolumeBootPattern-23416231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:19:06Z,user_data=None,user_id='15be5b54cc8346bb86683e4ed2fbba9e',uuid=e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a78e717e-684a-4255-b220-15faa1145a1e", "address": "fa:16:3e:0d:b5:d5", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa78e717e-68", "ovs_interfaceid": "a78e717e-684a-4255-b220-15faa1145a1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Converting VIF {"id": "a78e717e-684a-4255-b220-15faa1145a1e", "address": "fa:16:3e:0d:b5:d5", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa78e717e-68", "ovs_interfaceid": "a78e717e-684a-4255-b220-15faa1145a1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:b5:d5,bridge_name='br-int',has_traffic_filtering=True,id=a78e717e-684a-4255-b220-15faa1145a1e,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa78e717e-68') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG nova.objects.instance [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lazy-loading 'pci_devices' on Instance uuid e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:19:23 user nova-compute[75080]:   <uuid>e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40</uuid>
Dec 05 15:19:23 user nova-compute[75080]:   <name>instance-0000000b</name>
Dec 05 15:19:23 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:19:23 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:19:23 user nova-compute[75080]:   <metadata>
Dec 05 15:19:23 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:19:23 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:19:23 user nova-compute[75080]:       <nova:name>tempest-TestVolumeBootPattern-server-1823276450</nova:name>
Dec 05 15:19:23 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:19:21</nova:creationTime>
Dec 05 15:19:23 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:19:23 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:19:23 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:19:23 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:19:23 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:19:23 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:19:23 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:19:23 user nova-compute[75080]:       <nova:owner>
Dec 05 15:19:23 user nova-compute[75080]:         <nova:user uuid="15be5b54cc8346bb86683e4ed2fbba9e">tempest-TestVolumeBootPattern-23416231-project-member</nova:user>
Dec 05 15:19:23 user nova-compute[75080]:         <nova:project uuid="11227acd507347ae9c5a3bc710707f84">tempest-TestVolumeBootPattern-23416231</nova:project>
Dec 05 15:19:23 user nova-compute[75080]:       </nova:owner>
Dec 05 15:19:23 user nova-compute[75080]:       <nova:ports>
Dec 05 15:19:23 user nova-compute[75080]:         <nova:port uuid="a78e717e-684a-4255-b220-15faa1145a1e">
Dec 05 15:19:23 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 05 15:19:23 user nova-compute[75080]:         </nova:port>
Dec 05 15:19:23 user nova-compute[75080]:       </nova:ports>
Dec 05 15:19:23 user nova-compute[75080]:     </nova:instance>
Dec 05 15:19:23 user nova-compute[75080]:   </metadata>
Dec 05 15:19:23 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:19:23 user nova-compute[75080]:     <system>
Dec 05 15:19:23 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:19:23 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:19:23 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:19:23 user nova-compute[75080]:       <entry name="serial">e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40</entry>
Dec 05 15:19:23 user nova-compute[75080]:       <entry name="uuid">e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40</entry>
Dec 05 15:19:23 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:19:23 user nova-compute[75080]:     </system>
Dec 05 15:19:23 user nova-compute[75080]:   </sysinfo>
Dec 05 15:19:23 user nova-compute[75080]:   <os>
Dec 05 15:19:23 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:19:23 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:19:23 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:19:23 user nova-compute[75080]:   </os>
Dec 05 15:19:23 user nova-compute[75080]:   <features>
Dec 05 15:19:23 user nova-compute[75080]:     <acpi/>
Dec 05 15:19:23 user nova-compute[75080]:     <apic/>
Dec 05 15:19:23 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:19:23 user nova-compute[75080]:   </features>
Dec 05 15:19:23 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:19:23 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:19:23 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:19:23 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:19:23 user nova-compute[75080]:   </clock>
Dec 05 15:19:23 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:19:23 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:19:23 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:19:23 user nova-compute[75080]:   </cpu>
Dec 05 15:19:23 user nova-compute[75080]:   <devices>
Dec 05 15:19:23 user nova-compute[75080]:     <disk type="block" device="disk">
Dec 05 15:19:23 user nova-compute[75080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:19:23 user nova-compute[75080]:       <source dev="/dev/sdb"/>
Dec 05 15:19:23 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:19:23 user nova-compute[75080]:       <serial>7e285c4b-6267-4c48-9b43-f344783b2d6a</serial>
Dec 05 15:19:23 user nova-compute[75080]:     </disk>
Dec 05 15:19:23 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:19:23 user nova-compute[75080]:       <mac address="fa:16:3e:0d:b5:d5"/>
Dec 05 15:19:23 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:19:23 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:19:23 user nova-compute[75080]:       <target dev="tapa78e717e-68"/>
Dec 05 15:19:23 user nova-compute[75080]:     </interface>
Dec 05 15:19:23 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:19:23 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40/console.log" append="off"/>
Dec 05 15:19:23 user nova-compute[75080]:     </serial>
Dec 05 15:19:23 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:19:23 user nova-compute[75080]:     <video>
Dec 05 15:19:23 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:19:23 user nova-compute[75080]:     </video>
Dec 05 15:19:23 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:19:23 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:19:23 user nova-compute[75080]:     </rng>
Dec 05 15:19:23 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:19:23 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:19:23 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:19:23 user nova-compute[75080]:     </memballoon>
Dec 05 15:19:23 user nova-compute[75080]:   </devices>
Dec 05 15:19:23 user nova-compute[75080]: </domain>
Dec 05 15:19:23 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:19:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1823276450',display_name='tempest-TestVolumeBootPattern-server-1823276450',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1823276450',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11227acd507347ae9c5a3bc710707f84',ramdisk_id='',reservation_id='r-yootenq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-23416231',owner_user_name='tempest-TestVolumeBootPattern-23416231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:19:06Z,user_data=None,user_id='15be5b54cc8346bb86683e4ed2fbba9e',uuid=e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a78e717e-684a-4255-b220-15faa1145a1e", "address": "fa:16:3e:0d:b5:d5", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa78e717e-68", "ovs_interfaceid": "a78e717e-684a-4255-b220-15faa1145a1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Converting VIF {"id": "a78e717e-684a-4255-b220-15faa1145a1e", "address": "fa:16:3e:0d:b5:d5", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa78e717e-68", "ovs_interfaceid": "a78e717e-684a-4255-b220-15faa1145a1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:b5:d5,bridge_name='br-int',has_traffic_filtering=True,id=a78e717e-684a-4255-b220-15faa1145a1e,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa78e717e-68') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG os_vif [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:b5:d5,bridge_name='br-int',has_traffic_filtering=True,id=a78e717e-684a-4255-b220-15faa1145a1e,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa78e717e-68') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea53e7d2-9f48-5743-a0b5-a85650dc2777', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa78e717e-68, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa78e717e-68, col_values=(('qos', UUID('9e6a6b3a-36e3-47a3-8ba1-17e101d00783')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa78e717e-68, col_values=(('external_ids', {'iface-id': 'a78e717e-684a-4255-b220-15faa1145a1e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:b5:d5', 'vm-uuid': 'e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:23 user nova-compute[75080]: INFO os_vif [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:b5:d5,bridge_name='br-int',has_traffic_filtering=True,id=a78e717e-684a-4255-b220-15faa1145a1e,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa78e717e-68')
Dec 05 15:19:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] No VIF found with MAC fa:16:3e:0d:b5:d5, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG nova.compute.manager [req-9da62143-9832-4a51-a0fd-38c52fde7eff req-503ba5e7-5dbe-4ac9-bd4d-17a924f23269 service nova] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Received event network-vif-plugged-6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9da62143-9832-4a51-a0fd-38c52fde7eff req-503ba5e7-5dbe-4ac9-bd4d-17a924f23269 service nova] Acquiring lock "31688583-6336-4e34-8df5-6947402c39ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9da62143-9832-4a51-a0fd-38c52fde7eff req-503ba5e7-5dbe-4ac9-bd4d-17a924f23269 service nova] Lock "31688583-6336-4e34-8df5-6947402c39ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9da62143-9832-4a51-a0fd-38c52fde7eff req-503ba5e7-5dbe-4ac9-bd4d-17a924f23269 service nova] Lock "31688583-6336-4e34-8df5-6947402c39ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:19:23 user nova-compute[75080]: DEBUG nova.compute.manager [req-9da62143-9832-4a51-a0fd-38c52fde7eff req-503ba5e7-5dbe-4ac9-bd4d-17a924f23269 service nova] [instance: 31688583-6336-4e34-8df5-6947402c39ef] No waiting events found dispatching network-vif-plugged-6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:19:23 user nova-compute[75080]: WARNING nova.compute.manager [req-9da62143-9832-4a51-a0fd-38c52fde7eff req-503ba5e7-5dbe-4ac9-bd4d-17a924f23269 service nova] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Received unexpected event network-vif-plugged-6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b for instance with vm_state building and task_state spawning.
Dec 05 15:19:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:25 user nova-compute[75080]: DEBUG nova.compute.manager [req-3c7aefb8-1791-4d13-93bc-a98d509572ae req-a1a7f498-98ff-4b70-b136-3e50f0ba8291 service nova] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Received event network-vif-plugged-a78e717e-684a-4255-b220-15faa1145a1e {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:19:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-3c7aefb8-1791-4d13-93bc-a98d509572ae req-a1a7f498-98ff-4b70-b136-3e50f0ba8291 service nova] Acquiring lock "e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-3c7aefb8-1791-4d13-93bc-a98d509572ae req-a1a7f498-98ff-4b70-b136-3e50f0ba8291 service nova] Lock "e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-3c7aefb8-1791-4d13-93bc-a98d509572ae req-a1a7f498-98ff-4b70-b136-3e50f0ba8291 service nova] Lock "e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:19:25 user nova-compute[75080]: DEBUG nova.compute.manager [req-3c7aefb8-1791-4d13-93bc-a98d509572ae req-a1a7f498-98ff-4b70-b136-3e50f0ba8291 service nova] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] No waiting events found dispatching network-vif-plugged-a78e717e-684a-4255-b220-15faa1145a1e {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:19:25 user nova-compute[75080]: WARNING nova.compute.manager [req-3c7aefb8-1791-4d13-93bc-a98d509572ae req-a1a7f498-98ff-4b70-b136-3e50f0ba8291 service nova] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Received unexpected event network-vif-plugged-a78e717e-684a-4255-b220-15faa1145a1e for instance with vm_state building and task_state spawning.
Dec 05 15:19:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:25 user nova-compute[75080]: DEBUG nova.compute.manager [req-9205853e-96f2-416d-84f6-80a0068cfd24 req-c33d2b6d-ae69-4819-8980-1312ace94eda service nova] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Received event network-vif-plugged-6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:19:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9205853e-96f2-416d-84f6-80a0068cfd24 req-c33d2b6d-ae69-4819-8980-1312ace94eda service nova] Acquiring lock "31688583-6336-4e34-8df5-6947402c39ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9205853e-96f2-416d-84f6-80a0068cfd24 req-c33d2b6d-ae69-4819-8980-1312ace94eda service nova] Lock "31688583-6336-4e34-8df5-6947402c39ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9205853e-96f2-416d-84f6-80a0068cfd24 req-c33d2b6d-ae69-4819-8980-1312ace94eda service nova] Lock "31688583-6336-4e34-8df5-6947402c39ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:19:25 user nova-compute[75080]: DEBUG nova.compute.manager [req-9205853e-96f2-416d-84f6-80a0068cfd24 req-c33d2b6d-ae69-4819-8980-1312ace94eda service nova] [instance: 31688583-6336-4e34-8df5-6947402c39ef] No waiting events found dispatching network-vif-plugged-6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:19:25 user nova-compute[75080]: WARNING nova.compute.manager [req-9205853e-96f2-416d-84f6-80a0068cfd24 req-c33d2b6d-ae69-4819-8980-1312ace94eda service nova] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Received unexpected event network-vif-plugged-6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b for instance with vm_state building and task_state spawning.
Dec 05 15:19:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:27 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:19:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:19:27 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Instance spawned successfully.
Dec 05 15:19:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:19:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:19:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:19:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:19:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:19:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:19:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:19:27 user nova-compute[75080]: INFO nova.compute.manager [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Took 6.78 seconds to spawn the instance on the hypervisor.
Dec 05 15:19:27 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:19:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:27 user nova-compute[75080]: INFO nova.compute.manager [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Took 7.72 seconds to build instance.
Dec 05 15:19:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e0711e8f-84f5-49e2-903d-f038a524c57e tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Lock "31688583-6336-4e34-8df5-6947402c39ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.833s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:19:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:27 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:19:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:19:27 user nova-compute[75080]: DEBUG nova.compute.manager [req-48ea37ae-b099-40fe-8b33-828b81a78fa8 req-c8a7eee7-c09b-411a-99b0-ac186eb2c9d3 service nova] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Received event network-vif-plugged-a78e717e-684a-4255-b220-15faa1145a1e {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:19:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-48ea37ae-b099-40fe-8b33-828b81a78fa8 req-c8a7eee7-c09b-411a-99b0-ac186eb2c9d3 service nova] Acquiring lock "e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-48ea37ae-b099-40fe-8b33-828b81a78fa8 req-c8a7eee7-c09b-411a-99b0-ac186eb2c9d3 service nova] Lock "e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-48ea37ae-b099-40fe-8b33-828b81a78fa8 req-c8a7eee7-c09b-411a-99b0-ac186eb2c9d3 service nova] Lock "e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:19:27 user nova-compute[75080]: DEBUG nova.compute.manager [req-48ea37ae-b099-40fe-8b33-828b81a78fa8 req-c8a7eee7-c09b-411a-99b0-ac186eb2c9d3 service nova] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] No waiting events found dispatching network-vif-plugged-a78e717e-684a-4255-b220-15faa1145a1e {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:19:27 user nova-compute[75080]: WARNING nova.compute.manager [req-48ea37ae-b099-40fe-8b33-828b81a78fa8 req-c8a7eee7-c09b-411a-99b0-ac186eb2c9d3 service nova] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Received unexpected event network-vif-plugged-a78e717e-684a-4255-b220-15faa1145a1e for instance with vm_state building and task_state spawning.
Dec 05 15:19:27 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Instance spawned successfully.
Dec 05 15:19:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:19:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:19:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:19:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:19:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:19:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:19:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:19:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33078a88-4858-4c6b-bfa9-c3d9b83cf78b/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:27 user nova-compute[75080]: INFO nova.compute.manager [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Took 6.00 seconds to spawn the instance on the hypervisor.
Dec 05 15:19:27 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:19:27 user nova-compute[75080]: INFO nova.compute.manager [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Took 23.00 seconds to build instance.
Dec 05 15:19:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e7ccf875-f0a6-4454-a302-3e9d7e999ab9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.148s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:19:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33078a88-4858-4c6b-bfa9-c3d9b83cf78b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33078a88-4858-4c6b-bfa9-c3d9b83cf78b/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33078a88-4858-4c6b-bfa9-c3d9b83cf78b/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG nova.compute.manager [req-123967eb-08d2-4205-b186-d901b16cc4a0 req-44d231ad-9ffa-48be-b05a-cea4a8e80054 service nova] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Received event network-changed-f0094ba7-45c2-445b-bd35-d5c7aedd68bd {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG nova.compute.manager [req-123967eb-08d2-4205-b186-d901b16cc4a0 req-44d231ad-9ffa-48be-b05a-cea4a8e80054 service nova] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Refreshing instance network info cache due to event network-changed-f0094ba7-45c2-445b-bd35-d5c7aedd68bd. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-123967eb-08d2-4205-b186-d901b16cc4a0 req-44d231ad-9ffa-48be-b05a-cea4a8e80054 service nova] Acquiring lock "refresh_cache-eedd1529-4feb-4f85-8625-0c20d8e0359d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-123967eb-08d2-4205-b186-d901b16cc4a0 req-44d231ad-9ffa-48be-b05a-cea4a8e80054 service nova] Acquired lock "refresh_cache-eedd1529-4feb-4f85-8625-0c20d8e0359d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG nova.network.neutron [req-123967eb-08d2-4205-b186-d901b16cc4a0 req-44d231ad-9ffa-48be-b05a-cea4a8e80054 service nova] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Refreshing network info cache for port f0094ba7-45c2-445b-bd35-d5c7aedd68bd {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG nova.compute.manager [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:19:28 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Creating image(s)
Dec 05 15:19:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Did not create local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Ensure instance console log exists: /opt/stack/data/nova/instances/912b0528-be16-427f-84fc-8a6cf89d5000/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Start _get_guest_xml network_info=[{"id": "6fc199c0-dcfd-4c56-a910-37478f4c85bb", "address": "fa:16:3e:74:76:f4", "network": {"id": "a9446f1c-bd4f-47f6-a76d-8e479fe32437", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-273850890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fc199c0-dc", "ovs_interfaceid": "6fc199c0-dcfd-4c56-a910-37478f4c85bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ac602c3-db8c-42fd-a71f-1664e7a33d9a", "address": "fa:16:3e:4a:ae:17", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac602c3-db", "ovs_interfaceid": "4ac602c3-db8c-42fd-a71f-1664e7a33d9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "05511460-e0ce-4cd0-9d83-f61d776230e3", "address": "fa:16:3e:4c:56:ff", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05511460-e0", "ovs_interfaceid": "05511460-e0ce-4cd0-9d83-f61d776230e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b5f4ea2a-ca87-42b4-a7fe-0234b8567230", "address": "fa:16:3e:86:2e:34", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f4ea2a-ca", "ovs_interfaceid": "b5f4ea2a-ca87-42b4-a7fe-0234b8567230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08064378-9b0c-4b96-a818-6bbd4e31b553", "address": "fa:16:3e:58:dc:50", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08064378-9b", "ovs_interfaceid": "08064378-9b0c-4b96-a818-6bbd4e31b553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d89c793b-d55a-47b5-a857-bfb4b02d9781", "address": "fa:16:3e:38:ba:63", "network": {"id": "552adb39-e03e-4478-ac90-a3ca91fdce4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1038445196", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd89c793b-d5", "ovs_interfaceid": "d89c793b-d55a-47b5-a857-bfb4b02d9781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c", "address": "fa:16:3e:4a:8d:8f", "network": {"id": "552adb39-e03e-4478-ac90-a3ca91fdce4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1038445196", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac25d6a-4e", "ovs_interfaceid": "eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FAgGrBRk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '912b0528-be16-427f-84fc-8a6cf89d5000', 'attached_at': '', 'detached_at': '', 'volume_id': '7dcf2180-a9e8-4068-825b-1d71c9ec54ed', 'serial': '7dcf2180-a9e8-4068-825b-1d71c9ec54ed'}, 'device_type': 'disk', 'attachment_id': '0ac8ff63-f15e-43fd-9359-e7c727743779', 'disk_bus': 'virtio', 'volume_type': None}, {'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': 1, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZGIkRYsx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '912b0528-be16-427f-84fc-8a6cf89d5000', 'attached_at': '', 'detached_at': '', 'volume_id': 'b5c4e8fc-305e-4461-b96c-43cff51cf25f', 'serial': 'b5c4e8fc-305e-4461-b96c-43cff51cf25f'}, 'device_type': 'disk', 'attachment_id': '2d4ae6db-3783-4a00-bb9e-9d0e4103e68b', 'disk_bus': 'virtio', 'volume_type': None}, {'mount_device': '/dev/vdc', 'guest_format': None, 'boot_index': 2, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pUAzRPOI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '912b0528-be16-427f-84fc-8a6cf89d5000', 'attached_at': '', 'detached_at': '', 'volume_id': '5b31e078-8572-43ca-8a7a-337916550058', 'serial': '5b31e078-8572-43ca-8a7a-337916550058'}, 'device_type': 'disk', 'attachment_id': 'ba823fee-9325-45dc-a011-ed2619a494ac', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:19:28 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:19:28 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:19:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FAgGrBRk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:19:28 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:19:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:19:28 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:19:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:19:28 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f39698-ff65-4dfb-8a6a-76b250e618e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:19:28 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e61436-d8c7-4404-9a07-d41e0d9e6c03]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed] added
Dec 05 15:19:28 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0b832d-adff-42c5-ac36-acee242d56b0]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d087974-c29e-4674-a3c9-8e1fcc204005]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FAgGrBRk {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FAgGrBRk" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff16402-f8bd-473f-a61b-71254de0616e]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FAgGrBRk'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6e9f11-291c-4ad3-b561-6ea1ef7452b5]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57d741b-032a-4720-b056-7c0d254434eb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:19:28 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:19:28 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09a6833-0a9d-48f8-a615-38211d2d2bc8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed, portal: 172.16.0.220,3260]
Dec 05 15:19:28 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed, portal: 172.16.0.220,3260] successful.
Dec 05 15:19:28 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG nova.network.neutron [req-123967eb-08d2-4205-b186-d901b16cc4a0 req-44d231ad-9ffa-48be-b05a-cea4a8e80054 service nova] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Updated VIF entry in instance network info cache for port f0094ba7-45c2-445b-bd35-d5c7aedd68bd. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG nova.network.neutron [req-123967eb-08d2-4205-b186-d901b16cc4a0 req-44d231ad-9ffa-48be-b05a-cea4a8e80054 service nova] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Updating instance_info_cache with network_info: [{"id": "f0094ba7-45c2-445b-bd35-d5c7aedd68bd", "address": "fa:16:3e:f9:84:93", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0094ba7-45", "ovs_interfaceid": "f0094ba7-45c2-445b-bd35-d5c7aedd68bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07b8db6-5795-4ce1-a5dd-863fc14ece4c]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-123967eb-08d2-4205-b186-d901b16cc4a0 req-44d231ad-9ffa-48be-b05a-cea4a8e80054 service nova] Releasing lock "refresh_cache-eedd1529-4feb-4f85-8625-0c20d8e0359d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e25c6ab-268b-4c60-9ac7-706cbdd2f60c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:19:28 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:19:28 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:19:28 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:19:28 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.375s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:19:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.083s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[832b1234-7d64-4fb7-be72-7083628ccb6e]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:29 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:19:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FAgGrBRk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:19:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1830878a-71e0-48f1-85b8-9ed83b1419cd/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1830878a-71e0-48f1-85b8-9ed83b1419cd/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1830878a-71e0-48f1-85b8-9ed83b1419cd/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1830878a-71e0-48f1-85b8-9ed83b1419cd/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69bc0bc-b6e8-447b-b529-54031fc78ce1/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.477s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] <== connect_volume: return (1481ms) {'type': 'block', 'scsi_wwn': '23031313336356433', 'path': '/dev/sdc'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031313336356433', 'path': '/dev/sdc'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZGIkRYsx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:19:30 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:19:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:19:30 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:19:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:19:30 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c106678-d575-4bda-ba41-a16cd6bcd601]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:19:30 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e107a75c-f8f7-4a5c-a611-0d3c9c892947]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f] added
Dec 05 15:19:30 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69bc0bc-b6e8-447b-b529-54031fc78ce1/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69bc0bc-b6e8-447b-b529-54031fc78ce1/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef1d2e9-539b-4852-a448-27f8a722ded1]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[34963b04-072f-417e-90a9-8b43156fe3cc]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZGIkRYsx {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZGIkRYsx" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[debebe6d-4b32-454a-9bf1-0b2f803017f8]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZGIkRYsx'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2777c5b1-952e-49e3-9fb0-49645669d82c]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb229a7-7d95-4ea1-a0d4-7631314e5e23]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:19:30 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:19:30 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:19:30 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:19:30 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[571fa096-182c-41da-bcac-d2359d5461aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f, portal: 172.16.0.220,3260]
Dec 05 15:19:30 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f, portal: 172.16.0.220,3260] successful.
Dec 05 15:19:30 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69bc0bc-b6e8-447b-b529-54031fc78ce1/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b86f43-a8f7-4b1d-a2e2-e0f614e6d764/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[810be3c8-afcc-48e2-b830-ad50a3506f8c]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de122fa-4a0a-442d-9444-62a8556e29e6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:19:30 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:19:30 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:19:30 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:19:30 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:19:30 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:19:30 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc10a11-6d06-4f23-9698-a1cf18ce172a]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZGIkRYsx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b86f43-a8f7-4b1d-a2e2-e0f614e6d764/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b86f43-a8f7-4b1d-a2e2-e0f614e6d764/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b86f43-a8f7-4b1d-a2e2-e0f614e6d764/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31688583-6336-4e34-8df5-6947402c39ef/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31688583-6336-4e34-8df5-6947402c39ef/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31688583-6336-4e34-8df5-6947402c39ef/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31688583-6336-4e34-8df5-6947402c39ef/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3cdfe20-7429-476d-9914-8141ba8b7488/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3cdfe20-7429-476d-9914-8141ba8b7488/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3cdfe20-7429-476d-9914-8141ba8b7488/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:31 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.422s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:19:31 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] <== connect_volume: return (1426ms) {'type': 'block', 'scsi_wwn': '26365313134306632', 'path': '/dev/sdd'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:19:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365313134306632', 'path': '/dev/sdd'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:19:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:19:31 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pUAzRPOI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:19:31 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:19:31 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:19:31 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:19:31 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:19:31 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:19:31 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:19:31 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:19:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:31 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbd685f-3a0b-4495-baec-09352727575e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:31 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:19:31 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:31 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[84602026-0a14-4309-b600-6d556e84ee58]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:31 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058] added
Dec 05 15:19:31 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:31 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[793ff1de-8459-4d0e-9f7e-97673149ebe4]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:31 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:31 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d660cfcd-f7d6-467a-9d42-4bede57e829a]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:31 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pUAzRPOI {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pUAzRPOI" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:31 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4b52cd-8503-468e-abc7-ba52e2e2fb63]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:31 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pUAzRPOI'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3cdfe20-7429-476d-9914-8141ba8b7488/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:31 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[820ef09a-102e-416c-97d9-5ea1accbfef6]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:31 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddaaa2f-344c-4939-af20-9f69447af7c3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:19:32 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:19:32 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:19:32 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:19:32 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:19:32 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:19:32 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:32 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:19:32 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:19:32 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=7174MB free_disk=25.432586669921875GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52763e2-944b-4d4e-a991-e10eeed8388f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058, portal: 172.16.0.220,3260]
Dec 05 15:19:32 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058, portal: 172.16.0.220,3260] successful.
Dec 05 15:19:32 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b56ded-efb8-47bf-ba71-2d67c0400e13]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e7207a-5dbe-4265-b5af-ea676b06608b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:19:32 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:19:32 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:19:32 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:19:32 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:19:32 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:19:32 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:19:32 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:19:32 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.775s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e22e00-d3f7-4de8-a7c6-822f94e628d9]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pUAzRPOI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance bd75375a-8b70-4bc2-a72b-14213ebaa4e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance eedd1529-4feb-4f85-8625-0c20d8e0359d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 0259351f-617f-47be-bfb6-2fef1c35bf15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance f3cdfe20-7429-476d-9914-8141ba8b7488 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 1830878a-71e0-48f1-85b8-9ed83b1419cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 33078a88-4858-4c6b-bfa9-c3d9b83cf78b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance d69bc0bc-b6e8-447b-b529-54031fc78ce1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 912b0528-be16-427f-84fc-8a6cf89d5000 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 31688583-6336-4e34-8df5-6947402c39ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:19:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.654s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.811s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] <== connect_volume: return (1813ms) {'type': 'block', 'scsi_wwn': '23732633465333666', 'path': '/dev/sde'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732633465333666', 'path': '/dev/sde'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:18:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174925668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174925668',id=10,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHK7Ceny/4wgBfAUwFIy0jKcP3pm9AXL1VYOmtUxhFboGcu4M4VBVSnAyAsPHPSjfIfcCdCI36JPaLWtGUaQKjuFjNLj9cN1QOT++IwetaV0zm/g0TGwm5lA9cWkw5Shw==',key_name='tempest-keypair-1933341906',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3bd42ae707642a09acd3c394fd36a88',ramdisk_id='',reservation_id='r-faxly3br',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-987206712',owner_user_name='tempest-TaggedBootDevicesTest-987206712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:18:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05a2411551904db193548223ad5e3be8',uuid=912b0528-be16-427f-84fc-8a6cf89d5000,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fc199c0-dcfd-4c56-a910-37478f4c85bb", "address": "fa:16:3e:74:76:f4", "network": {"id": "a9446f1c-bd4f-47f6-a76d-8e479fe32437", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-273850890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fc199c0-dc", "ovs_interfaceid": "6fc199c0-dcfd-4c56-a910-37478f4c85bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converting VIF {"id": "6fc199c0-dcfd-4c56-a910-37478f4c85bb", "address": "fa:16:3e:74:76:f4", "network": {"id": "a9446f1c-bd4f-47f6-a76d-8e479fe32437", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-273850890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fc199c0-dc", "ovs_interfaceid": "6fc199c0-dcfd-4c56-a910-37478f4c85bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:76:f4,bridge_name='br-int',has_traffic_filtering=True,id=6fc199c0-dcfd-4c56-a910-37478f4c85bb,network=Network(a9446f1c-bd4f-47f6-a76d-8e479fe32437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fc199c0-dc') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:18:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174925668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174925668',id=10,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHK7Ceny/4wgBfAUwFIy0jKcP3pm9AXL1VYOmtUxhFboGcu4M4VBVSnAyAsPHPSjfIfcCdCI36JPaLWtGUaQKjuFjNLj9cN1QOT++IwetaV0zm/g0TGwm5lA9cWkw5Shw==',key_name='tempest-keypair-1933341906',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3bd42ae707642a09acd3c394fd36a88',ramdisk_id='',reservation_id='r-faxly3br',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-987206712',owner_user_name='tempest-TaggedBootDevicesTest-987206712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:18:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05a2411551904db193548223ad5e3be8',uuid=912b0528-be16-427f-84fc-8a6cf89d5000,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ac602c3-db8c-42fd-a71f-1664e7a33d9a", "address": "fa:16:3e:4a:ae:17", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac602c3-db", "ovs_interfaceid": "4ac602c3-db8c-42fd-a71f-1664e7a33d9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converting VIF {"id": "4ac602c3-db8c-42fd-a71f-1664e7a33d9a", "address": "fa:16:3e:4a:ae:17", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac602c3-db", "ovs_interfaceid": "4ac602c3-db8c-42fd-a71f-1664e7a33d9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ae:17,bridge_name='br-int',has_traffic_filtering=True,id=4ac602c3-db8c-42fd-a71f-1664e7a33d9a,network=Network(2c38d0dd-fd3c-45ea-8455-3c9bea79261c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4ac602c3-db') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:18:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174925668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174925668',id=10,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHK7Ceny/4wgBfAUwFIy0jKcP3pm9AXL1VYOmtUxhFboGcu4M4VBVSnAyAsPHPSjfIfcCdCI36JPaLWtGUaQKjuFjNLj9cN1QOT++IwetaV0zm/g0TGwm5lA9cWkw5Shw==',key_name='tempest-keypair-1933341906',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3bd42ae707642a09acd3c394fd36a88',ramdisk_id='',reservation_id='r-faxly3br',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-987206712',owner_user_name='tempest-TaggedBootDevicesTest-987206712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:18:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05a2411551904db193548223ad5e3be8',uuid=912b0528-be16-427f-84fc-8a6cf89d5000,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05511460-e0ce-4cd0-9d83-f61d776230e3", "address": "fa:16:3e:4c:56:ff", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05511460-e0", "ovs_interfaceid": "05511460-e0ce-4cd0-9d83-f61d776230e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converting VIF {"id": "05511460-e0ce-4cd0-9d83-f61d776230e3", "address": "fa:16:3e:4c:56:ff", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05511460-e0", "ovs_interfaceid": "05511460-e0ce-4cd0-9d83-f61d776230e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:56:ff,bridge_name='br-int',has_traffic_filtering=True,id=05511460-e0ce-4cd0-9d83-f61d776230e3,network=Network(2c38d0dd-fd3c-45ea-8455-3c9bea79261c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap05511460-e0') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:18:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174925668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174925668',id=10,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHK7Ceny/4wgBfAUwFIy0jKcP3pm9AXL1VYOmtUxhFboGcu4M4VBVSnAyAsPHPSjfIfcCdCI36JPaLWtGUaQKjuFjNLj9cN1QOT++IwetaV0zm/g0TGwm5lA9cWkw5Shw==',key_name='tempest-keypair-1933341906',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3bd42ae707642a09acd3c394fd36a88',ramdisk_id='',reservation_id='r-faxly3br',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-987206712',owner_user_name='tempest-TaggedBootDevicesTest-987206712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:18:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05a2411551904db193548223ad5e3be8',uuid=912b0528-be16-427f-84fc-8a6cf89d5000,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5f4ea2a-ca87-42b4-a7fe-0234b8567230", "address": "fa:16:3e:86:2e:34", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f4ea2a-ca", "ovs_interfaceid": "b5f4ea2a-ca87-42b4-a7fe-0234b8567230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converting VIF {"id": "b5f4ea2a-ca87-42b4-a7fe-0234b8567230", "address": "fa:16:3e:86:2e:34", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f4ea2a-ca", "ovs_interfaceid": "b5f4ea2a-ca87-42b4-a7fe-0234b8567230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:2e:34,bridge_name='br-int',has_traffic_filtering=True,id=b5f4ea2a-ca87-42b4-a7fe-0234b8567230,network=Network(2c38d0dd-fd3c-45ea-8455-3c9bea79261c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f4ea2a-ca') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:18:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174925668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174925668',id=10,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHK7Ceny/4wgBfAUwFIy0jKcP3pm9AXL1VYOmtUxhFboGcu4M4VBVSnAyAsPHPSjfIfcCdCI36JPaLWtGUaQKjuFjNLj9cN1QOT++IwetaV0zm/g0TGwm5lA9cWkw5Shw==',key_name='tempest-keypair-1933341906',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3bd42ae707642a09acd3c394fd36a88',ramdisk_id='',reservation_id='r-faxly3br',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-987206712',owner_user_name='tempest-TaggedBootDevicesTest-987206712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:18:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05a2411551904db193548223ad5e3be8',uuid=912b0528-be16-427f-84fc-8a6cf89d5000,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08064378-9b0c-4b96-a818-6bbd4e31b553", "address": "fa:16:3e:58:dc:50", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08064378-9b", "ovs_interfaceid": "08064378-9b0c-4b96-a818-6bbd4e31b553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converting VIF {"id": "08064378-9b0c-4b96-a818-6bbd4e31b553", "address": "fa:16:3e:58:dc:50", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08064378-9b", "ovs_interfaceid": "08064378-9b0c-4b96-a818-6bbd4e31b553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:dc:50,bridge_name='br-int',has_traffic_filtering=True,id=08064378-9b0c-4b96-a818-6bbd4e31b553,network=Network(2c38d0dd-fd3c-45ea-8455-3c9bea79261c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08064378-9b') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:18:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174925668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174925668',id=10,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHK7Ceny/4wgBfAUwFIy0jKcP3pm9AXL1VYOmtUxhFboGcu4M4VBVSnAyAsPHPSjfIfcCdCI36JPaLWtGUaQKjuFjNLj9cN1QOT++IwetaV0zm/g0TGwm5lA9cWkw5Shw==',key_name='tempest-keypair-1933341906',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3bd42ae707642a09acd3c394fd36a88',ramdisk_id='',reservation_id='r-faxly3br',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-987206712',owner_user_name='tempest-TaggedBootDevicesTest-987206712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:18:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05a2411551904db193548223ad5e3be8',uuid=912b0528-be16-427f-84fc-8a6cf89d5000,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d89c793b-d55a-47b5-a857-bfb4b02d9781", "address": "fa:16:3e:38:ba:63", "network": {"id": "552adb39-e03e-4478-ac90-a3ca91fdce4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1038445196", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd89c793b-d5", "ovs_interfaceid": "d89c793b-d55a-47b5-a857-bfb4b02d9781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converting VIF {"id": "d89c793b-d55a-47b5-a857-bfb4b02d9781", "address": "fa:16:3e:38:ba:63", "network": {"id": "552adb39-e03e-4478-ac90-a3ca91fdce4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1038445196", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd89c793b-d5", "ovs_interfaceid": "d89c793b-d55a-47b5-a857-bfb4b02d9781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:ba:63,bridge_name='br-int',has_traffic_filtering=True,id=d89c793b-d55a-47b5-a857-bfb4b02d9781,network=Network(552adb39-e03e-4478-ac90-a3ca91fdce4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd89c793b-d5') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:18:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174925668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174925668',id=10,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHK7Ceny/4wgBfAUwFIy0jKcP3pm9AXL1VYOmtUxhFboGcu4M4VBVSnAyAsPHPSjfIfcCdCI36JPaLWtGUaQKjuFjNLj9cN1QOT++IwetaV0zm/g0TGwm5lA9cWkw5Shw==',key_name='tempest-keypair-1933341906',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3bd42ae707642a09acd3c394fd36a88',ramdisk_id='',reservation_id='r-faxly3br',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-987206712',owner_user_name='tempest-TaggedBootDevicesTest-987206712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:18:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05a2411551904db193548223ad5e3be8',uuid=912b0528-be16-427f-84fc-8a6cf89d5000,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c", "address": "fa:16:3e:4a:8d:8f", "network": {"id": "552adb39-e03e-4478-ac90-a3ca91fdce4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1038445196", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac25d6a-4e", "ovs_interfaceid": "eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converting VIF {"id": "eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c", "address": "fa:16:3e:4a:8d:8f", "network": {"id": "552adb39-e03e-4478-ac90-a3ca91fdce4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1038445196", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac25d6a-4e", "ovs_interfaceid": "eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:8d:8f,bridge_name='br-int',has_traffic_filtering=True,id=eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c,network=Network(552adb39-e03e-4478-ac90-a3ca91fdce4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac25d6a-4e') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.objects.instance [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Lazy-loading 'pci_devices' on Instance uuid 912b0528-be16-427f-84fc-8a6cf89d5000 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:19:33 user nova-compute[75080]:   <uuid>912b0528-be16-427f-84fc-8a6cf89d5000</uuid>
Dec 05 15:19:33 user nova-compute[75080]:   <name>instance-0000000a</name>
Dec 05 15:19:33 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:19:33 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:19:33 user nova-compute[75080]:   <metadata>
Dec 05 15:19:33 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:19:33 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:19:33 user nova-compute[75080]:       <nova:name>tempest-device-tagging-server-174925668</nova:name>
Dec 05 15:19:33 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:19:28</nova:creationTime>
Dec 05 15:19:33 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:19:33 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:19:33 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:19:33 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:19:33 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:19:33 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:19:33 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:19:33 user nova-compute[75080]:       <nova:owner>
Dec 05 15:19:33 user nova-compute[75080]:         <nova:user uuid="05a2411551904db193548223ad5e3be8">tempest-TaggedBootDevicesTest-987206712-project-member</nova:user>
Dec 05 15:19:33 user nova-compute[75080]:         <nova:project uuid="e3bd42ae707642a09acd3c394fd36a88">tempest-TaggedBootDevicesTest-987206712</nova:project>
Dec 05 15:19:33 user nova-compute[75080]:       </nova:owner>
Dec 05 15:19:33 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:19:33 user nova-compute[75080]:       <nova:ports>
Dec 05 15:19:33 user nova-compute[75080]:         <nova:port uuid="6fc199c0-dcfd-4c56-a910-37478f4c85bb">
Dec 05 15:19:33 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 05 15:19:33 user nova-compute[75080]:         </nova:port>
Dec 05 15:19:33 user nova-compute[75080]:         <nova:port uuid="4ac602c3-db8c-42fd-a71f-1664e7a33d9a">
Dec 05 15:19:33 user nova-compute[75080]:           <nova:ip type="fixed" address="10.1.1.118" ipVersion="4"/>
Dec 05 15:19:33 user nova-compute[75080]:         </nova:port>
Dec 05 15:19:33 user nova-compute[75080]:         <nova:port uuid="05511460-e0ce-4cd0-9d83-f61d776230e3">
Dec 05 15:19:33 user nova-compute[75080]:           <nova:ip type="fixed" address="10.1.1.48" ipVersion="4"/>
Dec 05 15:19:33 user nova-compute[75080]:         </nova:port>
Dec 05 15:19:33 user nova-compute[75080]:         <nova:port uuid="b5f4ea2a-ca87-42b4-a7fe-0234b8567230">
Dec 05 15:19:33 user nova-compute[75080]:           <nova:ip type="fixed" address="10.1.1.229" ipVersion="4"/>
Dec 05 15:19:33 user nova-compute[75080]:         </nova:port>
Dec 05 15:19:33 user nova-compute[75080]:         <nova:port uuid="08064378-9b0c-4b96-a818-6bbd4e31b553">
Dec 05 15:19:33 user nova-compute[75080]:           <nova:ip type="fixed" address="10.1.1.64" ipVersion="4"/>
Dec 05 15:19:33 user nova-compute[75080]:         </nova:port>
Dec 05 15:19:33 user nova-compute[75080]:         <nova:port uuid="d89c793b-d55a-47b5-a857-bfb4b02d9781">
Dec 05 15:19:33 user nova-compute[75080]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Dec 05 15:19:33 user nova-compute[75080]:         </nova:port>
Dec 05 15:19:33 user nova-compute[75080]:         <nova:port uuid="eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c">
Dec 05 15:19:33 user nova-compute[75080]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Dec 05 15:19:33 user nova-compute[75080]:         </nova:port>
Dec 05 15:19:33 user nova-compute[75080]:       </nova:ports>
Dec 05 15:19:33 user nova-compute[75080]:     </nova:instance>
Dec 05 15:19:33 user nova-compute[75080]:   </metadata>
Dec 05 15:19:33 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:19:33 user nova-compute[75080]:     <system>
Dec 05 15:19:33 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:19:33 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:19:33 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:19:33 user nova-compute[75080]:       <entry name="serial">912b0528-be16-427f-84fc-8a6cf89d5000</entry>
Dec 05 15:19:33 user nova-compute[75080]:       <entry name="uuid">912b0528-be16-427f-84fc-8a6cf89d5000</entry>
Dec 05 15:19:33 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:19:33 user nova-compute[75080]:     </system>
Dec 05 15:19:33 user nova-compute[75080]:   </sysinfo>
Dec 05 15:19:33 user nova-compute[75080]:   <os>
Dec 05 15:19:33 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:19:33 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:19:33 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:19:33 user nova-compute[75080]:   </os>
Dec 05 15:19:33 user nova-compute[75080]:   <features>
Dec 05 15:19:33 user nova-compute[75080]:     <acpi/>
Dec 05 15:19:33 user nova-compute[75080]:     <apic/>
Dec 05 15:19:33 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:19:33 user nova-compute[75080]:   </features>
Dec 05 15:19:33 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:19:33 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:19:33 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:19:33 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:19:33 user nova-compute[75080]:   </clock>
Dec 05 15:19:33 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:19:33 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:19:33 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:19:33 user nova-compute[75080]:   </cpu>
Dec 05 15:19:33 user nova-compute[75080]:   <devices>
Dec 05 15:19:33 user nova-compute[75080]:     <disk type="file" device="cdrom">
Dec 05 15:19:33 user nova-compute[75080]:       <driver name="qemu" type="raw" cache="none"/>
Dec 05 15:19:33 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/912b0528-be16-427f-84fc-8a6cf89d5000/disk.config"/>
Dec 05 15:19:33 user nova-compute[75080]:       <target dev="hda" bus="ide"/>
Dec 05 15:19:33 user nova-compute[75080]:     </disk>
Dec 05 15:19:33 user nova-compute[75080]:     <disk type="block" device="disk">
Dec 05 15:19:33 user nova-compute[75080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:19:33 user nova-compute[75080]:       <source dev="/dev/sdc"/>
Dec 05 15:19:33 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:19:33 user nova-compute[75080]:       <serial>7dcf2180-a9e8-4068-825b-1d71c9ec54ed</serial>
Dec 05 15:19:33 user nova-compute[75080]:     </disk>
Dec 05 15:19:33 user nova-compute[75080]:     <disk type="block" device="disk">
Dec 05 15:19:33 user nova-compute[75080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:19:33 user nova-compute[75080]:       <source dev="/dev/sdd"/>
Dec 05 15:19:33 user nova-compute[75080]:       <target dev="vdb" bus="virtio"/>
Dec 05 15:19:33 user nova-compute[75080]:       <serial>b5c4e8fc-305e-4461-b96c-43cff51cf25f</serial>
Dec 05 15:19:33 user nova-compute[75080]:     </disk>
Dec 05 15:19:33 user nova-compute[75080]:     <disk type="block" device="disk">
Dec 05 15:19:33 user nova-compute[75080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:19:33 user nova-compute[75080]:       <source dev="/dev/sde"/>
Dec 05 15:19:33 user nova-compute[75080]:       <target dev="vdc" bus="virtio"/>
Dec 05 15:19:33 user nova-compute[75080]:       <serial>5b31e078-8572-43ca-8a7a-337916550058</serial>
Dec 05 15:19:33 user nova-compute[75080]:     </disk>
Dec 05 15:19:33 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:19:33 user nova-compute[75080]:       <mac address="fa:16:3e:74:76:f4"/>
Dec 05 15:19:33 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:19:33 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:19:33 user nova-compute[75080]:       <target dev="tap6fc199c0-dc"/>
Dec 05 15:19:33 user nova-compute[75080]:     </interface>
Dec 05 15:19:33 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:19:33 user nova-compute[75080]:       <mac address="fa:16:3e:4a:ae:17"/>
Dec 05 15:19:33 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:19:33 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:19:33 user nova-compute[75080]:       <target dev="tap4ac602c3-db"/>
Dec 05 15:19:33 user nova-compute[75080]:     </interface>
Dec 05 15:19:33 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:19:33 user nova-compute[75080]:       <mac address="fa:16:3e:4c:56:ff"/>
Dec 05 15:19:33 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:19:33 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:19:33 user nova-compute[75080]:       <target dev="tap05511460-e0"/>
Dec 05 15:19:33 user nova-compute[75080]:     </interface>
Dec 05 15:19:33 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:19:33 user nova-compute[75080]:       <mac address="fa:16:3e:86:2e:34"/>
Dec 05 15:19:33 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:19:33 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:19:33 user nova-compute[75080]:       <target dev="tapb5f4ea2a-ca"/>
Dec 05 15:19:33 user nova-compute[75080]:     </interface>
Dec 05 15:19:33 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:19:33 user nova-compute[75080]:       <mac address="fa:16:3e:58:dc:50"/>
Dec 05 15:19:33 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:19:33 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:19:33 user nova-compute[75080]:       <target dev="tap08064378-9b"/>
Dec 05 15:19:33 user nova-compute[75080]:     </interface>
Dec 05 15:19:33 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:19:33 user nova-compute[75080]:       <mac address="fa:16:3e:38:ba:63"/>
Dec 05 15:19:33 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:19:33 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:19:33 user nova-compute[75080]:       <target dev="tapd89c793b-d5"/>
Dec 05 15:19:33 user nova-compute[75080]:     </interface>
Dec 05 15:19:33 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:19:33 user nova-compute[75080]:       <mac address="fa:16:3e:4a:8d:8f"/>
Dec 05 15:19:33 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:19:33 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:19:33 user nova-compute[75080]:       <target dev="tapeac25d6a-4e"/>
Dec 05 15:19:33 user nova-compute[75080]:     </interface>
Dec 05 15:19:33 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:19:33 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/912b0528-be16-427f-84fc-8a6cf89d5000/console.log" append="off"/>
Dec 05 15:19:33 user nova-compute[75080]:     </serial>
Dec 05 15:19:33 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:19:33 user nova-compute[75080]:     <video>
Dec 05 15:19:33 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:19:33 user nova-compute[75080]:     </video>
Dec 05 15:19:33 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:19:33 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:19:33 user nova-compute[75080]:     </rng>
Dec 05 15:19:33 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:19:33 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:19:33 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:19:33 user nova-compute[75080]:     </memballoon>
Dec 05 15:19:33 user nova-compute[75080]:   </devices>
Dec 05 15:19:33 user nova-compute[75080]: </domain>
Dec 05 15:19:33 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:18:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174925668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174925668',id=10,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHK7Ceny/4wgBfAUwFIy0jKcP3pm9AXL1VYOmtUxhFboGcu4M4VBVSnAyAsPHPSjfIfcCdCI36JPaLWtGUaQKjuFjNLj9cN1QOT++IwetaV0zm/g0TGwm5lA9cWkw5Shw==',key_name='tempest-keypair-1933341906',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3bd42ae707642a09acd3c394fd36a88',ramdisk_id='',reservation_id='r-faxly3br',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-987206712',owner_user_name='tempest-TaggedBootDevicesTest-987206712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:18:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05a2411551904db193548223ad5e3be8',uuid=912b0528-be16-427f-84fc-8a6cf89d5000,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fc199c0-dcfd-4c56-a910-37478f4c85bb", "address": "fa:16:3e:74:76:f4", "network": {"id": "a9446f1c-bd4f-47f6-a76d-8e479fe32437", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-273850890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fc199c0-dc", "ovs_interfaceid": "6fc199c0-dcfd-4c56-a910-37478f4c85bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converting VIF {"id": "6fc199c0-dcfd-4c56-a910-37478f4c85bb", "address": "fa:16:3e:74:76:f4", "network": {"id": "a9446f1c-bd4f-47f6-a76d-8e479fe32437", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-273850890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fc199c0-dc", "ovs_interfaceid": "6fc199c0-dcfd-4c56-a910-37478f4c85bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:76:f4,bridge_name='br-int',has_traffic_filtering=True,id=6fc199c0-dcfd-4c56-a910-37478f4c85bb,network=Network(a9446f1c-bd4f-47f6-a76d-8e479fe32437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fc199c0-dc') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG os_vif [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:76:f4,bridge_name='br-int',has_traffic_filtering=True,id=6fc199c0-dcfd-4c56-a910-37478f4c85bb,network=Network(a9446f1c-bd4f-47f6-a76d-8e479fe32437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fc199c0-dc') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '11083b97-ff93-5247-ad09-ad2d1ab35ca7', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6fc199c0-dc, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6fc199c0-dc, col_values=(('qos', UUID('7ceedcf8-c040-41aa-84a6-25519794ad7f')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6fc199c0-dc, col_values=(('external_ids', {'iface-id': '6fc199c0-dcfd-4c56-a910-37478f4c85bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:76:f4', 'vm-uuid': '912b0528-be16-427f-84fc-8a6cf89d5000'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: INFO os_vif [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:76:f4,bridge_name='br-int',has_traffic_filtering=True,id=6fc199c0-dcfd-4c56-a910-37478f4c85bb,network=Network(a9446f1c-bd4f-47f6-a76d-8e479fe32437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fc199c0-dc')
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:18:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174925668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174925668',id=10,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHK7Ceny/4wgBfAUwFIy0jKcP3pm9AXL1VYOmtUxhFboGcu4M4VBVSnAyAsPHPSjfIfcCdCI36JPaLWtGUaQKjuFjNLj9cN1QOT++IwetaV0zm/g0TGwm5lA9cWkw5Shw==',key_name='tempest-keypair-1933341906',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3bd42ae707642a09acd3c394fd36a88',ramdisk_id='',reservation_id='r-faxly3br',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-987206712',owner_user_name='tempest-TaggedBootDevicesTest-987206712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:18:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05a2411551904db193548223ad5e3be8',uuid=912b0528-be16-427f-84fc-8a6cf89d5000,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ac602c3-db8c-42fd-a71f-1664e7a33d9a", "address": "fa:16:3e:4a:ae:17", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac602c3-db", "ovs_interfaceid": "4ac602c3-db8c-42fd-a71f-1664e7a33d9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converting VIF {"id": "4ac602c3-db8c-42fd-a71f-1664e7a33d9a", "address": "fa:16:3e:4a:ae:17", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac602c3-db", "ovs_interfaceid": "4ac602c3-db8c-42fd-a71f-1664e7a33d9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ae:17,bridge_name='br-int',has_traffic_filtering=True,id=4ac602c3-db8c-42fd-a71f-1664e7a33d9a,network=Network(2c38d0dd-fd3c-45ea-8455-3c9bea79261c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4ac602c3-db') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG os_vif [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ae:17,bridge_name='br-int',has_traffic_filtering=True,id=4ac602c3-db8c-42fd-a71f-1664e7a33d9a,network=Network(2c38d0dd-fd3c-45ea-8455-3c9bea79261c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4ac602c3-db') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '68f7bafe-15ee-599c-b5f3-26675c3f1195', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ac602c3-db, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4ac602c3-db, col_values=(('qos', UUID('bd69ffd1-0f9b-42a2-80b9-278a198443b3')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4ac602c3-db, col_values=(('external_ids', {'iface-id': '4ac602c3-db8c-42fd-a71f-1664e7a33d9a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:ae:17', 'vm-uuid': '912b0528-be16-427f-84fc-8a6cf89d5000'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: INFO os_vif [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ae:17,bridge_name='br-int',has_traffic_filtering=True,id=4ac602c3-db8c-42fd-a71f-1664e7a33d9a,network=Network(2c38d0dd-fd3c-45ea-8455-3c9bea79261c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4ac602c3-db')
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:18:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174925668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174925668',id=10,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHK7Ceny/4wgBfAUwFIy0jKcP3pm9AXL1VYOmtUxhFboGcu4M4VBVSnAyAsPHPSjfIfcCdCI36JPaLWtGUaQKjuFjNLj9cN1QOT++IwetaV0zm/g0TGwm5lA9cWkw5Shw==',key_name='tempest-keypair-1933341906',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3bd42ae707642a09acd3c394fd36a88',ramdisk_id='',reservation_id='r-faxly3br',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-987206712',owner_user_name='tempest-TaggedBootDevicesTest-987206712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:18:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05a2411551904db193548223ad5e3be8',uuid=912b0528-be16-427f-84fc-8a6cf89d5000,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05511460-e0ce-4cd0-9d83-f61d776230e3", "address": "fa:16:3e:4c:56:ff", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05511460-e0", "ovs_interfaceid": "05511460-e0ce-4cd0-9d83-f61d776230e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converting VIF {"id": "05511460-e0ce-4cd0-9d83-f61d776230e3", "address": "fa:16:3e:4c:56:ff", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05511460-e0", "ovs_interfaceid": "05511460-e0ce-4cd0-9d83-f61d776230e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:56:ff,bridge_name='br-int',has_traffic_filtering=True,id=05511460-e0ce-4cd0-9d83-f61d776230e3,network=Network(2c38d0dd-fd3c-45ea-8455-3c9bea79261c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap05511460-e0') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG os_vif [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:56:ff,bridge_name='br-int',has_traffic_filtering=True,id=05511460-e0ce-4cd0-9d83-f61d776230e3,network=Network(2c38d0dd-fd3c-45ea-8455-3c9bea79261c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap05511460-e0') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'da8a3fc7-8b03-5ec2-9905-720d42d3063d', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05511460-e0, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap05511460-e0, col_values=(('qos', UUID('5bbe2cbf-4165-4dcb-907a-14f0ae19b515')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap05511460-e0, col_values=(('external_ids', {'iface-id': '05511460-e0ce-4cd0-9d83-f61d776230e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:56:ff', 'vm-uuid': '912b0528-be16-427f-84fc-8a6cf89d5000'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: INFO os_vif [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:56:ff,bridge_name='br-int',has_traffic_filtering=True,id=05511460-e0ce-4cd0-9d83-f61d776230e3,network=Network(2c38d0dd-fd3c-45ea-8455-3c9bea79261c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap05511460-e0')
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:18:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174925668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174925668',id=10,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHK7Ceny/4wgBfAUwFIy0jKcP3pm9AXL1VYOmtUxhFboGcu4M4VBVSnAyAsPHPSjfIfcCdCI36JPaLWtGUaQKjuFjNLj9cN1QOT++IwetaV0zm/g0TGwm5lA9cWkw5Shw==',key_name='tempest-keypair-1933341906',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3bd42ae707642a09acd3c394fd36a88',ramdisk_id='',reservation_id='r-faxly3br',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-987206712',owner_user_name='tempest-TaggedBootDevicesTest-987206712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:18:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05a2411551904db193548223ad5e3be8',uuid=912b0528-be16-427f-84fc-8a6cf89d5000,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5f4ea2a-ca87-42b4-a7fe-0234b8567230", "address": "fa:16:3e:86:2e:34", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f4ea2a-ca", "ovs_interfaceid": "b5f4ea2a-ca87-42b4-a7fe-0234b8567230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converting VIF {"id": "b5f4ea2a-ca87-42b4-a7fe-0234b8567230", "address": "fa:16:3e:86:2e:34", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f4ea2a-ca", "ovs_interfaceid": "b5f4ea2a-ca87-42b4-a7fe-0234b8567230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:2e:34,bridge_name='br-int',has_traffic_filtering=True,id=b5f4ea2a-ca87-42b4-a7fe-0234b8567230,network=Network(2c38d0dd-fd3c-45ea-8455-3c9bea79261c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f4ea2a-ca') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG os_vif [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:2e:34,bridge_name='br-int',has_traffic_filtering=True,id=b5f4ea2a-ca87-42b4-a7fe-0234b8567230,network=Network(2c38d0dd-fd3c-45ea-8455-3c9bea79261c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f4ea2a-ca') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '38ff76bb-cfbe-5415-9fe8-ed301b918438', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5f4ea2a-ca, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb5f4ea2a-ca, col_values=(('qos', UUID('cddcb3cb-f547-4dc4-8267-700e1ddaa0ae')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb5f4ea2a-ca, col_values=(('external_ids', {'iface-id': 'b5f4ea2a-ca87-42b4-a7fe-0234b8567230', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:2e:34', 'vm-uuid': '912b0528-be16-427f-84fc-8a6cf89d5000'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: INFO os_vif [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:2e:34,bridge_name='br-int',has_traffic_filtering=True,id=b5f4ea2a-ca87-42b4-a7fe-0234b8567230,network=Network(2c38d0dd-fd3c-45ea-8455-3c9bea79261c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f4ea2a-ca')
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:18:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174925668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174925668',id=10,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHK7Ceny/4wgBfAUwFIy0jKcP3pm9AXL1VYOmtUxhFboGcu4M4VBVSnAyAsPHPSjfIfcCdCI36JPaLWtGUaQKjuFjNLj9cN1QOT++IwetaV0zm/g0TGwm5lA9cWkw5Shw==',key_name='tempest-keypair-1933341906',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3bd42ae707642a09acd3c394fd36a88',ramdisk_id='',reservation_id='r-faxly3br',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-987206712',owner_user_name='tempest-TaggedBootDevicesTest-987206712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:18:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05a2411551904db193548223ad5e3be8',uuid=912b0528-be16-427f-84fc-8a6cf89d5000,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08064378-9b0c-4b96-a818-6bbd4e31b553", "address": "fa:16:3e:58:dc:50", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08064378-9b", "ovs_interfaceid": "08064378-9b0c-4b96-a818-6bbd4e31b553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converting VIF {"id": "08064378-9b0c-4b96-a818-6bbd4e31b553", "address": "fa:16:3e:58:dc:50", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08064378-9b", "ovs_interfaceid": "08064378-9b0c-4b96-a818-6bbd4e31b553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:dc:50,bridge_name='br-int',has_traffic_filtering=True,id=08064378-9b0c-4b96-a818-6bbd4e31b553,network=Network(2c38d0dd-fd3c-45ea-8455-3c9bea79261c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08064378-9b') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG os_vif [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:dc:50,bridge_name='br-int',has_traffic_filtering=True,id=08064378-9b0c-4b96-a818-6bbd4e31b553,network=Network(2c38d0dd-fd3c-45ea-8455-3c9bea79261c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08064378-9b') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '201219b7-cd77-5461-a6eb-4145c718e3af', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08064378-9b, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap08064378-9b, col_values=(('qos', UUID('be301673-54f1-4521-bd42-073e18de0bca')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap08064378-9b, col_values=(('external_ids', {'iface-id': '08064378-9b0c-4b96-a818-6bbd4e31b553', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:dc:50', 'vm-uuid': '912b0528-be16-427f-84fc-8a6cf89d5000'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: INFO os_vif [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:dc:50,bridge_name='br-int',has_traffic_filtering=True,id=08064378-9b0c-4b96-a818-6bbd4e31b553,network=Network(2c38d0dd-fd3c-45ea-8455-3c9bea79261c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08064378-9b')
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:18:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174925668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174925668',id=10,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHK7Ceny/4wgBfAUwFIy0jKcP3pm9AXL1VYOmtUxhFboGcu4M4VBVSnAyAsPHPSjfIfcCdCI36JPaLWtGUaQKjuFjNLj9cN1QOT++IwetaV0zm/g0TGwm5lA9cWkw5Shw==',key_name='tempest-keypair-1933341906',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3bd42ae707642a09acd3c394fd36a88',ramdisk_id='',reservation_id='r-faxly3br',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-987206712',owner_user_name='tempest-TaggedBootDevicesTest-987206712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:18:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05a2411551904db193548223ad5e3be8',uuid=912b0528-be16-427f-84fc-8a6cf89d5000,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d89c793b-d55a-47b5-a857-bfb4b02d9781", "address": "fa:16:3e:38:ba:63", "network": {"id": "552adb39-e03e-4478-ac90-a3ca91fdce4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1038445196", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd89c793b-d5", "ovs_interfaceid": "d89c793b-d55a-47b5-a857-bfb4b02d9781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converting VIF {"id": "d89c793b-d55a-47b5-a857-bfb4b02d9781", "address": "fa:16:3e:38:ba:63", "network": {"id": "552adb39-e03e-4478-ac90-a3ca91fdce4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1038445196", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd89c793b-d5", "ovs_interfaceid": "d89c793b-d55a-47b5-a857-bfb4b02d9781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:ba:63,bridge_name='br-int',has_traffic_filtering=True,id=d89c793b-d55a-47b5-a857-bfb4b02d9781,network=Network(552adb39-e03e-4478-ac90-a3ca91fdce4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd89c793b-d5') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG os_vif [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:ba:63,bridge_name='br-int',has_traffic_filtering=True,id=d89c793b-d55a-47b5-a857-bfb4b02d9781,network=Network(552adb39-e03e-4478-ac90-a3ca91fdce4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd89c793b-d5') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8a62f729-f767-5154-9524-48e5c7a788cf', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd89c793b-d5, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd89c793b-d5, col_values=(('qos', UUID('e514ceba-5e02-42bb-bdde-cfe3a851f44a')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd89c793b-d5, col_values=(('external_ids', {'iface-id': 'd89c793b-d55a-47b5-a857-bfb4b02d9781', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:ba:63', 'vm-uuid': '912b0528-be16-427f-84fc-8a6cf89d5000'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: INFO os_vif [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:ba:63,bridge_name='br-int',has_traffic_filtering=True,id=d89c793b-d55a-47b5-a857-bfb4b02d9781,network=Network(552adb39-e03e-4478-ac90-a3ca91fdce4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd89c793b-d5')
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:18:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174925668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174925668',id=10,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHK7Ceny/4wgBfAUwFIy0jKcP3pm9AXL1VYOmtUxhFboGcu4M4VBVSnAyAsPHPSjfIfcCdCI36JPaLWtGUaQKjuFjNLj9cN1QOT++IwetaV0zm/g0TGwm5lA9cWkw5Shw==',key_name='tempest-keypair-1933341906',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3bd42ae707642a09acd3c394fd36a88',ramdisk_id='',reservation_id='r-faxly3br',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-987206712',owner_user_name='tempest-TaggedBootDevicesTest-987206712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:18:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05a2411551904db193548223ad5e3be8',uuid=912b0528-be16-427f-84fc-8a6cf89d5000,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c", "address": "fa:16:3e:4a:8d:8f", "network": {"id": "552adb39-e03e-4478-ac90-a3ca91fdce4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1038445196", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac25d6a-4e", "ovs_interfaceid": "eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converting VIF {"id": "eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c", "address": "fa:16:3e:4a:8d:8f", "network": {"id": "552adb39-e03e-4478-ac90-a3ca91fdce4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1038445196", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac25d6a-4e", "ovs_interfaceid": "eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:8d:8f,bridge_name='br-int',has_traffic_filtering=True,id=eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c,network=Network(552adb39-e03e-4478-ac90-a3ca91fdce4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac25d6a-4e') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG os_vif [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:8d:8f,bridge_name='br-int',has_traffic_filtering=True,id=eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c,network=Network(552adb39-e03e-4478-ac90-a3ca91fdce4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac25d6a-4e') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5d2ecc00-89ac-58ed-98d1-3da7902202f2', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:19:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeac25d6a-4e, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeac25d6a-4e, col_values=(('qos', UUID('86b01991-6cad-4e81-b1a7-8936c8d38632')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeac25d6a-4e, col_values=(('external_ids', {'iface-id': 'eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:8d:8f', 'vm-uuid': '912b0528-be16-427f-84fc-8a6cf89d5000'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:19:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:34 user nova-compute[75080]: INFO os_vif [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:8d:8f,bridge_name='br-int',has_traffic_filtering=True,id=eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c,network=Network(552adb39-e03e-4478-ac90-a3ca91fdce4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac25d6a-4e')
Dec 05 15:19:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] No BDM found with device name hda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:19:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:19:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] No VIF found with MAC fa:16:3e:74:76:f4, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:19:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] No VIF found with MAC fa:16:3e:58:dc:50, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:19:34 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Using config drive
Dec 05 15:19:34 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Creating config drive at /opt/stack/data/nova/instances/912b0528-be16-427f-84fc-8a6cf89d5000/disk.config
Dec 05 15:19:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/912b0528-be16-427f-84fc-8a6cf89d5000/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpz0gqp2h5 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/912b0528-be16-427f-84fc-8a6cf89d5000/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpz0gqp2h5" returned: 0 in 0.088s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:36 user nova-compute[75080]: DEBUG nova.compute.manager [req-ad17b5c3-ac68-4801-b08e-15b780e9f4e3 req-7fec5df7-260c-40c2-9d7d-e0c80011a71c service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-plugged-6fc199c0-dcfd-4c56-a910-37478f4c85bb {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:19:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-ad17b5c3-ac68-4801-b08e-15b780e9f4e3 req-7fec5df7-260c-40c2-9d7d-e0c80011a71c service nova] Acquiring lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-ad17b5c3-ac68-4801-b08e-15b780e9f4e3 req-7fec5df7-260c-40c2-9d7d-e0c80011a71c service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-ad17b5c3-ac68-4801-b08e-15b780e9f4e3 req-7fec5df7-260c-40c2-9d7d-e0c80011a71c service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:19:36 user nova-compute[75080]: DEBUG nova.compute.manager [req-ad17b5c3-ac68-4801-b08e-15b780e9f4e3 req-7fec5df7-260c-40c2-9d7d-e0c80011a71c service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] No waiting events found dispatching network-vif-plugged-6fc199c0-dcfd-4c56-a910-37478f4c85bb {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:19:36 user nova-compute[75080]: WARNING nova.compute.manager [req-ad17b5c3-ac68-4801-b08e-15b780e9f4e3 req-7fec5df7-260c-40c2-9d7d-e0c80011a71c service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received unexpected event network-vif-plugged-6fc199c0-dcfd-4c56-a910-37478f4c85bb for instance with vm_state building and task_state spawning.
Dec 05 15:19:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:37 user nova-compute[75080]: DEBUG nova.compute.manager [req-4b6b48b5-2568-479f-a1ad-a57f4911e4c0 req-2c9b1997-1422-4c7b-b251-cd75c5a37370 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-plugged-4ac602c3-db8c-42fd-a71f-1664e7a33d9a {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:19:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4b6b48b5-2568-479f-a1ad-a57f4911e4c0 req-2c9b1997-1422-4c7b-b251-cd75c5a37370 service nova] Acquiring lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4b6b48b5-2568-479f-a1ad-a57f4911e4c0 req-2c9b1997-1422-4c7b-b251-cd75c5a37370 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4b6b48b5-2568-479f-a1ad-a57f4911e4c0 req-2c9b1997-1422-4c7b-b251-cd75c5a37370 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:19:37 user nova-compute[75080]: DEBUG nova.compute.manager [req-4b6b48b5-2568-479f-a1ad-a57f4911e4c0 req-2c9b1997-1422-4c7b-b251-cd75c5a37370 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] No waiting events found dispatching network-vif-plugged-4ac602c3-db8c-42fd-a71f-1664e7a33d9a {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:19:37 user nova-compute[75080]: WARNING nova.compute.manager [req-4b6b48b5-2568-479f-a1ad-a57f4911e4c0 req-2c9b1997-1422-4c7b-b251-cd75c5a37370 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received unexpected event network-vif-plugged-4ac602c3-db8c-42fd-a71f-1664e7a33d9a for instance with vm_state building and task_state spawning.
Dec 05 15:19:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:37 user nova-compute[75080]: DEBUG nova.compute.manager [req-be15e344-c0ef-4705-8f2b-f5cf17c0c632 req-70086e0a-0b7e-4e00-9531-0e6c2d7bb9e3 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-plugged-b5f4ea2a-ca87-42b4-a7fe-0234b8567230 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:19:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-be15e344-c0ef-4705-8f2b-f5cf17c0c632 req-70086e0a-0b7e-4e00-9531-0e6c2d7bb9e3 service nova] Acquiring lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-be15e344-c0ef-4705-8f2b-f5cf17c0c632 req-70086e0a-0b7e-4e00-9531-0e6c2d7bb9e3 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-be15e344-c0ef-4705-8f2b-f5cf17c0c632 req-70086e0a-0b7e-4e00-9531-0e6c2d7bb9e3 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:19:37 user nova-compute[75080]: DEBUG nova.compute.manager [req-be15e344-c0ef-4705-8f2b-f5cf17c0c632 req-70086e0a-0b7e-4e00-9531-0e6c2d7bb9e3 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] No waiting events found dispatching network-vif-plugged-b5f4ea2a-ca87-42b4-a7fe-0234b8567230 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:19:37 user nova-compute[75080]: WARNING nova.compute.manager [req-be15e344-c0ef-4705-8f2b-f5cf17c0c632 req-70086e0a-0b7e-4e00-9531-0e6c2d7bb9e3 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received unexpected event network-vif-plugged-b5f4ea2a-ca87-42b4-a7fe-0234b8567230 for instance with vm_state building and task_state spawning.
Dec 05 15:19:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:38 user nova-compute[75080]: DEBUG nova.compute.manager [req-27f5e93b-6e98-4a95-89f3-0eb35bbcf64a req-ecf920c5-38ed-4292-8b90-52f0198d1d31 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-plugged-6fc199c0-dcfd-4c56-a910-37478f4c85bb {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:19:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-27f5e93b-6e98-4a95-89f3-0eb35bbcf64a req-ecf920c5-38ed-4292-8b90-52f0198d1d31 service nova] Acquiring lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-27f5e93b-6e98-4a95-89f3-0eb35bbcf64a req-ecf920c5-38ed-4292-8b90-52f0198d1d31 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-27f5e93b-6e98-4a95-89f3-0eb35bbcf64a req-ecf920c5-38ed-4292-8b90-52f0198d1d31 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:19:38 user nova-compute[75080]: DEBUG nova.compute.manager [req-27f5e93b-6e98-4a95-89f3-0eb35bbcf64a req-ecf920c5-38ed-4292-8b90-52f0198d1d31 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] No waiting events found dispatching network-vif-plugged-6fc199c0-dcfd-4c56-a910-37478f4c85bb {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:19:38 user nova-compute[75080]: WARNING nova.compute.manager [req-27f5e93b-6e98-4a95-89f3-0eb35bbcf64a req-ecf920c5-38ed-4292-8b90-52f0198d1d31 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received unexpected event network-vif-plugged-6fc199c0-dcfd-4c56-a910-37478f4c85bb for instance with vm_state building and task_state spawning.
Dec 05 15:19:38 user nova-compute[75080]: DEBUG nova.compute.manager [req-27f5e93b-6e98-4a95-89f3-0eb35bbcf64a req-ecf920c5-38ed-4292-8b90-52f0198d1d31 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-plugged-08064378-9b0c-4b96-a818-6bbd4e31b553 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:19:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-27f5e93b-6e98-4a95-89f3-0eb35bbcf64a req-ecf920c5-38ed-4292-8b90-52f0198d1d31 service nova] Acquiring lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-27f5e93b-6e98-4a95-89f3-0eb35bbcf64a req-ecf920c5-38ed-4292-8b90-52f0198d1d31 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-27f5e93b-6e98-4a95-89f3-0eb35bbcf64a req-ecf920c5-38ed-4292-8b90-52f0198d1d31 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:19:38 user nova-compute[75080]: DEBUG nova.compute.manager [req-27f5e93b-6e98-4a95-89f3-0eb35bbcf64a req-ecf920c5-38ed-4292-8b90-52f0198d1d31 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] No waiting events found dispatching network-vif-plugged-08064378-9b0c-4b96-a818-6bbd4e31b553 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:19:38 user nova-compute[75080]: WARNING nova.compute.manager [req-27f5e93b-6e98-4a95-89f3-0eb35bbcf64a req-ecf920c5-38ed-4292-8b90-52f0198d1d31 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received unexpected event network-vif-plugged-08064378-9b0c-4b96-a818-6bbd4e31b553 for instance with vm_state building and task_state spawning.
Dec 05 15:19:38 user nova-compute[75080]: DEBUG nova.compute.manager [req-27f5e93b-6e98-4a95-89f3-0eb35bbcf64a req-ecf920c5-38ed-4292-8b90-52f0198d1d31 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-plugged-08064378-9b0c-4b96-a818-6bbd4e31b553 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:19:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-27f5e93b-6e98-4a95-89f3-0eb35bbcf64a req-ecf920c5-38ed-4292-8b90-52f0198d1d31 service nova] Acquiring lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-27f5e93b-6e98-4a95-89f3-0eb35bbcf64a req-ecf920c5-38ed-4292-8b90-52f0198d1d31 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-27f5e93b-6e98-4a95-89f3-0eb35bbcf64a req-ecf920c5-38ed-4292-8b90-52f0198d1d31 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:19:38 user nova-compute[75080]: DEBUG nova.compute.manager [req-27f5e93b-6e98-4a95-89f3-0eb35bbcf64a req-ecf920c5-38ed-4292-8b90-52f0198d1d31 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] No waiting events found dispatching network-vif-plugged-08064378-9b0c-4b96-a818-6bbd4e31b553 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:19:38 user nova-compute[75080]: WARNING nova.compute.manager [req-27f5e93b-6e98-4a95-89f3-0eb35bbcf64a req-ecf920c5-38ed-4292-8b90-52f0198d1d31 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received unexpected event network-vif-plugged-08064378-9b0c-4b96-a818-6bbd4e31b553 for instance with vm_state building and task_state spawning.
Dec 05 15:19:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:39 user nova-compute[75080]: DEBUG nova.compute.manager [req-61de0dc7-c0d6-45e4-988c-f09b75b7e4fc req-45d075e4-2ae3-46e1-8c5e-a4b2f7702b5b service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-plugged-4ac602c3-db8c-42fd-a71f-1664e7a33d9a {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:19:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-61de0dc7-c0d6-45e4-988c-f09b75b7e4fc req-45d075e4-2ae3-46e1-8c5e-a4b2f7702b5b service nova] Acquiring lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-61de0dc7-c0d6-45e4-988c-f09b75b7e4fc req-45d075e4-2ae3-46e1-8c5e-a4b2f7702b5b service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-61de0dc7-c0d6-45e4-988c-f09b75b7e4fc req-45d075e4-2ae3-46e1-8c5e-a4b2f7702b5b service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:19:39 user nova-compute[75080]: DEBUG nova.compute.manager [req-61de0dc7-c0d6-45e4-988c-f09b75b7e4fc req-45d075e4-2ae3-46e1-8c5e-a4b2f7702b5b service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] No waiting events found dispatching network-vif-plugged-4ac602c3-db8c-42fd-a71f-1664e7a33d9a {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:19:39 user nova-compute[75080]: WARNING nova.compute.manager [req-61de0dc7-c0d6-45e4-988c-f09b75b7e4fc req-45d075e4-2ae3-46e1-8c5e-a4b2f7702b5b service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received unexpected event network-vif-plugged-4ac602c3-db8c-42fd-a71f-1664e7a33d9a for instance with vm_state building and task_state spawning.
Dec 05 15:19:39 user nova-compute[75080]: DEBUG nova.compute.manager [req-61de0dc7-c0d6-45e4-988c-f09b75b7e4fc req-45d075e4-2ae3-46e1-8c5e-a4b2f7702b5b service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-plugged-05511460-e0ce-4cd0-9d83-f61d776230e3 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:19:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-61de0dc7-c0d6-45e4-988c-f09b75b7e4fc req-45d075e4-2ae3-46e1-8c5e-a4b2f7702b5b service nova] Acquiring lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-61de0dc7-c0d6-45e4-988c-f09b75b7e4fc req-45d075e4-2ae3-46e1-8c5e-a4b2f7702b5b service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-61de0dc7-c0d6-45e4-988c-f09b75b7e4fc req-45d075e4-2ae3-46e1-8c5e-a4b2f7702b5b service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:19:39 user nova-compute[75080]: DEBUG nova.compute.manager [req-61de0dc7-c0d6-45e4-988c-f09b75b7e4fc req-45d075e4-2ae3-46e1-8c5e-a4b2f7702b5b service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] No waiting events found dispatching network-vif-plugged-05511460-e0ce-4cd0-9d83-f61d776230e3 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:19:39 user nova-compute[75080]: WARNING nova.compute.manager [req-61de0dc7-c0d6-45e4-988c-f09b75b7e4fc req-45d075e4-2ae3-46e1-8c5e-a4b2f7702b5b service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received unexpected event network-vif-plugged-05511460-e0ce-4cd0-9d83-f61d776230e3 for instance with vm_state building and task_state spawning.
Dec 05 15:19:39 user nova-compute[75080]: DEBUG nova.compute.manager [req-61de0dc7-c0d6-45e4-988c-f09b75b7e4fc req-45d075e4-2ae3-46e1-8c5e-a4b2f7702b5b service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-plugged-05511460-e0ce-4cd0-9d83-f61d776230e3 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:19:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-61de0dc7-c0d6-45e4-988c-f09b75b7e4fc req-45d075e4-2ae3-46e1-8c5e-a4b2f7702b5b service nova] Acquiring lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-61de0dc7-c0d6-45e4-988c-f09b75b7e4fc req-45d075e4-2ae3-46e1-8c5e-a4b2f7702b5b service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-61de0dc7-c0d6-45e4-988c-f09b75b7e4fc req-45d075e4-2ae3-46e1-8c5e-a4b2f7702b5b service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:19:39 user nova-compute[75080]: DEBUG nova.compute.manager [req-61de0dc7-c0d6-45e4-988c-f09b75b7e4fc req-45d075e4-2ae3-46e1-8c5e-a4b2f7702b5b service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] No waiting events found dispatching network-vif-plugged-05511460-e0ce-4cd0-9d83-f61d776230e3 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:19:39 user nova-compute[75080]: WARNING nova.compute.manager [req-61de0dc7-c0d6-45e4-988c-f09b75b7e4fc req-45d075e4-2ae3-46e1-8c5e-a4b2f7702b5b service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received unexpected event network-vif-plugged-05511460-e0ce-4cd0-9d83-f61d776230e3 for instance with vm_state building and task_state spawning.
Dec 05 15:19:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:40 user nova-compute[75080]: DEBUG nova.compute.manager [req-0b2451eb-1518-40c7-b68d-c050ba6886d7 req-86acc436-d429-4869-9d1d-8e45ee969ad9 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-plugged-b5f4ea2a-ca87-42b4-a7fe-0234b8567230 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:19:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0b2451eb-1518-40c7-b68d-c050ba6886d7 req-86acc436-d429-4869-9d1d-8e45ee969ad9 service nova] Acquiring lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0b2451eb-1518-40c7-b68d-c050ba6886d7 req-86acc436-d429-4869-9d1d-8e45ee969ad9 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0b2451eb-1518-40c7-b68d-c050ba6886d7 req-86acc436-d429-4869-9d1d-8e45ee969ad9 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:19:40 user nova-compute[75080]: DEBUG nova.compute.manager [req-0b2451eb-1518-40c7-b68d-c050ba6886d7 req-86acc436-d429-4869-9d1d-8e45ee969ad9 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] No waiting events found dispatching network-vif-plugged-b5f4ea2a-ca87-42b4-a7fe-0234b8567230 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:19:40 user nova-compute[75080]: WARNING nova.compute.manager [req-0b2451eb-1518-40c7-b68d-c050ba6886d7 req-86acc436-d429-4869-9d1d-8e45ee969ad9 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received unexpected event network-vif-plugged-b5f4ea2a-ca87-42b4-a7fe-0234b8567230 for instance with vm_state building and task_state spawning.
Dec 05 15:19:40 user nova-compute[75080]: DEBUG nova.compute.manager [req-0b2451eb-1518-40c7-b68d-c050ba6886d7 req-86acc436-d429-4869-9d1d-8e45ee969ad9 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-plugged-d89c793b-d55a-47b5-a857-bfb4b02d9781 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:19:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0b2451eb-1518-40c7-b68d-c050ba6886d7 req-86acc436-d429-4869-9d1d-8e45ee969ad9 service nova] Acquiring lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0b2451eb-1518-40c7-b68d-c050ba6886d7 req-86acc436-d429-4869-9d1d-8e45ee969ad9 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0b2451eb-1518-40c7-b68d-c050ba6886d7 req-86acc436-d429-4869-9d1d-8e45ee969ad9 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:19:40 user nova-compute[75080]: DEBUG nova.compute.manager [req-0b2451eb-1518-40c7-b68d-c050ba6886d7 req-86acc436-d429-4869-9d1d-8e45ee969ad9 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] No waiting events found dispatching network-vif-plugged-d89c793b-d55a-47b5-a857-bfb4b02d9781 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:19:40 user nova-compute[75080]: WARNING nova.compute.manager [req-0b2451eb-1518-40c7-b68d-c050ba6886d7 req-86acc436-d429-4869-9d1d-8e45ee969ad9 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received unexpected event network-vif-plugged-d89c793b-d55a-47b5-a857-bfb4b02d9781 for instance with vm_state building and task_state spawning.
Dec 05 15:19:40 user nova-compute[75080]: DEBUG nova.compute.manager [req-0b2451eb-1518-40c7-b68d-c050ba6886d7 req-86acc436-d429-4869-9d1d-8e45ee969ad9 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-plugged-d89c793b-d55a-47b5-a857-bfb4b02d9781 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:19:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0b2451eb-1518-40c7-b68d-c050ba6886d7 req-86acc436-d429-4869-9d1d-8e45ee969ad9 service nova] Acquiring lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0b2451eb-1518-40c7-b68d-c050ba6886d7 req-86acc436-d429-4869-9d1d-8e45ee969ad9 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0b2451eb-1518-40c7-b68d-c050ba6886d7 req-86acc436-d429-4869-9d1d-8e45ee969ad9 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:19:40 user nova-compute[75080]: DEBUG nova.compute.manager [req-0b2451eb-1518-40c7-b68d-c050ba6886d7 req-86acc436-d429-4869-9d1d-8e45ee969ad9 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] No waiting events found dispatching network-vif-plugged-d89c793b-d55a-47b5-a857-bfb4b02d9781 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:19:40 user nova-compute[75080]: WARNING nova.compute.manager [req-0b2451eb-1518-40c7-b68d-c050ba6886d7 req-86acc436-d429-4869-9d1d-8e45ee969ad9 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received unexpected event network-vif-plugged-d89c793b-d55a-47b5-a857-bfb4b02d9781 for instance with vm_state building and task_state spawning.
Dec 05 15:19:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:40 user nova-compute[75080]: DEBUG nova.compute.manager [req-3c76e366-b4a3-438a-a70c-b0b7b2f29cbf req-904bfda8-d16f-4c4d-b600-94eb9148fc10 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-plugged-eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:19:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-3c76e366-b4a3-438a-a70c-b0b7b2f29cbf req-904bfda8-d16f-4c4d-b600-94eb9148fc10 service nova] Acquiring lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-3c76e366-b4a3-438a-a70c-b0b7b2f29cbf req-904bfda8-d16f-4c4d-b600-94eb9148fc10 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-3c76e366-b4a3-438a-a70c-b0b7b2f29cbf req-904bfda8-d16f-4c4d-b600-94eb9148fc10 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:19:40 user nova-compute[75080]: DEBUG nova.compute.manager [req-3c76e366-b4a3-438a-a70c-b0b7b2f29cbf req-904bfda8-d16f-4c4d-b600-94eb9148fc10 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] No waiting events found dispatching network-vif-plugged-eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:19:40 user nova-compute[75080]: WARNING nova.compute.manager [req-3c76e366-b4a3-438a-a70c-b0b7b2f29cbf req-904bfda8-d16f-4c4d-b600-94eb9148fc10 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received unexpected event network-vif-plugged-eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c for instance with vm_state building and task_state spawning.
Dec 05 15:19:40 user nova-compute[75080]: DEBUG nova.compute.manager [req-3c76e366-b4a3-438a-a70c-b0b7b2f29cbf req-904bfda8-d16f-4c4d-b600-94eb9148fc10 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-plugged-eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:19:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-3c76e366-b4a3-438a-a70c-b0b7b2f29cbf req-904bfda8-d16f-4c4d-b600-94eb9148fc10 service nova] Acquiring lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-3c76e366-b4a3-438a-a70c-b0b7b2f29cbf req-904bfda8-d16f-4c4d-b600-94eb9148fc10 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-3c76e366-b4a3-438a-a70c-b0b7b2f29cbf req-904bfda8-d16f-4c4d-b600-94eb9148fc10 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:19:40 user nova-compute[75080]: DEBUG nova.compute.manager [req-3c76e366-b4a3-438a-a70c-b0b7b2f29cbf req-904bfda8-d16f-4c4d-b600-94eb9148fc10 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] No waiting events found dispatching network-vif-plugged-eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:19:40 user nova-compute[75080]: WARNING nova.compute.manager [req-3c76e366-b4a3-438a-a70c-b0b7b2f29cbf req-904bfda8-d16f-4c4d-b600-94eb9148fc10 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received unexpected event network-vif-plugged-eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c for instance with vm_state building and task_state spawning.
Dec 05 15:19:41 user nova-compute[75080]: DEBUG nova.compute.manager [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:19:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:19:41 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Instance spawned successfully.
Dec 05 15:19:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:19:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:19:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:19:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:19:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:19:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:19:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:19:41 user nova-compute[75080]: INFO nova.compute.manager [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Took 12.73 seconds to spawn the instance on the hypervisor.
Dec 05 15:19:41 user nova-compute[75080]: DEBUG nova.compute.manager [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:19:41 user nova-compute[75080]: INFO nova.compute.manager [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Took 46.55 seconds to build instance.
Dec 05 15:19:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-40839587-5242-47ff-bf84-eee1b627f5df tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Lock "912b0528-be16-427f-84fc-8a6cf89d5000" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 46.665s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:19:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:42 user nova-compute[75080]: DEBUG nova.compute.manager [req-4a8db9d9-1275-4c45-9681-6d731c026292 req-bccc1281-6c1d-486f-b248-2cc420d89aa2 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Received event network-changed-3e2379bd-6e97-45dc-917b-e8e4478a3be0 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:19:42 user nova-compute[75080]: DEBUG nova.compute.manager [req-4a8db9d9-1275-4c45-9681-6d731c026292 req-bccc1281-6c1d-486f-b248-2cc420d89aa2 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Refreshing instance network info cache due to event network-changed-3e2379bd-6e97-45dc-917b-e8e4478a3be0. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:19:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4a8db9d9-1275-4c45-9681-6d731c026292 req-bccc1281-6c1d-486f-b248-2cc420d89aa2 service nova] Acquiring lock "refresh_cache-0259351f-617f-47be-bfb6-2fef1c35bf15" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:19:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4a8db9d9-1275-4c45-9681-6d731c026292 req-bccc1281-6c1d-486f-b248-2cc420d89aa2 service nova] Acquired lock "refresh_cache-0259351f-617f-47be-bfb6-2fef1c35bf15" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:19:42 user nova-compute[75080]: DEBUG nova.network.neutron [req-4a8db9d9-1275-4c45-9681-6d731c026292 req-bccc1281-6c1d-486f-b248-2cc420d89aa2 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Refreshing network info cache for port 3e2379bd-6e97-45dc-917b-e8e4478a3be0 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:19:42 user nova-compute[75080]: DEBUG nova.compute.manager [req-19a1c266-9c33-4118-b210-33241e0881d9 req-ad1208b6-7ae2-4a4b-a94f-83e0e2de148c service nova] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Received event network-changed-74eb53ef-5ba7-4bd5-81af-d6adede99fad {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:19:42 user nova-compute[75080]: DEBUG nova.compute.manager [req-19a1c266-9c33-4118-b210-33241e0881d9 req-ad1208b6-7ae2-4a4b-a94f-83e0e2de148c service nova] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Refreshing instance network info cache due to event network-changed-74eb53ef-5ba7-4bd5-81af-d6adede99fad. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:19:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-19a1c266-9c33-4118-b210-33241e0881d9 req-ad1208b6-7ae2-4a4b-a94f-83e0e2de148c service nova] Acquiring lock "refresh_cache-a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:19:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-19a1c266-9c33-4118-b210-33241e0881d9 req-ad1208b6-7ae2-4a4b-a94f-83e0e2de148c service nova] Acquired lock "refresh_cache-a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:19:42 user nova-compute[75080]: DEBUG nova.network.neutron [req-19a1c266-9c33-4118-b210-33241e0881d9 req-ad1208b6-7ae2-4a4b-a94f-83e0e2de148c service nova] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Refreshing network info cache for port 74eb53ef-5ba7-4bd5-81af-d6adede99fad {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:19:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e5a0dc36-0295-4b21-b88c-6a8f0136bcf5 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Acquiring lock "interface-0259351f-617f-47be-bfb6-2fef1c35bf15-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e5a0dc36-0295-4b21-b88c-6a8f0136bcf5 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lock "interface-0259351f-617f-47be-bfb6-2fef1c35bf15-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:43 user nova-compute[75080]: DEBUG nova.objects.instance [None req-e5a0dc36-0295-4b21-b88c-6a8f0136bcf5 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lazy-loading 'flavor' on Instance uuid 0259351f-617f-47be-bfb6-2fef1c35bf15 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:19:43 user nova-compute[75080]: DEBUG nova.objects.instance [None req-e5a0dc36-0295-4b21-b88c-6a8f0136bcf5 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lazy-loading 'pci_requests' on Instance uuid 0259351f-617f-47be-bfb6-2fef1c35bf15 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:19:43 user nova-compute[75080]: DEBUG nova.objects.base [None req-e5a0dc36-0295-4b21-b88c-6a8f0136bcf5 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Object Instance<0259351f-617f-47be-bfb6-2fef1c35bf15> lazy-loaded attributes: flavor,pci_requests {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:19:43 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e5a0dc36-0295-4b21-b88c-6a8f0136bcf5 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:19:43 user nova-compute[75080]: DEBUG nova.policy [None req-e5a0dc36-0295-4b21-b88c-6a8f0136bcf5 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2bd4a8e35eed47d1b156037a6dda5668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e3fe3c0db24db598f947ebfe7a8b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:19:43 user nova-compute[75080]: DEBUG nova.network.neutron [req-4a8db9d9-1275-4c45-9681-6d731c026292 req-bccc1281-6c1d-486f-b248-2cc420d89aa2 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Updated VIF entry in instance network info cache for port 3e2379bd-6e97-45dc-917b-e8e4478a3be0. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:19:43 user nova-compute[75080]: DEBUG nova.network.neutron [req-4a8db9d9-1275-4c45-9681-6d731c026292 req-bccc1281-6c1d-486f-b248-2cc420d89aa2 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Updating instance_info_cache with network_info: [{"id": "3e2379bd-6e97-45dc-917b-e8e4478a3be0", "address": "fa:16:3e:68:6e:ba", "network": {"id": "1adc7b37-8fcb-4b25-92e7-e746874f778b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-490224437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24e3fe3c0db24db598f947ebfe7a8b3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2379bd-6e", "ovs_interfaceid": "3e2379bd-6e97-45dc-917b-e8e4478a3be0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:19:43 user nova-compute[75080]: DEBUG nova.network.neutron [req-19a1c266-9c33-4118-b210-33241e0881d9 req-ad1208b6-7ae2-4a4b-a94f-83e0e2de148c service nova] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Updated VIF entry in instance network info cache for port 74eb53ef-5ba7-4bd5-81af-d6adede99fad. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:19:43 user nova-compute[75080]: DEBUG nova.network.neutron [req-19a1c266-9c33-4118-b210-33241e0881d9 req-ad1208b6-7ae2-4a4b-a94f-83e0e2de148c service nova] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Updating instance_info_cache with network_info: [{"id": "74eb53ef-5ba7-4bd5-81af-d6adede99fad", "address": "fa:16:3e:91:12:8c", "network": {"id": "ecbc1165-663e-47ca-87c7-ecda194bb3cc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-140281562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b74a9586932440678d59170e174336a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74eb53ef-5b", "ovs_interfaceid": "74eb53ef-5ba7-4bd5-81af-d6adede99fad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:19:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4a8db9d9-1275-4c45-9681-6d731c026292 req-bccc1281-6c1d-486f-b248-2cc420d89aa2 service nova] Releasing lock "refresh_cache-0259351f-617f-47be-bfb6-2fef1c35bf15" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:19:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-19a1c266-9c33-4118-b210-33241e0881d9 req-ad1208b6-7ae2-4a4b-a94f-83e0e2de148c service nova] Releasing lock "refresh_cache-a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:19:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:44 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e5a0dc36-0295-4b21-b88c-6a8f0136bcf5 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Successfully created port: dcdd907f-231e-4ca4-97b6-23f980fa55d9 {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:19:44 user nova-compute[75080]: DEBUG nova.compute.manager [req-f10c7877-7ad9-438c-8323-34ef022bb217 req-0d2f920e-59d1-4865-a914-ccbf4ed6c495 service nova] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Received event network-changed-a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:19:44 user nova-compute[75080]: DEBUG nova.compute.manager [req-f10c7877-7ad9-438c-8323-34ef022bb217 req-0d2f920e-59d1-4865-a914-ccbf4ed6c495 service nova] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Refreshing instance network info cache due to event network-changed-a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:19:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f10c7877-7ad9-438c-8323-34ef022bb217 req-0d2f920e-59d1-4865-a914-ccbf4ed6c495 service nova] Acquiring lock "refresh_cache-f3cdfe20-7429-476d-9914-8141ba8b7488" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:19:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f10c7877-7ad9-438c-8323-34ef022bb217 req-0d2f920e-59d1-4865-a914-ccbf4ed6c495 service nova] Acquired lock "refresh_cache-f3cdfe20-7429-476d-9914-8141ba8b7488" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:19:44 user nova-compute[75080]: DEBUG nova.network.neutron [req-f10c7877-7ad9-438c-8323-34ef022bb217 req-0d2f920e-59d1-4865-a914-ccbf4ed6c495 service nova] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Refreshing network info cache for port a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:19:45 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e5a0dc36-0295-4b21-b88c-6a8f0136bcf5 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Successfully updated port: dcdd907f-231e-4ca4-97b6-23f980fa55d9 {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:19:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e5a0dc36-0295-4b21-b88c-6a8f0136bcf5 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Acquiring lock "refresh_cache-0259351f-617f-47be-bfb6-2fef1c35bf15" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:19:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e5a0dc36-0295-4b21-b88c-6a8f0136bcf5 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Acquired lock "refresh_cache-0259351f-617f-47be-bfb6-2fef1c35bf15" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:19:45 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e5a0dc36-0295-4b21-b88c-6a8f0136bcf5 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:19:45 user nova-compute[75080]: DEBUG nova.compute.manager [req-5b0fefbf-47c5-4a41-b9e4-c82455ef6d50 req-7a3bf9ad-f510-4308-a55f-5dd3b7867e52 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Received event network-changed-dcdd907f-231e-4ca4-97b6-23f980fa55d9 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:19:45 user nova-compute[75080]: DEBUG nova.compute.manager [req-5b0fefbf-47c5-4a41-b9e4-c82455ef6d50 req-7a3bf9ad-f510-4308-a55f-5dd3b7867e52 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Refreshing instance network info cache due to event network-changed-dcdd907f-231e-4ca4-97b6-23f980fa55d9. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:19:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5b0fefbf-47c5-4a41-b9e4-c82455ef6d50 req-7a3bf9ad-f510-4308-a55f-5dd3b7867e52 service nova] Acquiring lock "refresh_cache-0259351f-617f-47be-bfb6-2fef1c35bf15" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:19:45 user nova-compute[75080]: DEBUG nova.network.neutron [req-f10c7877-7ad9-438c-8323-34ef022bb217 req-0d2f920e-59d1-4865-a914-ccbf4ed6c495 service nova] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Updated VIF entry in instance network info cache for port a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:19:45 user nova-compute[75080]: DEBUG nova.network.neutron [req-f10c7877-7ad9-438c-8323-34ef022bb217 req-0d2f920e-59d1-4865-a914-ccbf4ed6c495 service nova] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Updating instance_info_cache with network_info: [{"id": "a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347", "address": "fa:16:3e:cd:52:36", "network": {"id": "eed25aef-3f43-4c98-8113-f5720a304787", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1510992179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e2a6722602c4978b5eb12cdce13bb1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa66b89bf-3d", "ovs_interfaceid": "a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:19:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f10c7877-7ad9-438c-8323-34ef022bb217 req-0d2f920e-59d1-4865-a914-ccbf4ed6c495 service nova] Releasing lock "refresh_cache-f3cdfe20-7429-476d-9914-8141ba8b7488" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:19:46 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e5a0dc36-0295-4b21-b88c-6a8f0136bcf5 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Updating instance_info_cache with network_info: [{"id": "3e2379bd-6e97-45dc-917b-e8e4478a3be0", "address": "fa:16:3e:68:6e:ba", "network": {"id": "1adc7b37-8fcb-4b25-92e7-e746874f778b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-490224437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24e3fe3c0db24db598f947ebfe7a8b3d", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2379bd-6e", "ovs_interfaceid": "3e2379bd-6e97-45dc-917b-e8e4478a3be0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dcdd907f-231e-4ca4-97b6-23f980fa55d9", "address": "fa:16:3e:3a:71:c4", "network": {"id": "c00c0358-c733-4598-b947-d6c502a0c5e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-376926346", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "24e3fe3c0db24db598f947ebfe7a8b3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcdd907f-23", "ovs_interfaceid": "dcdd907f-231e-4ca4-97b6-23f980fa55d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:19:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e5a0dc36-0295-4b21-b88c-6a8f0136bcf5 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Releasing lock "refresh_cache-0259351f-617f-47be-bfb6-2fef1c35bf15" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:19:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5b0fefbf-47c5-4a41-b9e4-c82455ef6d50 req-7a3bf9ad-f510-4308-a55f-5dd3b7867e52 service nova] Acquired lock "refresh_cache-0259351f-617f-47be-bfb6-2fef1c35bf15" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:19:46 user nova-compute[75080]: DEBUG nova.network.neutron [req-5b0fefbf-47c5-4a41-b9e4-c82455ef6d50 req-7a3bf9ad-f510-4308-a55f-5dd3b7867e52 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Refreshing network info cache for port dcdd907f-231e-4ca4-97b6-23f980fa55d9 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:19:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-e5a0dc36-0295-4b21-b88c-6a8f0136bcf5 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-640774861',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-640774861',id=4,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOcchwMQ/y1AsP3A0b3QpAgR94U3k1ch+DL7mOp5G4Jk3dTtQRet9PTuUq+tE9S2nFGwMJzhzoriFDCKnxJ67e/D1DfTAZHVMm0T9FYpXt1Eg6HZqWa1ZIEyx+Gye4eIQ==',key_name='tempest-keypair-1279310443',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:18:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='24e3fe3c0db24db598f947ebfe7a8b3d',ramdisk_id='',reservation_id='r-yuqxc4c9',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1860660485',owner_user_name='tempest-TaggedAttachmentsTest-1860660485-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:18:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bd4a8e35eed47d1b156037a6dda5668',uuid=0259351f-617f-47be-bfb6-2fef1c35bf15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dcdd907f-231e-4ca4-97b6-23f980fa55d9", "address": "fa:16:3e:3a:71:c4", "network": {"id": "c00c0358-c733-4598-b947-d6c502a0c5e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-376926346", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "24e3fe3c0db24db598f947ebfe7a8b3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcdd907f-23", "ovs_interfaceid": "dcdd907f-231e-4ca4-97b6-23f980fa55d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:19:46 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-e5a0dc36-0295-4b21-b88c-6a8f0136bcf5 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Converting VIF {"id": "dcdd907f-231e-4ca4-97b6-23f980fa55d9", "address": "fa:16:3e:3a:71:c4", "network": {"id": "c00c0358-c733-4598-b947-d6c502a0c5e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-376926346", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "24e3fe3c0db24db598f947ebfe7a8b3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcdd907f-23", "ovs_interfaceid": "dcdd907f-231e-4ca4-97b6-23f980fa55d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:19:46 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-e5a0dc36-0295-4b21-b88c-6a8f0136bcf5 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:71:c4,bridge_name='br-int',has_traffic_filtering=True,id=dcdd907f-231e-4ca4-97b6-23f980fa55d9,network=Network(c00c0358-c733-4598-b947-d6c502a0c5e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcdd907f-23') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:19:46 user nova-compute[75080]: DEBUG os_vif [None req-e5a0dc36-0295-4b21-b88c-6a8f0136bcf5 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:71:c4,bridge_name='br-int',has_traffic_filtering=True,id=dcdd907f-231e-4ca4-97b6-23f980fa55d9,network=Network(c00c0358-c733-4598-b947-d6c502a0c5e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcdd907f-23') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:19:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:19:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '317223b7-1b1a-58ae-9088-2df77288d806', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:19:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdcdd907f-23, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdcdd907f-23, col_values=(('qos', UUID('f763ab12-efd1-4016-89f8-d08783cf1ea1')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdcdd907f-23, col_values=(('external_ids', {'iface-id': 'dcdd907f-231e-4ca4-97b6-23f980fa55d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:71:c4', 'vm-uuid': '0259351f-617f-47be-bfb6-2fef1c35bf15'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:19:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:19:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:46 user nova-compute[75080]: INFO os_vif [None req-e5a0dc36-0295-4b21-b88c-6a8f0136bcf5 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:71:c4,bridge_name='br-int',has_traffic_filtering=True,id=dcdd907f-231e-4ca4-97b6-23f980fa55d9,network=Network(c00c0358-c733-4598-b947-d6c502a0c5e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcdd907f-23')
Dec 05 15:19:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-e5a0dc36-0295-4b21-b88c-6a8f0136bcf5 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-640774861',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-640774861',id=4,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOcchwMQ/y1AsP3A0b3QpAgR94U3k1ch+DL7mOp5G4Jk3dTtQRet9PTuUq+tE9S2nFGwMJzhzoriFDCKnxJ67e/D1DfTAZHVMm0T9FYpXt1Eg6HZqWa1ZIEyx+Gye4eIQ==',key_name='tempest-keypair-1279310443',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:18:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='24e3fe3c0db24db598f947ebfe7a8b3d',ramdisk_id='',reservation_id='r-yuqxc4c9',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1860660485',owner_user_name='tempest-TaggedAttachmentsTest-1860660485-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:18:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bd4a8e35eed47d1b156037a6dda5668',uuid=0259351f-617f-47be-bfb6-2fef1c35bf15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dcdd907f-231e-4ca4-97b6-23f980fa55d9", "address": "fa:16:3e:3a:71:c4", "network": {"id": "c00c0358-c733-4598-b947-d6c502a0c5e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-376926346", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "24e3fe3c0db24db598f947ebfe7a8b3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcdd907f-23", "ovs_interfaceid": "dcdd907f-231e-4ca4-97b6-23f980fa55d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:19:46 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-e5a0dc36-0295-4b21-b88c-6a8f0136bcf5 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Converting VIF {"id": "dcdd907f-231e-4ca4-97b6-23f980fa55d9", "address": "fa:16:3e:3a:71:c4", "network": {"id": "c00c0358-c733-4598-b947-d6c502a0c5e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-376926346", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "24e3fe3c0db24db598f947ebfe7a8b3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcdd907f-23", "ovs_interfaceid": "dcdd907f-231e-4ca4-97b6-23f980fa55d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:19:46 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-e5a0dc36-0295-4b21-b88c-6a8f0136bcf5 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:71:c4,bridge_name='br-int',has_traffic_filtering=True,id=dcdd907f-231e-4ca4-97b6-23f980fa55d9,network=Network(c00c0358-c733-4598-b947-d6c502a0c5e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcdd907f-23') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:19:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-e5a0dc36-0295-4b21-b88c-6a8f0136bcf5 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] attach device xml: <interface type="ethernet">
Dec 05 15:19:46 user nova-compute[75080]:   <mac address="fa:16:3e:3a:71:c4"/>
Dec 05 15:19:46 user nova-compute[75080]:   <model type="virtio"/>
Dec 05 15:19:46 user nova-compute[75080]:   <mtu size="1442"/>
Dec 05 15:19:46 user nova-compute[75080]:   <target dev="tapdcdd907f-23"/>
Dec 05 15:19:46 user nova-compute[75080]: </interface>
Dec 05 15:19:46 user nova-compute[75080]:  {{(pid=75080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 15:19:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:47 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e5a0dc36-0295-4b21-b88c-6a8f0136bcf5 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:19:47 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e5a0dc36-0295-4b21-b88c-6a8f0136bcf5 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] No BDM found with device name hda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:19:47 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e5a0dc36-0295-4b21-b88c-6a8f0136bcf5 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] No VIF found with MAC fa:16:3e:68:6e:ba, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:19:47 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-e5a0dc36-0295-4b21-b88c-6a8f0136bcf5 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:19:47 user nova-compute[75080]:   <nova:package version="0.0.0"/>
Dec 05 15:19:47 user nova-compute[75080]:   <nova:name>tempest-device-tagging-server-640774861</nova:name>
Dec 05 15:19:47 user nova-compute[75080]:   <nova:creationTime>2023-12-05 15:19:47</nova:creationTime>
Dec 05 15:19:47 user nova-compute[75080]:   <nova:flavor name="m1.tiny">
Dec 05 15:19:47 user nova-compute[75080]:     <nova:memory>512</nova:memory>
Dec 05 15:19:47 user nova-compute[75080]:     <nova:disk>1</nova:disk>
Dec 05 15:19:47 user nova-compute[75080]:     <nova:swap>0</nova:swap>
Dec 05 15:19:47 user nova-compute[75080]:     <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:19:47 user nova-compute[75080]:     <nova:vcpus>1</nova:vcpus>
Dec 05 15:19:47 user nova-compute[75080]:   </nova:flavor>
Dec 05 15:19:47 user nova-compute[75080]:   <nova:owner>
Dec 05 15:19:47 user nova-compute[75080]:     <nova:user uuid="2bd4a8e35eed47d1b156037a6dda5668">tempest-TaggedAttachmentsTest-1860660485-project-member</nova:user>
Dec 05 15:19:47 user nova-compute[75080]:     <nova:project uuid="24e3fe3c0db24db598f947ebfe7a8b3d">tempest-TaggedAttachmentsTest-1860660485</nova:project>
Dec 05 15:19:47 user nova-compute[75080]:   </nova:owner>
Dec 05 15:19:47 user nova-compute[75080]:   <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:19:47 user nova-compute[75080]:   <nova:ports>
Dec 05 15:19:47 user nova-compute[75080]:     <nova:port uuid="3e2379bd-6e97-45dc-917b-e8e4478a3be0">
Dec 05 15:19:47 user nova-compute[75080]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 05 15:19:47 user nova-compute[75080]:     </nova:port>
Dec 05 15:19:47 user nova-compute[75080]:     <nova:port uuid="dcdd907f-231e-4ca4-97b6-23f980fa55d9">
Dec 05 15:19:47 user nova-compute[75080]:       <nova:ip type="fixed" address="10.10.10.34" ipVersion="4"/>
Dec 05 15:19:47 user nova-compute[75080]:     </nova:port>
Dec 05 15:19:47 user nova-compute[75080]:   </nova:ports>
Dec 05 15:19:47 user nova-compute[75080]: </nova:instance>
Dec 05 15:19:47 user nova-compute[75080]:  {{(pid=75080) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Dec 05 15:19:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e5a0dc36-0295-4b21-b88c-6a8f0136bcf5 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lock "interface-0259351f-617f-47be-bfb6-2fef1c35bf15-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.096s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:19:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:47 user nova-compute[75080]: DEBUG nova.network.neutron [req-5b0fefbf-47c5-4a41-b9e4-c82455ef6d50 req-7a3bf9ad-f510-4308-a55f-5dd3b7867e52 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Updated VIF entry in instance network info cache for port dcdd907f-231e-4ca4-97b6-23f980fa55d9. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:19:47 user nova-compute[75080]: DEBUG nova.network.neutron [req-5b0fefbf-47c5-4a41-b9e4-c82455ef6d50 req-7a3bf9ad-f510-4308-a55f-5dd3b7867e52 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Updating instance_info_cache with network_info: [{"id": "3e2379bd-6e97-45dc-917b-e8e4478a3be0", "address": "fa:16:3e:68:6e:ba", "network": {"id": "1adc7b37-8fcb-4b25-92e7-e746874f778b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-490224437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24e3fe3c0db24db598f947ebfe7a8b3d", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2379bd-6e", "ovs_interfaceid": "3e2379bd-6e97-45dc-917b-e8e4478a3be0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dcdd907f-231e-4ca4-97b6-23f980fa55d9", "address": "fa:16:3e:3a:71:c4", "network": {"id": "c00c0358-c733-4598-b947-d6c502a0c5e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-376926346", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "24e3fe3c0db24db598f947ebfe7a8b3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcdd907f-23", "ovs_interfaceid": "dcdd907f-231e-4ca4-97b6-23f980fa55d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:19:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5b0fefbf-47c5-4a41-b9e4-c82455ef6d50 req-7a3bf9ad-f510-4308-a55f-5dd3b7867e52 service nova] Releasing lock "refresh_cache-0259351f-617f-47be-bfb6-2fef1c35bf15" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:19:47 user nova-compute[75080]: DEBUG nova.compute.manager [req-5883a560-6ac9-4204-a7b1-fa6d96a24944 req-be9644a9-f125-45f0-bc73-54ccf802ad0c service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Received event network-vif-plugged-dcdd907f-231e-4ca4-97b6-23f980fa55d9 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:19:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5883a560-6ac9-4204-a7b1-fa6d96a24944 req-be9644a9-f125-45f0-bc73-54ccf802ad0c service nova] Acquiring lock "0259351f-617f-47be-bfb6-2fef1c35bf15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5883a560-6ac9-4204-a7b1-fa6d96a24944 req-be9644a9-f125-45f0-bc73-54ccf802ad0c service nova] Lock "0259351f-617f-47be-bfb6-2fef1c35bf15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5883a560-6ac9-4204-a7b1-fa6d96a24944 req-be9644a9-f125-45f0-bc73-54ccf802ad0c service nova] Lock "0259351f-617f-47be-bfb6-2fef1c35bf15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:19:47 user nova-compute[75080]: DEBUG nova.compute.manager [req-5883a560-6ac9-4204-a7b1-fa6d96a24944 req-be9644a9-f125-45f0-bc73-54ccf802ad0c service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] No waiting events found dispatching network-vif-plugged-dcdd907f-231e-4ca4-97b6-23f980fa55d9 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:19:47 user nova-compute[75080]: WARNING nova.compute.manager [req-5883a560-6ac9-4204-a7b1-fa6d96a24944 req-be9644a9-f125-45f0-bc73-54ccf802ad0c service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Received unexpected event network-vif-plugged-dcdd907f-231e-4ca4-97b6-23f980fa55d9 for instance with vm_state active and task_state None.
Dec 05 15:19:47 user nova-compute[75080]: DEBUG nova.compute.manager [req-5883a560-6ac9-4204-a7b1-fa6d96a24944 req-be9644a9-f125-45f0-bc73-54ccf802ad0c service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Received event network-vif-plugged-dcdd907f-231e-4ca4-97b6-23f980fa55d9 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:19:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5883a560-6ac9-4204-a7b1-fa6d96a24944 req-be9644a9-f125-45f0-bc73-54ccf802ad0c service nova] Acquiring lock "0259351f-617f-47be-bfb6-2fef1c35bf15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5883a560-6ac9-4204-a7b1-fa6d96a24944 req-be9644a9-f125-45f0-bc73-54ccf802ad0c service nova] Lock "0259351f-617f-47be-bfb6-2fef1c35bf15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5883a560-6ac9-4204-a7b1-fa6d96a24944 req-be9644a9-f125-45f0-bc73-54ccf802ad0c service nova] Lock "0259351f-617f-47be-bfb6-2fef1c35bf15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:19:47 user nova-compute[75080]: DEBUG nova.compute.manager [req-5883a560-6ac9-4204-a7b1-fa6d96a24944 req-be9644a9-f125-45f0-bc73-54ccf802ad0c service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] No waiting events found dispatching network-vif-plugged-dcdd907f-231e-4ca4-97b6-23f980fa55d9 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:19:47 user nova-compute[75080]: WARNING nova.compute.manager [req-5883a560-6ac9-4204-a7b1-fa6d96a24944 req-be9644a9-f125-45f0-bc73-54ccf802ad0c service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Received unexpected event network-vif-plugged-dcdd907f-231e-4ca4-97b6-23f980fa55d9 for instance with vm_state active and task_state None.
Dec 05 15:19:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Acquiring lock "0259351f-617f-47be-bfb6-2fef1c35bf15" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lock "0259351f-617f-47be-bfb6-2fef1c35bf15" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:47 user nova-compute[75080]: DEBUG nova.objects.instance [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lazy-loading 'flavor' on Instance uuid 0259351f-617f-47be-bfb6-2fef1c35bf15 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:19:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lock "0259351f-617f-47be-bfb6-2fef1c35bf15" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.096s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:19:47 user nova-compute[75080]: DEBUG nova.compute.manager [req-2744f51d-21cc-4686-a685-aa00bb0033bb req-9e4478e9-da5b-4469-9286-0d97918d0596 service nova] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Received event network-changed-fe1ce7fc-22e0-4814-b15f-c3e9f82574b6 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:19:47 user nova-compute[75080]: DEBUG nova.compute.manager [req-2744f51d-21cc-4686-a685-aa00bb0033bb req-9e4478e9-da5b-4469-9286-0d97918d0596 service nova] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Refreshing instance network info cache due to event network-changed-fe1ce7fc-22e0-4814-b15f-c3e9f82574b6. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:19:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2744f51d-21cc-4686-a685-aa00bb0033bb req-9e4478e9-da5b-4469-9286-0d97918d0596 service nova] Acquiring lock "refresh_cache-1830878a-71e0-48f1-85b8-9ed83b1419cd" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:19:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2744f51d-21cc-4686-a685-aa00bb0033bb req-9e4478e9-da5b-4469-9286-0d97918d0596 service nova] Acquired lock "refresh_cache-1830878a-71e0-48f1-85b8-9ed83b1419cd" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:19:47 user nova-compute[75080]: DEBUG nova.network.neutron [req-2744f51d-21cc-4686-a685-aa00bb0033bb req-9e4478e9-da5b-4469-9286-0d97918d0596 service nova] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Refreshing network info cache for port fe1ce7fc-22e0-4814-b15f-c3e9f82574b6 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:19:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Acquiring lock "0259351f-617f-47be-bfb6-2fef1c35bf15" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lock "0259351f-617f-47be-bfb6-2fef1c35bf15" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:47 user nova-compute[75080]: INFO nova.compute.manager [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Attaching volume 43e9addf-dbf2-48a8-bcd9-c578e7f7c570 to /dev/vdb
Dec 05 15:19:48 user nova-compute[75080]: DEBUG os_brick.utils [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.042s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c95cf6-5f0a-487b-af53-b07d91fff9c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5fa851-1605-46c9-8ac7-6b772f2a1d0e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Acquiring lock "f3cdfe20-7429-476d-9914-8141ba8b7488" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Lock "f3cdfe20-7429-476d-9914-8141ba8b7488" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e42ce1b-dd57-47f7-8772-8b7656f3987e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Acquiring lock "1830878a-71e0-48f1-85b8-9ed83b1419cd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Lock "1830878a-71e0-48f1-85b8-9ed83b1419cd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[54240979-fc63-41c7-8398-d58dba594910]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG nova.objects.instance [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Lazy-loading 'flavor' on Instance uuid f3cdfe20-7429-476d-9914-8141ba8b7488 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG nova.objects.instance [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Lazy-loading 'flavor' on Instance uuid 1830878a-71e0-48f1-85b8-9ed83b1419cd {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:19:48 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:19:48 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fd1526-7c1c-4e0b-8018-fc2aa852a5cd]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG os_brick.utils [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] <== get_connector_properties: return (213ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Updating existing volume attachment record: 96614280-9d5e-489d-be94-4c40343f2e7c {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Lock "f3cdfe20-7429-476d-9914-8141ba8b7488" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.132s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Lock "1830878a-71e0-48f1-85b8-9ed83b1419cd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.148s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Acquiring lock "a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG nova.objects.instance [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lazy-loading 'flavor' on Instance uuid a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Acquiring lock "f3cdfe20-7429-476d-9914-8141ba8b7488" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Lock "f3cdfe20-7429-476d-9914-8141ba8b7488" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:48 user nova-compute[75080]: INFO nova.compute.manager [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Attaching volume ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 to /dev/sdc
Dec 05 15:19:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.145s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Acquiring lock "1830878a-71e0-48f1-85b8-9ed83b1419cd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Lock "1830878a-71e0-48f1-85b8-9ed83b1419cd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:48 user nova-compute[75080]: INFO nova.compute.manager [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Attaching volume 22aea242-c46e-4ce0-bc46-c34a56465dd9 to /dev/vdb
Dec 05 15:19:48 user nova-compute[75080]: DEBUG os_brick.utils [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG os_brick.utils [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e435c1ac-93ca-436a-945e-e6374fa30b39]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Acquiring lock "a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:19:48 user nova-compute[75080]: INFO nova.compute.manager [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Attaching volume 0f18db39-ee9a-4f2d-a3cf-7609453eec5e to /dev/vdb
Dec 05 15:19:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:48 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[422ad307-4a28-4d48-9e44-ca1e4033d144]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37750d5-01a8-493c-bdb2-c9d49a82249c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[61938913-807b-4e66-bde0-46c3a7f9d405]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac7c07e-d675-4397-a0b7-7aa39d76ff5e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG nova.network.neutron [req-2744f51d-21cc-4686-a685-aa00bb0033bb req-9e4478e9-da5b-4469-9286-0d97918d0596 service nova] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Updated VIF entry in instance network info cache for port fe1ce7fc-22e0-4814-b15f-c3e9f82574b6. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG nova.network.neutron [req-2744f51d-21cc-4686-a685-aa00bb0033bb req-9e4478e9-da5b-4469-9286-0d97918d0596 service nova] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Updating instance_info_cache with network_info: [{"id": "fe1ce7fc-22e0-4814-b15f-c3e9f82574b6", "address": "fa:16:3e:ad:48:50", "network": {"id": "ab471423-0f49-4695-a2d0-76abb88aec8e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-408483206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e445361a61f44659ba229fd8c053d736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1ce7fc-22", "ovs_interfaceid": "fe1ce7fc-22e0-4814-b15f-c3e9f82574b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG os_brick.utils [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd77342-a4fb-42c7-ab3d-baf0478bc656]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f67faa-eb9e-4572-bcc9-6f5f2afc036e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1256ef49-21bf-4446-bdd1-b1e1d6c10d01]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2744f51d-21cc-4686-a685-aa00bb0033bb req-9e4478e9-da5b-4469-9286-0d97918d0596 service nova] Releasing lock "refresh_cache-1830878a-71e0-48f1-85b8-9ed83b1419cd" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b01b773-b5eb-4993-8786-6a9402ec1b49]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b03875-7fc2-4f17-9936-6506e1aff73d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:19:49 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:19:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acd2d3e-d3cc-4909-a450-4f5cd901aaa3]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG os_brick.utils [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] <== get_connector_properties: return (212ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Updating existing volume attachment record: e1635d88-1926-442b-a289-8fc9bf32d68e {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cf6cb7-aece-415b-88bb-e2559d30091d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:49 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:19:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15944e2-3433-4527-b73e-abd79b1c0a36]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG os_brick.utils [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] <== get_connector_properties: return (231ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Updating existing volume attachment record: 5c25805d-12e4-49c3-938a-cad300756209 {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46fdb77-7d10-45da-9687-bd8f97ae8c8e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:19:49 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:19:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[99639d3d-2eb9-4ad8-8636-f988a9e130a8]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG os_brick.utils [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] <== get_connector_properties: return (210ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:19:49 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Updating existing volume attachment record: 65689e66-10ed-4127-9848-799bba76c079 {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:19:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:19:58 user nova-compute[75080]: DEBUG nova.compute.manager [req-abde8e71-7bfe-4542-98fc-fa828808072b req-eaf000bf-ed9c-4f23-9290-7c9a3130358d service nova] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Received event network-changed-1ba3c430-69cf-40e7-bfe4-f12fb016fcc6 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:19:58 user nova-compute[75080]: DEBUG nova.compute.manager [req-abde8e71-7bfe-4542-98fc-fa828808072b req-eaf000bf-ed9c-4f23-9290-7c9a3130358d service nova] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Refreshing instance network info cache due to event network-changed-1ba3c430-69cf-40e7-bfe4-f12fb016fcc6. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:19:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-abde8e71-7bfe-4542-98fc-fa828808072b req-eaf000bf-ed9c-4f23-9290-7c9a3130358d service nova] Acquiring lock "refresh_cache-33078a88-4858-4c6b-bfa9-c3d9b83cf78b" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:19:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-abde8e71-7bfe-4542-98fc-fa828808072b req-eaf000bf-ed9c-4f23-9290-7c9a3130358d service nova] Acquired lock "refresh_cache-33078a88-4858-4c6b-bfa9-c3d9b83cf78b" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:19:58 user nova-compute[75080]: DEBUG nova.network.neutron [req-abde8e71-7bfe-4542-98fc-fa828808072b req-eaf000bf-ed9c-4f23-9290-7c9a3130358d service nova] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Refreshing network info cache for port 1ba3c430-69cf-40e7-bfe4-f12fb016fcc6 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:19:58 user nova-compute[75080]: DEBUG nova.network.neutron [req-abde8e71-7bfe-4542-98fc-fa828808072b req-eaf000bf-ed9c-4f23-9290-7c9a3130358d service nova] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Updated VIF entry in instance network info cache for port 1ba3c430-69cf-40e7-bfe4-f12fb016fcc6. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:19:58 user nova-compute[75080]: DEBUG nova.network.neutron [req-abde8e71-7bfe-4542-98fc-fa828808072b req-eaf000bf-ed9c-4f23-9290-7c9a3130358d service nova] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Updating instance_info_cache with network_info: [{"id": "1ba3c430-69cf-40e7-bfe4-f12fb016fcc6", "address": "fa:16:3e:35:a9:ee", "network": {"id": "c3560d36-b0b7-4e66-a452-fd50e56003f9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1825133181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc2b129bb5af4ea9844c6eb1ac0e892b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ba3c430-69", "ovs_interfaceid": "1ba3c430-69cf-40e7-bfe4-f12fb016fcc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:19:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-abde8e71-7bfe-4542-98fc-fa828808072b req-eaf000bf-ed9c-4f23-9290-7c9a3130358d service nova] Releasing lock "refresh_cache-33078a88-4858-4c6b-bfa9-c3d9b83cf78b" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jfDBzNcE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:19:59 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:19:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:19:59 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:19:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:19:59 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:19:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f15716-d37f-4a6c-963f-b6c2f35de50c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:19:59 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb8c09a-cce9-42e3-928c-b91a0eb7d814]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9] added
Dec 05 15:19:59 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f373dfb0-163b-4029-9004-ffb800cb3869]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.054s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[795debc1-ffd9-4a55-9431-fc0691e18526]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jfDBzNcE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jfDBzNcE" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df4e9fb-0691-48c4-b68b-037caec63e41]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jfDBzNcE'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5db6eb7-8bdc-458d-8082-43efecd0ca8b]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53b53b2-8b4c-4fb1-b931-03253f04aded]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:19:59 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:19:59 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:19:59 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:19:59 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:19:59 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:19:59 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:19:59 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:19:59 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --login" returned: 0 in 0.118s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c24b6c-70e4-417b-a25d-65927b171dba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9, portal: 172.16.0.220,3260]
Dec 05 15:19:59 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9, portal: 172.16.0.220,3260] successful.
Dec 05 15:19:59 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[217780b3-8af1-40ff-b4e9-aa056b9efc26]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85302f8-9a19-4e9a-a10f-5f862f338c97]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:19:59 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:19:59 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:19:59 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:19:59 user nova-compute[75080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)
Dec 05 15:19:59 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:19:59 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:19:59 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:19:59 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:19:59 user nova-compute[75080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)
Dec 05 15:19:59 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89c5fb8-dec8-4f81-b32a-7e8c0f24b278]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:19:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jfDBzNcE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:20:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.424s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:20:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] <== connect_volume: return (1425ms) {'type': 'block', 'scsi_wwn': '26130333132393463', 'path': '/dev/sdf'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:20:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130333132393463', 'path': '/dev/sdf'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:20:00 user nova-compute[75080]: DEBUG nova.objects.instance [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Lazy-loading 'flavor' on Instance uuid 1830878a-71e0-48f1-85b8-9ed83b1419cd {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:20:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 15:20:01 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:20:01 user nova-compute[75080]:   <source dev="/dev/sdf"/>
Dec 05 15:20:01 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:20:01 user nova-compute[75080]:   <serial>22aea242-c46e-4ce0-bc46-c34a56465dd9</serial>
Dec 05 15:20:01 user nova-compute[75080]: </disk>
Dec 05 15:20:01 user nova-compute[75080]:  {{(pid=75080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 15:20:01 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:20:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:20:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] No VIF found with MAC fa:16:3e:ad:48:50, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:20:01 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:06 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:06 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:20:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mPlpRaDQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:20:08 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:20:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:20:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:20:08 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:20:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:20:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:20:08 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:20:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d7ebdd-c58a-44ef-984e-220f44b0922a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:20:08 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:20:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIXbkzSN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:20:08 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:20:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:20:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa59d125-4db9-4199-bee1-1961723281ad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570] added
Dec 05 15:20:08 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ff49f6-466f-48de-a7d0-9b79c4262bfe]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe1b27e-933c-4c87-ba78-e1b490385a24]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mPlpRaDQ {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mPlpRaDQ" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcafe37-4012-4fec-9424-8be30a20e68a]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mPlpRaDQ'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58f1c27-efa7-44e9-8014-28ac87247957]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9273899-d85a-40bf-9a1e-817d0f0e2ad0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:08 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:20:08 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:20:08 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:20:08 user nova-compute[75080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)
Dec 05 15:20:08 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:20:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:08 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:20:08 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:20:08 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:20:08 user nova-compute[75080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)
Dec 05 15:20:08 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:20:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Acquiring lock "33078a88-4858-4c6b-bfa9-c3d9b83cf78b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Lock "33078a88-4858-4c6b-bfa9-c3d9b83cf78b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:08 user nova-compute[75080]: DEBUG nova.objects.instance [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Lazy-loading 'flavor' on Instance uuid 33078a88-4858-4c6b-bfa9-c3d9b83cf78b {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e972e9c4-e695-4cb0-bda1-24c126aa8174 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Lock "1830878a-71e0-48f1-85b8-9ed83b1419cd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.529s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Lock "33078a88-4858-4c6b-bfa9-c3d9b83cf78b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e374f4a1-bd89-469f-b0fb-1088281738c3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570, portal: 172.16.0.220,3260]
Dec 05 15:20:09 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570, portal: 172.16.0.220,3260] successful.
Dec 05 15:20:09 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d2f850-d2cd-4558-9bc0-4b352ee47624]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf02b390-87c3-4ce5-a8bb-0e9eb12bb708]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:09 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:20:09 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:20:09 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:20:09 user nova-compute[75080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)
Dec 05 15:20:09 user nova-compute[75080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 (non-flash)
Dec 05 15:20:09 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:09 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:20:09 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:20:09 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:20:09 user nova-compute[75080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)
Dec 05 15:20:09 user nova-compute[75080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 (non-flash)
Dec 05 15:20:09 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5332fa9-bb8c-4d09-a846-f27f35465aa5]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mPlpRaDQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Acquiring lock "33078a88-4858-4c6b-bfa9-c3d9b83cf78b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Lock "33078a88-4858-4c6b-bfa9-c3d9b83cf78b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:09 user nova-compute[75080]: INFO nova.compute.manager [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Attaching volume 892c0e92-c044-4b58-a91f-e139c8788d5a to /dev/vdb
Dec 05 15:20:09 user nova-compute[75080]: DEBUG os_brick.utils [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4baa0bc-8be3-41e0-90cc-8338bf63af29]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3e45f4-19b7-4df2-94ae-2d98ebd5ad5e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b3bfc0-da5e-400e-8dd0-2d168e4ca888]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[178111a7-d985-477b-b890-0c6b2f2e182e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:20:09 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:20:09 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4b820e-76b7-4845-ad46-91179947f26f]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG os_brick.utils [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:20:09 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Updating existing volume attachment record: 8dca3cfb-9c61-4154-afac-3f323df8e3d6 {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QUlnuBiN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:20:10 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:20:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23366323764376131', 'path': '/dev/sdg'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366323764376131', 'path': '/dev/sdg'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.331s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:20:10 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:20:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:20:10 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG nova.objects.instance [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lazy-loading 'flavor' on Instance uuid 0259351f-617f-47be-bfb6-2fef1c35bf15 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[84be030a-826f-4d4e-a3a7-997944d1ebb6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:20:10 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6570f9fd-1cc4-4cf1-be4f-6305c4f4be67]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8] added
Dec 05 15:20:10 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 15:20:10 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:20:10 user nova-compute[75080]:   <source dev="/dev/sdg"/>
Dec 05 15:20:10 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:20:10 user nova-compute[75080]:   <serial>43e9addf-dbf2-48a8-bcd9-c578e7f7c570</serial>
Dec 05 15:20:10 user nova-compute[75080]: </disk>
Dec 05 15:20:10 user nova-compute[75080]:  {{(pid=75080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5399fe0c-0db7-477f-8760-68cabe46baa4]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38464ef-1618-49c1-afa8-10ed1a76c564]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LIXbkzSN {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LIXbkzSN" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6dd2f40-1250-4926-b43e-04045c34cc38]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LIXbkzSN'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e144c76e-5832-4bee-a87d-c082070536d8]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed93335-e0bd-4228-a307-722c902669b0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:10 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:20:10 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:20:10 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:20:10 user nova-compute[75080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)
Dec 05 15:20:10 user nova-compute[75080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 (non-flash)
Dec 05 15:20:10 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:10 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:20:10 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:20:10 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:20:10 user nova-compute[75080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)
Dec 05 15:20:10 user nova-compute[75080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 (non-flash)
Dec 05 15:20:10 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[576bf180-c9ba-43db-a0ac-65b7ce86077c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8, portal: 172.16.0.220,3260]
Dec 05 15:20:10 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8, portal: 172.16.0.220,3260] successful.
Dec 05 15:20:10 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fd43ea-21df-4bb0-baa1-2b2c116fdf93]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8556985-0ec3-4a9b-a388-bae7ef2a31cf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:10 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:20:10 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:20:10 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:20:10 user nova-compute[75080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)
Dec 05 15:20:10 user nova-compute[75080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 (non-flash)
Dec 05 15:20:10 user nova-compute[75080]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 (non-flash)
Dec 05 15:20:10 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:10 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:20:10 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:20:10 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:20:10 user nova-compute[75080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)
Dec 05 15:20:10 user nova-compute[75080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 (non-flash)
Dec 05 15:20:10 user nova-compute[75080]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 (non-flash)
Dec 05 15:20:10 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[79279f6c-c364-428f-9fc7-44e6b7987293]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIXbkzSN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] No BDM found with device name hda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] No VIF found with MAC fa:16:3e:68:6e:ba, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-de3b84bc-98d8-4ba8-9da6-4d2bc97991e3 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lock "0259351f-617f-47be-bfb6-2fef1c35bf15" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.795s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Acquiring lock "1830878a-71e0-48f1-85b8-9ed83b1419cd" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Lock "1830878a-71e0-48f1-85b8-9ed83b1419cd" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG os_brick.utils [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[020f87a8-23a8-42ea-8b33-7e381d861b01]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c1afe6-dc0d-4df9-a599-75634cd9a668]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b351b84-d791-42b2-8a04-2a684ada2bb2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ed4028-c034-488f-aaba-66780a0b94f0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:20:11 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:20:11 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f84dcd1-1ba2-427d-b48e-346ee1f0bf13]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG os_brick.utils [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:20:11 user nova-compute[75080]: INFO nova.compute.manager [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Swapping volume 22aea242-c46e-4ce0-bc46-c34a56465dd9 for dd92e10f-dace-4099-ba5d-c7fcbe8a1867
Dec 05 15:20:11 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] <== connect_volume: return (2687ms) {'type': 'block', 'scsi_wwn': '26534326437663866', 'path': '/dev/sdh'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534326437663866', 'path': '/dev/sdh'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.411s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:20:11 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:20:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:20:11 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:20:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG nova.objects.instance [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Lazy-loading 'flavor' on Instance uuid f3cdfe20-7429-476d-9914-8141ba8b7488 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a2b367-8b81-4295-91fc-742d5222b936]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:20:11 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 15:20:11 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:20:11 user nova-compute[75080]:   <source dev="/dev/sdh"/>
Dec 05 15:20:11 user nova-compute[75080]:   <target dev="sdc" bus="scsi"/>
Dec 05 15:20:11 user nova-compute[75080]:   <serial>ba054005-ad45-4d43-80e7-8d3c6a7f6ff8</serial>
Dec 05 15:20:11 user nova-compute[75080]:   <address type="drive" controller="0" unit="2"/>
Dec 05 15:20:11 user nova-compute[75080]: </disk>
Dec 05 15:20:11 user nova-compute[75080]:  {{(pid=75080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd1627e-f8a3-4df9-9e04-d0dc4ded014f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e] added
Dec 05 15:20:11 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3172e3-f199-42b2-9591-98af63db32ce]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9f69a1-1c59-43f1-8a15-95457a9b0c46]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QUlnuBiN {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QUlnuBiN" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0d35b1-d93c-4b3d-acc7-68044ecc354e]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QUlnuBiN'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5650cb-be9a-4458-80b6-8cd4ba5b5196]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d0eff8-8139-4df6-a7fe-ba7de7ee238c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:11 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:20:11 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:20:11 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:20:11 user nova-compute[75080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)
Dec 05 15:20:11 user nova-compute[75080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 (non-flash)
Dec 05 15:20:11 user nova-compute[75080]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 (non-flash)
Dec 05 15:20:11 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:11 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:20:11 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:20:11 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:20:11 user nova-compute[75080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)
Dec 05 15:20:11 user nova-compute[75080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 (non-flash)
Dec 05 15:20:11 user nova-compute[75080]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 (non-flash)
Dec 05 15:20:11 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e -p 172.16.0.220:3260 --login" returned: 0 in 0.113s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabdeb47-505b-42e4-8682-015c2624bca6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e, portal: 172.16.0.220,3260]
Dec 05 15:20:11 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e, portal: 172.16.0.220,3260] successful.
Dec 05 15:20:11 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b65b3d-c022-4950-af92-248fd4372dab]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[263c141e-f5ef-44f0-b385-a20ab7108754]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:11 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:20:11 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:20:11 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:20:11 user nova-compute[75080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)
Dec 05 15:20:11 user nova-compute[75080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 (non-flash)
Dec 05 15:20:11 user nova-compute[75080]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 (non-flash)
Dec 05 15:20:11 user nova-compute[75080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e (non-flash)
Dec 05 15:20:11 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:11 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:20:11 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:20:11 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:20:11 user nova-compute[75080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)
Dec 05 15:20:11 user nova-compute[75080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 (non-flash)
Dec 05 15:20:11 user nova-compute[75080]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 (non-flash)
Dec 05 15:20:11 user nova-compute[75080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e (non-flash)
Dec 05 15:20:11 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6b1681-4846-4631-a185-f8c4126edf8b]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:20:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QUlnuBiN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:20:12 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] No BDM found with device name sda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:20:12 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:20:12 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:20:12 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] No VIF found with MAC fa:16:3e:cd:52:36, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:20:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c20ac8de-bba7-498b-87b7-973377ac983f tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Acquiring lock "0259351f-617f-47be-bfb6-2fef1c35bf15" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c20ac8de-bba7-498b-87b7-973377ac983f tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lock "0259351f-617f-47be-bfb6-2fef1c35bf15" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:12 user nova-compute[75080]: INFO nova.compute.manager [None req-c20ac8de-bba7-498b-87b7-973377ac983f tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Detaching volume 43e9addf-dbf2-48a8-bcd9-c578e7f7c570
Dec 05 15:20:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8b974c97-32fd-4262-ac92-adb0e9c71e1a tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Lock "f3cdfe20-7429-476d-9914-8141ba8b7488" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.744s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:12 user nova-compute[75080]: INFO nova.virt.block_device [None req-c20ac8de-bba7-498b-87b7-973377ac983f tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Attempting to driver detach volume 43e9addf-dbf2-48a8-bcd9-c578e7f7c570 from mountpoint /dev/vdb
Dec 05 15:20:12 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c20ac8de-bba7-498b-87b7-973377ac983f tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Attempting to detach device vdb from instance 0259351f-617f-47be-bfb6-2fef1c35bf15 from the persistent domain config. {{(pid=75080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 15:20:12 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-c20ac8de-bba7-498b-87b7-973377ac983f tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:20:12 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:20:12 user nova-compute[75080]:   <source dev="/dev/sdg"/>
Dec 05 15:20:12 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:20:12 user nova-compute[75080]:   <serial>43e9addf-dbf2-48a8-bcd9-c578e7f7c570</serial>
Dec 05 15:20:12 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 05 15:20:12 user nova-compute[75080]: </disk>
Dec 05 15:20:12 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:20:12 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-c20ac8de-bba7-498b-87b7-973377ac983f tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Successfully detached device vdb from instance 0259351f-617f-47be-bfb6-2fef1c35bf15 from the persistent domain config.
Dec 05 15:20:12 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c20ac8de-bba7-498b-87b7-973377ac983f tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0259351f-617f-47be-bfb6-2fef1c35bf15 from the live domain config. {{(pid=75080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 15:20:12 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-c20ac8de-bba7-498b-87b7-973377ac983f tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:20:12 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:20:12 user nova-compute[75080]:   <source dev="/dev/sdg"/>
Dec 05 15:20:12 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:20:12 user nova-compute[75080]:   <serial>43e9addf-dbf2-48a8-bcd9-c578e7f7c570</serial>
Dec 05 15:20:12 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 05 15:20:12 user nova-compute[75080]: </disk>
Dec 05 15:20:12 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:20:12 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c20ac8de-bba7-498b-87b7-973377ac983f tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0259351f-617f-47be-bfb6-2fef1c35bf15 {{(pid=75080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 15:20:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:20:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] <== connect_volume: return (2802ms) {'type': 'block', 'scsi_wwn': '26435323339653462', 'path': '/dev/sdi'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:20:12 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435323339653462', 'path': '/dev/sdi'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:20:12 user nova-compute[75080]: DEBUG nova.objects.instance [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lazy-loading 'flavor' on Instance uuid a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:20:12 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 15:20:12 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:20:12 user nova-compute[75080]:   <source dev="/dev/sdi"/>
Dec 05 15:20:12 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:20:12 user nova-compute[75080]:   <serial>0f18db39-ee9a-4f2d-a3cf-7609453eec5e</serial>
Dec 05 15:20:12 user nova-compute[75080]: </disk>
Dec 05 15:20:12 user nova-compute[75080]:  {{(pid=75080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 15:20:13 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:20:13 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:20:13 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] No VIF found with MAC fa:16:3e:91:12:8c, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:20:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7a3bafaa-cc3e-4429-b191-47d58372f982 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.687s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d353e83d-3cd1-4058-a13f-54d2024195b6 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Acquiring lock "f3cdfe20-7429-476d-9914-8141ba8b7488" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d353e83d-3cd1-4058-a13f-54d2024195b6 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Lock "f3cdfe20-7429-476d-9914-8141ba8b7488" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:13 user nova-compute[75080]: INFO nova.compute.manager [None req-d353e83d-3cd1-4058-a13f-54d2024195b6 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Detaching volume ba054005-ad45-4d43-80e7-8d3c6a7f6ff8
Dec 05 15:20:13 user nova-compute[75080]: DEBUG nova.compute.manager [req-fd2f0a7f-70a3-418f-9c32-20748ab889c3 req-d5467c11-4090-4e9e-b7c2-85ea78d1d650 service nova] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Received event network-changed-1c52a0de-1054-487a-9f4b-467d9151f1b0 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:20:13 user nova-compute[75080]: DEBUG nova.compute.manager [req-fd2f0a7f-70a3-418f-9c32-20748ab889c3 req-d5467c11-4090-4e9e-b7c2-85ea78d1d650 service nova] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Refreshing instance network info cache due to event network-changed-1c52a0de-1054-487a-9f4b-467d9151f1b0. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:20:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-fd2f0a7f-70a3-418f-9c32-20748ab889c3 req-d5467c11-4090-4e9e-b7c2-85ea78d1d650 service nova] Acquiring lock "refresh_cache-d69bc0bc-b6e8-447b-b529-54031fc78ce1" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:20:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-fd2f0a7f-70a3-418f-9c32-20748ab889c3 req-d5467c11-4090-4e9e-b7c2-85ea78d1d650 service nova] Acquired lock "refresh_cache-d69bc0bc-b6e8-447b-b529-54031fc78ce1" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:20:13 user nova-compute[75080]: DEBUG nova.network.neutron [req-fd2f0a7f-70a3-418f-9c32-20748ab889c3 req-d5467c11-4090-4e9e-b7c2-85ea78d1d650 service nova] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Refreshing network info cache for port 1c52a0de-1054-487a-9f4b-467d9151f1b0 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:20:13 user nova-compute[75080]: INFO nova.virt.block_device [None req-d353e83d-3cd1-4058-a13f-54d2024195b6 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Attempting to driver detach volume ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 from mountpoint /dev/sdc
Dec 05 15:20:13 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d353e83d-3cd1-4058-a13f-54d2024195b6 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Attempting to detach device sdc from instance f3cdfe20-7429-476d-9914-8141ba8b7488 from the persistent domain config. {{(pid=75080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 15:20:13 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-d353e83d-3cd1-4058-a13f-54d2024195b6 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:20:13 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:20:13 user nova-compute[75080]:   <source dev="/dev/sdh"/>
Dec 05 15:20:13 user nova-compute[75080]:   <target dev="sdc" bus="scsi"/>
Dec 05 15:20:13 user nova-compute[75080]:   <serial>ba054005-ad45-4d43-80e7-8d3c6a7f6ff8</serial>
Dec 05 15:20:13 user nova-compute[75080]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Dec 05 15:20:13 user nova-compute[75080]: </disk>
Dec 05 15:20:13 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:20:13 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-d353e83d-3cd1-4058-a13f-54d2024195b6 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Successfully detached device sdc from instance f3cdfe20-7429-476d-9914-8141ba8b7488 from the persistent domain config.
Dec 05 15:20:13 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d353e83d-3cd1-4058-a13f-54d2024195b6 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance f3cdfe20-7429-476d-9914-8141ba8b7488 from the live domain config. {{(pid=75080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 15:20:13 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-d353e83d-3cd1-4058-a13f-54d2024195b6 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:20:13 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:20:13 user nova-compute[75080]:   <source dev="/dev/sdh"/>
Dec 05 15:20:13 user nova-compute[75080]:   <target dev="sdc" bus="scsi"/>
Dec 05 15:20:13 user nova-compute[75080]:   <serial>ba054005-ad45-4d43-80e7-8d3c6a7f6ff8</serial>
Dec 05 15:20:13 user nova-compute[75080]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Dec 05 15:20:13 user nova-compute[75080]: </disk>
Dec 05 15:20:13 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:20:14 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d353e83d-3cd1-4058-a13f-54d2024195b6 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance f3cdfe20-7429-476d-9914-8141ba8b7488 {{(pid=75080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 15:20:14 user nova-compute[75080]: DEBUG nova.network.neutron [req-fd2f0a7f-70a3-418f-9c32-20748ab889c3 req-d5467c11-4090-4e9e-b7c2-85ea78d1d650 service nova] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Updated VIF entry in instance network info cache for port 1c52a0de-1054-487a-9f4b-467d9151f1b0. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:20:14 user nova-compute[75080]: DEBUG nova.network.neutron [req-fd2f0a7f-70a3-418f-9c32-20748ab889c3 req-d5467c11-4090-4e9e-b7c2-85ea78d1d650 service nova] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Updating instance_info_cache with network_info: [{"id": "1c52a0de-1054-487a-9f4b-467d9151f1b0", "address": "fa:16:3e:b4:f4:d6", "network": {"id": "73bdb098-8c6b-4af3-b3f5-5fb4b213a0ab", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1357180398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "787d8b299b8b4940b04446b4189fdf05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c52a0de-10", "ovs_interfaceid": "1c52a0de-1054-487a-9f4b-467d9151f1b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:20:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-fd2f0a7f-70a3-418f-9c32-20748ab889c3 req-d5467c11-4090-4e9e-b7c2-85ea78d1d650 service nova] Releasing lock "refresh_cache-d69bc0bc-b6e8-447b-b529-54031fc78ce1" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:20:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Acquiring lock "d69bc0bc-b6e8-447b-b529-54031fc78ce1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "d69bc0bc-b6e8-447b-b529-54031fc78ce1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:14 user nova-compute[75080]: DEBUG nova.objects.instance [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lazy-loading 'flavor' on Instance uuid d69bc0bc-b6e8-447b-b529-54031fc78ce1 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:20:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "d69bc0bc-b6e8-447b-b529-54031fc78ce1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Acquiring lock "d69bc0bc-b6e8-447b-b529-54031fc78ce1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "d69bc0bc-b6e8-447b-b529-54031fc78ce1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:15 user nova-compute[75080]: INFO nova.compute.manager [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Attaching volume 953c464d-b8f7-42c1-a489-f1573851a20a to /dev/vdb
Dec 05 15:20:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-22bc2dd4-4e4b-4b07-8c7b-4dbcc2d6a707 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Acquiring lock "a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-22bc2dd4-4e4b-4b07-8c7b-4dbcc2d6a707 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:15 user nova-compute[75080]: DEBUG os_brick.utils [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:20:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:15 user nova-compute[75080]: INFO nova.compute.manager [None req-22bc2dd4-4e4b-4b07-8c7b-4dbcc2d6a707 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Detaching volume 0f18db39-ee9a-4f2d-a3cf-7609453eec5e
Dec 05 15:20:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:15 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[162d21ee-f0e7-49f6-b2ee-aae914cddf4b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:15 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[885be862-8db2-4360-b3ac-861624328ef7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:15 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a8708c-b7d8-41cf-95e3-da693af1959b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:15 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fb6f3e-6db3-474d-b106-0834636f1796]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:20:15 user nova-compute[75080]: INFO nova.virt.block_device [None req-22bc2dd4-4e4b-4b07-8c7b-4dbcc2d6a707 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Attempting to driver detach volume 0f18db39-ee9a-4f2d-a3cf-7609453eec5e from mountpoint /dev/vdb
Dec 05 15:20:15 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:20:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:20:15 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:20:15 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7297d551-c99b-46b1-a07b-90d628de2eff]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:15 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:20:15 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:20:15 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:20:15 user nova-compute[75080]: DEBUG os_brick.utils [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:20:15 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Updating existing volume attachment record: b88d6a31-622f-48c7-8e49-e6a2b0f7f747 {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:20:15 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-22bc2dd4-4e4b-4b07-8c7b-4dbcc2d6a707 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Attempting to detach device vdb from instance a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1 from the persistent domain config. {{(pid=75080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 15:20:15 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-22bc2dd4-4e4b-4b07-8c7b-4dbcc2d6a707 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:20:15 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:20:15 user nova-compute[75080]:   <source dev="/dev/sdi"/>
Dec 05 15:20:15 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:20:15 user nova-compute[75080]:   <serial>0f18db39-ee9a-4f2d-a3cf-7609453eec5e</serial>
Dec 05 15:20:15 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 15:20:15 user nova-compute[75080]: </disk>
Dec 05 15:20:15 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:20:15 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-22bc2dd4-4e4b-4b07-8c7b-4dbcc2d6a707 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Successfully detached device vdb from instance a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1 from the persistent domain config.
Dec 05 15:20:15 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-22bc2dd4-4e4b-4b07-8c7b-4dbcc2d6a707 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1 from the live domain config. {{(pid=75080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 15:20:15 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-22bc2dd4-4e4b-4b07-8c7b-4dbcc2d6a707 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:20:15 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:20:15 user nova-compute[75080]:   <source dev="/dev/sdi"/>
Dec 05 15:20:15 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:20:15 user nova-compute[75080]:   <serial>0f18db39-ee9a-4f2d-a3cf-7609453eec5e</serial>
Dec 05 15:20:15 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 15:20:15 user nova-compute[75080]: </disk>
Dec 05 15:20:15 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:20:15 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-22bc2dd4-4e4b-4b07-8c7b-4dbcc2d6a707 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1 {{(pid=75080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 15:20:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG nova.compute.manager [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xiXwjGRP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1830878a-71e0-48f1-85b8-9ed83b1419cd', 'attached_at': '', 'detached_at': '', 'volume_id': 'dd92e10f-dace-4099-ba5d-c7fcbe8a1867', 'serial': 'dd92e10f-dace-4099-ba5d-c7fcbe8a1867'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jfDBzNcE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '1830878a-71e0-48f1-85b8-9ed83b1419cd', 'attached_at': '', 'detached_at': '', 'volume_id': '22aea242-c46e-4ce0-bc46-c34a56465dd9', 'serial'} {{(pid=75080) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xiXwjGRP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:20:21 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:20:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:20:21 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:20:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:20:21 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:20:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fae1f9-6f4e-4fa3-8f60-40f0a8915352]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:20:21 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d27d2a-6225-4e66-b993-e7beb02643e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867] added
Dec 05 15:20:21 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a2e5a2-5896-4122-ad7c-f2d1dbd63ef2]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ac20ee-ab0d-4153-a472-52fe99016d5a]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xiXwjGRP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xiXwjGRP" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8811f3-3650-41c4-a9c6-b0e9af75bbf9]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xiXwjGRP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[659f55b9-312d-4dab-a855-1024556b725a]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca62ed4-3262-4390-990b-4f7c4ec4d2d6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:21 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:20:21 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:20:21 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:20:21 user nova-compute[75080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)
Dec 05 15:20:21 user nova-compute[75080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 (non-flash)
Dec 05 15:20:21 user nova-compute[75080]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 (non-flash)
Dec 05 15:20:21 user nova-compute[75080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e (non-flash)
Dec 05 15:20:21 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:21 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:20:21 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:20:21 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:20:21 user nova-compute[75080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)
Dec 05 15:20:21 user nova-compute[75080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 (non-flash)
Dec 05 15:20:21 user nova-compute[75080]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 (non-flash)
Dec 05 15:20:21 user nova-compute[75080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e (non-flash)
Dec 05 15:20:21 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[024968f4-8dc5-4cd3-b6b3-d23a9c7977b0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867, portal: 172.16.0.220,3260]
Dec 05 15:20:21 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867, portal: 172.16.0.220,3260] successful.
Dec 05 15:20:21 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80ea562-3a48-44bc-ab37-181093054782]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b532238-3c17-41d8-946f-6ab136f27d36]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)
Dec 05 15:20:21 user nova-compute[75080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:21 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:20:21 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:20:21 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:20:21 user nova-compute[75080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)
Dec 05 15:20:21 user nova-compute[75080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 (non-flash)
Dec 05 15:20:21 user nova-compute[75080]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 (non-flash)
Dec 05 15:20:21 user nova-compute[75080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e (non-flash)
Dec 05 15:20:21 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)
Dec 05 15:20:21 user nova-compute[75080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:21 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:20:21 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:20:21 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:20:21 user nova-compute[75080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)
Dec 05 15:20:21 user nova-compute[75080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 (non-flash)
Dec 05 15:20:21 user nova-compute[75080]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 (non-flash)
Dec 05 15:20:21 user nova-compute[75080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e (non-flash)
Dec 05 15:20:21 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] HCTL ('41', '-', '-', 0) found on session 10 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e538f65-dcba-4733-89c0-3b3f4eadec9b]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:20:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xiXwjGRP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:20:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:20:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:20:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:20:22 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:20:22 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:20:22 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '23464643939666533', 'path': '/dev/sdj'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:20:22 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464643939666533', 'path': '/dev/sdj'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:20:22 user nova-compute[75080]: DEBUG nova.objects.instance [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Lazy-loading 'flavor' on Instance uuid 1830878a-71e0-48f1-85b8-9ed83b1419cd {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:20:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Checking UEFI support for host arch (x86_64) {{(pid=75080) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}}
Dec 05 15:20:23 user nova-compute[75080]: INFO nova.virt.libvirt.host [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] UEFI support detected
Dec 05 15:20:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] COPY block job progress, current cursor: 7340032 final cursor: 1073741824 {{(pid=75080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 15:20:23 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:20:23 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:20:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:23 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:20:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] COPY block job progress, current cursor: 159383552 final cursor: 1073741824 {{(pid=75080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 15:20:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1/disk --force-share --output=json" returned: 0 in 0.420s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33078a88-4858-4c6b-bfa9-c3d9b83cf78b/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:24 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] COPY block job progress, current cursor: 318767104 final cursor: 1073741824 {{(pid=75080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 15:20:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33078a88-4858-4c6b-bfa9-c3d9b83cf78b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33078a88-4858-4c6b-bfa9-c3d9b83cf78b/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33078a88-4858-4c6b-bfa9-c3d9b83cf78b/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:24 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] COPY block job progress, current cursor: 473956352 final cursor: 1073741824 {{(pid=75080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 15:20:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:25 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:20:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:25 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] COPY block job progress, current cursor: 618659840 final cursor: 1073741824 {{(pid=75080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 15:20:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:25 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:20:25 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:20:25 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:20:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:25 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] COPY block job progress, current cursor: 783286272 final cursor: 1073741824 {{(pid=75080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 15:20:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1830878a-71e0-48f1-85b8-9ed83b1419cd/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1830878a-71e0-48f1-85b8-9ed83b1419cd/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1830878a-71e0-48f1-85b8-9ed83b1419cd/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] COPY block job progress, current cursor: 870318080 final cursor: 1073741824 {{(pid=75080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 15:20:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1830878a-71e0-48f1-85b8-9ed83b1419cd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:20:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69bc0bc-b6e8-447b-b529-54031fc78ce1/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69bc0bc-b6e8-447b-b529-54031fc78ce1/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69bc0bc-b6e8-447b-b529-54031fc78ce1/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] COPY block job progress, current cursor: 991952896 final cursor: 1073741824 {{(pid=75080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69bc0bc-b6e8-447b-b529-54031fc78ce1/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b86f43-a8f7-4b1d-a2e2-e0f614e6d764/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b86f43-a8f7-4b1d-a2e2-e0f614e6d764/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b86f43-a8f7-4b1d-a2e2-e0f614e6d764/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b86f43-a8f7-4b1d-a2e2-e0f614e6d764/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31688583-6336-4e34-8df5-6947402c39ef/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31688583-6336-4e34-8df5-6947402c39ef/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31688583-6336-4e34-8df5-6947402c39ef/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jfDBzNcE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:20:27 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:20:27 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a92f4d8-8453-4750-b7e6-5d4e2b21bdb2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:20:27 user nova-compute[75080]: No targets found.
Dec 05 15:20:27 user nova-compute[75080]: iSNS:
Dec 05 15:20:27 user nova-compute[75080]: No targets found.
Dec 05 15:20:27 user nova-compute[75080]: STATIC:
Dec 05 15:20:27 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed
Dec 05 15:20:27 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:27 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:27 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058
Dec 05 15:20:27 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:27 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:27 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9
Dec 05 15:20:27 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:27 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:27 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f
Dec 05 15:20:27 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:27 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:27 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e
Dec 05 15:20:27 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:27 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:27 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a
Dec 05 15:20:27 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:27 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:27 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8
Dec 05 15:20:27 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:27 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:27 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570
Dec 05 15:20:27 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:27 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:27 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867
Dec 05 15:20:27 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:27 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:27 user nova-compute[75080]: FIRMWARE:
Dec 05 15:20:27 user nova-compute[75080]: No targets found.
Dec 05 15:20:27 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:20:27 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:20:27 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ff96de-2925-447f-b435-08d7daf13be4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f67f49-2359-463e-acaf-0f8b9e27d2f8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)
Dec 05 15:20:27 user nova-compute[75080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:27 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:20:27 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:20:27 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:20:27 user nova-compute[75080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)
Dec 05 15:20:27 user nova-compute[75080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 (non-flash)
Dec 05 15:20:27 user nova-compute[75080]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 (non-flash)
Dec 05 15:20:27 user nova-compute[75080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e (non-flash)
Dec 05 15:20:27 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)
Dec 05 15:20:27 user nova-compute[75080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:27 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:20:27 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:20:27 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:20:27 user nova-compute[75080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)
Dec 05 15:20:27 user nova-compute[75080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 (non-flash)
Dec 05 15:20:27 user nova-compute[75080]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 (non-flash)
Dec 05 15:20:27 user nova-compute[75080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e (non-flash)
Dec 05 15:20:27 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f665c1e0790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9'): ({'sdf'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Removing single pathed devices sdf {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31688583-6336-4e34-8df5-6947402c39ef/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a984b82d-765c-4590-ad6e-f14c57fc4969]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3cdfe20-7429-476d-9914-8141ba8b7488/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[339fa985-dc55-4fb0-810d-bb17783531ea]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Flushing IO for device /dev/sdf {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a6a787-a458-48a3-aa78-1583a0cda045]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[531adf03-f9da-4fa9-a531-0e9b1be0aa6b]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] SCSI volumes sdf have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4015c29f-d136-4de6-b8a2-b2f01ea1ee59]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3cdfe20-7429-476d-9914-8141ba8b7488/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3cdfe20-7429-476d-9914-8141ba8b7488/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.097s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1267d182-2ccf-4187-bf10-ba40edf27d70]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9, portal: 172.16.0.220,3260]
Dec 05 15:20:28 user nova-compute[75080]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9, portal: 172.16.0.220,3260] successful.
Dec 05 15:20:28 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e08c091-514f-48fb-80c5-b15d6fca5527]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.419s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:20:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] <== disconnect_volume: return (421ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:20:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:20:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3cdfe20-7429-476d-9914-8141ba8b7488/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:28 user nova-compute[75080]: DEBUG nova.compute.manager [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xiXwjGRP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '1830878a-71e0-48f1-85b8-9ed83b1419cd', 'attached_at': '', 'detached_at': '', 'volume_id': 'dd92e10f-dace-4099-ba5d-c7fcbe8a1867', 'serial'} {{(pid=75080) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Dec 05 15:20:28 user nova-compute[75080]: DEBUG nova.compute.manager [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] swap_volume: removing Cinder connection for volume 22aea242-c46e-4ce0-bc46-c34a56465dd9 {{(pid=75080) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Dec 05 15:20:28 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:20:28 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:20:28 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=6993MB free_disk=25.3814697265625GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:20:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:28 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance bd75375a-8b70-4bc2-a72b-14213ebaa4e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:20:28 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance eedd1529-4feb-4f85-8625-0c20d8e0359d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:20:28 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:20:28 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 0259351f-617f-47be-bfb6-2fef1c35bf15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:20:28 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance f3cdfe20-7429-476d-9914-8141ba8b7488 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:20:28 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 1830878a-71e0-48f1-85b8-9ed83b1419cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:20:28 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 33078a88-4858-4c6b-bfa9-c3d9b83cf78b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:20:28 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance d69bc0bc-b6e8-447b-b529-54031fc78ce1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:20:28 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:20:28 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 912b0528-be16-427f-84fc-8a6cf89d5000 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:20:28 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:20:28 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 31688583-6336-4e34-8df5-6947402c39ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:20:28 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:20:28 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.576s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG nova.compute.manager [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] swap_volume: Updating volume 22aea242-c46e-4ce0-bc46-c34a56465dd9 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "xiXwjGRP", "auth_password": "3hyac6KVCFLAIG", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "dd92e10f-dace-4099-ba5d-c7fcbe8a1867"}, "status": "reserved", "instance": "1830878a-71e0-48f1-85b8-9ed83b1419cd", "attached_at": "", "detached_at": "", "volume_id": "dd92e10f-dace-4099-ba5d-c7fcbe8a1867", "serial": "dd92e10f-dace-4099-ba5d-c7fcbe8a1867"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'dd92e10f-dace-4099-ba5d-c7fcbe8a1867', 'no_device': None, 'attachment_id': '1bfbe9d9-acf7-4523-815a-14393ed9cccf'} {{(pid=75080) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3f7510e0-1b54-477e-b686-a23bd6bce467 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Lock "1830878a-71e0-48f1-85b8-9ed83b1419cd" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 18.762s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jLbdtQSD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:20:29 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:20:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:20:29 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:20:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:20:29 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:20:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf04bc8e-72f9-480f-a399-07a65b2b7a3b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:20:29 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4d1c69-daae-4db5-989c-e5e2ebae2c43]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a] added
Dec 05 15:20:29 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[909620b1-d426-4593-adea-eb549f191a91]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bc78cb-64cf-4574-8d20-edc9b9cc3931]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jLbdtQSD {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jLbdtQSD" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdd664c-c002-44ee-b344-47599b7c9f19]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jLbdtQSD'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[023bc187-40b3-470f-b87b-81a618b150c6]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a6ebf5-79eb-426b-8205-edb70880ada8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)
Dec 05 15:20:29 user nova-compute[75080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:29 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:20:29 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:20:29 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:20:29 user nova-compute[75080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 (non-flash)
Dec 05 15:20:29 user nova-compute[75080]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 (non-flash)
Dec 05 15:20:29 user nova-compute[75080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e (non-flash)
Dec 05 15:20:29 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)
Dec 05 15:20:29 user nova-compute[75080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:29 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:20:29 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:20:29 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:20:29 user nova-compute[75080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 (non-flash)
Dec 05 15:20:29 user nova-compute[75080]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 (non-flash)
Dec 05 15:20:29 user nova-compute[75080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e (non-flash)
Dec 05 15:20:29 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:29 user nova-compute[75080]: ERROR nova.volume.cinder [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Update attachment failed for attachment b88d6a31-622f-48c7-8e49-e6a2b0f7f747. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-fc4a9ed8-644d-4833-a476-86a4f2539a05) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-fc4a9ed8-644d-4833-a476-86a4f2539a05)
Dec 05 15:20:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe75d2d-77ac-4318-889d-5eada786f71f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a, portal: 172.16.0.220,3260]
Dec 05 15:20:29 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a, portal: 172.16.0.220,3260] successful.
Dec 05 15:20:29 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3a4ab1-4a46-4d21-b4ac-6fb7b8810ac9]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbbc0b3-eb09-4c80-94e0-399a6fda00ff]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)
Dec 05 15:20:30 user nova-compute[75080]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a (non-flash)
Dec 05 15:20:30 user nova-compute[75080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:30 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:20:30 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:20:30 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:20:30 user nova-compute[75080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 (non-flash)
Dec 05 15:20:30 user nova-compute[75080]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 (non-flash)
Dec 05 15:20:30 user nova-compute[75080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e (non-flash)
Dec 05 15:20:30 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)
Dec 05 15:20:30 user nova-compute[75080]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a (non-flash)
Dec 05 15:20:30 user nova-compute[75080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:30 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:20:30 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:20:30 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:20:30 user nova-compute[75080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 (non-flash)
Dec 05 15:20:30 user nova-compute[75080]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 (non-flash)
Dec 05 15:20:30 user nova-compute[75080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e (non-flash)
Dec 05 15:20:30 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] HCTL ('37', '-', '-', 0) found on session 11 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb36361-d73c-467d-ae53-46740e3d8fc4]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Searching for a device in session 11 and hctl ['37', '*', '*', 0] yield: None {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Acquiring lock "1830878a-71e0-48f1-85b8-9ed83b1419cd" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Lock "1830878a-71e0-48f1-85b8-9ed83b1419cd" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG os_brick.utils [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ed1434-b8c6-42d3-ba5f-62f563b0dfdd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[948ab528-97ba-40ab-8ff2-4a80313a2f8a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[031c84d9-3fbf-442b-9d3c-e4ced0f4c151]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0803c088-4ca5-4a4c-b3c5-61713f14dc40]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:20:30 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:20:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd5cc9c-e99c-4d54-8b5f-c2c8b37d2b9a]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:20:30 user nova-compute[75080]: DEBUG os_brick.utils [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:20:30 user nova-compute[75080]: INFO nova.compute.manager [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Swapping volume dd92e10f-dace-4099-ba5d-c7fcbe8a1867 for 22aea242-c46e-4ce0-bc46-c34a56465dd9
Dec 05 15:20:31 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Searching for a device in session 11 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:20:31 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jLbdtQSD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:20:31 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:20:31 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] <== connect_volume: return (1422ms) {'type': 'block', 'scsi_wwn': '26633656531326561', 'path': '/dev/sdf'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:20:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633656531326561', 'path': '/dev/sdf'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:20:31 user nova-compute[75080]: DEBUG nova.objects.instance [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Lazy-loading 'flavor' on Instance uuid 33078a88-4858-4c6b-bfa9-c3d9b83cf78b {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:20:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] attach device xml: <disk type="block" device="disk">
Dec 05 15:20:31 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:20:31 user nova-compute[75080]:   <source dev="/dev/sdf"/>
Dec 05 15:20:31 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:20:31 user nova-compute[75080]:   <serial>892c0e92-c044-4b58-a91f-e139c8788d5a</serial>
Dec 05 15:20:31 user nova-compute[75080]: </disk>
Dec 05 15:20:31 user nova-compute[75080]:  {{(pid=75080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 15:20:31 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Updating instance_info_cache with network_info: [{"id": "74eb53ef-5ba7-4bd5-81af-d6adede99fad", "address": "fa:16:3e:91:12:8c", "network": {"id": "ecbc1165-663e-47ca-87c7-ecda194bb3cc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-140281562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b74a9586932440678d59170e174336a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74eb53ef-5b", "ovs_interfaceid": "74eb53ef-5ba7-4bd5-81af-d6adede99fad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:20:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:20:31 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 15:20:31 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:20:31 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:20:31 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:20:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:20:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:20:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] No VIF found with MAC fa:16:3e:35:a9:ee, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:20:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d5aa4a7c-74b3-47d3-aa25-3595ac086d38 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Lock "33078a88-4858-4c6b-bfa9-c3d9b83cf78b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.416s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3faa75d1-2828-4619-b70f-901d57112b0b tempest-VolumesAssistedSnapshotsTest-1629594287 tempest-VolumesAssistedSnapshotsTest-1629594287-project] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] volume_snapshot_create: create_info: {'snapshot_id': '9a126af3-e3c1-4d71-9a96-3cf97324b62c', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75080) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3572}}
Dec 05 15:20:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3faa75d1-2828-4619-b70f-901d57112b0b tempest-VolumesAssistedSnapshotsTest-1629594287 tempest-VolumesAssistedSnapshotsTest-1629594287-project] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] snap xml: <domainsnapshot>
Dec 05 15:20:32 user nova-compute[75080]:   <disks>
Dec 05 15:20:32 user nova-compute[75080]:     <disk name="/dev/sdf" snapshot="external" type="file">
Dec 05 15:20:32 user nova-compute[75080]:       <source file="/dev/new_file"/>
Dec 05 15:20:32 user nova-compute[75080]:     </disk>
Dec 05 15:20:32 user nova-compute[75080]:     <disk name="vda" snapshot="no"/>
Dec 05 15:20:32 user nova-compute[75080]:   </disks>
Dec 05 15:20:32 user nova-compute[75080]: </domainsnapshot>
Dec 05 15:20:32 user nova-compute[75080]:  {{(pid=75080) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3513}}
Dec 05 15:20:32 user nova-compute[75080]: DEBUG nova.objects.instance [None req-3faa75d1-2828-4619-b70f-901d57112b0b tempest-VolumesAssistedSnapshotsTest-1629594287 tempest-VolumesAssistedSnapshotsTest-1629594287-project] Lazy-loading 'system_metadata' on Instance uuid 33078a88-4858-4c6b-bfa9-c3d9b83cf78b {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:20:32 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-3faa75d1-2828-4619-b70f-901d57112b0b tempest-VolumesAssistedSnapshotsTest-1629594287 tempest-VolumesAssistedSnapshotsTest-1629594287-project] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [None req-3faa75d1-2828-4619-b70f-901d57112b0b tempest-VolumesAssistedSnapshotsTest-1629594287 tempest-VolumesAssistedSnapshotsTest-1629594287-project] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Traceback (most recent call last):
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b]     rv = execute(f, *args, **kwargs)
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b]     six.reraise(c, e, tb)
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b]     raise value
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b]     rv = meth(*args, **kwargs)
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] 
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [None req-3faa75d1-2828-4619-b70f-901d57112b0b tempest-VolumesAssistedSnapshotsTest-1629594287 tempest-VolumesAssistedSnapshotsTest-1629594287-project] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Traceback (most recent call last):
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3590, in volume_snapshot_create
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b]     self._volume_snapshot_create(context, instance, guest,
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b]     rv = execute(f, *args, **kwargs)
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b]     six.reraise(c, e, tb)
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b]     raise value
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b]     rv = meth(*args, **kwargs)
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] 
Dec 05 15:20:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5808bdd3-c4da-4f1a-9e45-3ea1548833d4 tempest-VolumesAssistedSnapshotsTest-1629594287 tempest-VolumesAssistedSnapshotsTest-1629594287-project] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] volume_snapshot_delete: delete_info: {'volume_id': '892c0e92-c044-4b58-a91f-e139c8788d5a'} {{(pid=75080) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3673}}
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [None req-5808bdd3-c4da-4f1a-9e45-3ea1548833d4 tempest-VolumesAssistedSnapshotsTest-1629594287 tempest-VolumesAssistedSnapshotsTest-1629594287-project] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Traceback (most recent call last):
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3846, in volume_snapshot_delete
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b]     self._volume_snapshot_delete(context, instance, volume_id,
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3676, in _volume_snapshot_delete
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b]     if delete_info['type'] != 'qcow2':
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] KeyError: 'type'
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] 
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [None req-3faa75d1-2828-4619-b70f-901d57112b0b tempest-VolumesAssistedSnapshotsTest-1629594287 tempest-VolumesAssistedSnapshotsTest-1629594287-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 9a126af3-e3c1-4d71-9a96-3cf97324b62c could not be found.
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3590, in volume_snapshot_create
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     raise value
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver 
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver 
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 9a126af3-e3c1-4d71-9a96-3cf97324b62c could not be found. (HTTP 404) (Request-ID: req-19177821-1154-485c-9cea-dace469c1c3d)
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver 
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver 
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3412, in _volume_snapshot_update_status
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 9a126af3-e3c1-4d71-9a96-3cf97324b62c could not be found.
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver 
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server [None req-3faa75d1-2828-4619-b70f-901d57112b0b tempest-VolumesAssistedSnapshotsTest-1629594287 tempest-VolumesAssistedSnapshotsTest-1629594287-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3593, in volume_snapshot_create
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3590, in volume_snapshot_create
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server     raise value
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server 
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver [None req-5808bdd3-c4da-4f1a-9e45-3ea1548833d4 tempest-VolumesAssistedSnapshotsTest-1629594287 tempest-VolumesAssistedSnapshotsTest-1629594287-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3846, in volume_snapshot_delete
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3676, in _volume_snapshot_delete
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver 
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver 
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-7152637d-2f0b-44b0-a64f-7f3e02de642b)
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver 
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver 
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3412, in _volume_snapshot_update_status
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Dec 05 15:20:32 user nova-compute[75080]: ERROR nova.virt.libvirt.driver 
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server [None req-5808bdd3-c4da-4f1a-9e45-3ea1548833d4 tempest-VolumesAssistedSnapshotsTest-1629594287 tempest-VolumesAssistedSnapshotsTest-1629594287-project] Exception during message handling: KeyError: 'type'
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3849, in volume_snapshot_delete
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3846, in volume_snapshot_delete
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3676, in _volume_snapshot_delete
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Dec 05 15:20:32 user nova-compute[75080]: ERROR oslo_messaging.rpc.server 
Dec 05 15:20:32 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-c20ac8de-bba7-498b-87b7-973377ac983f tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0259351f-617f-47be-bfb6-2fef1c35bf15 is timed out.
Dec 05 15:20:32 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-c20ac8de-bba7-498b-87b7-973377ac983f tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Successfully detached device vdb from instance 0259351f-617f-47be-bfb6-2fef1c35bf15 from the live domain config.
Dec 05 15:20:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c20ac8de-bba7-498b-87b7-973377ac983f tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:20:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20ac8de-bba7-498b-87b7-973377ac983f tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mPlpRaDQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:20:32 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-c20ac8de-bba7-498b-87b7-973377ac983f tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:20:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-c20ac8de-bba7-498b-87b7-973377ac983f tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:20:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-c20ac8de-bba7-498b-87b7-973377ac983f tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:20:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bb536e-0fa0-4f57-9056-ea4921a90c5c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20ac8de-bba7-498b-87b7-973377ac983f tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:20:32 user nova-compute[75080]: No targets found.
Dec 05 15:20:32 user nova-compute[75080]: iSNS:
Dec 05 15:20:32 user nova-compute[75080]: No targets found.
Dec 05 15:20:32 user nova-compute[75080]: STATIC:
Dec 05 15:20:32 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed
Dec 05 15:20:32 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:32 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:32 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058
Dec 05 15:20:32 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:32 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:32 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f
Dec 05 15:20:32 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:32 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:32 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e
Dec 05 15:20:32 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:32 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:32 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a
Dec 05 15:20:32 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:32 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:32 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8
Dec 05 15:20:32 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:32 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:32 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a
Dec 05 15:20:32 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:32 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:32 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570
Dec 05 15:20:32 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:32 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:32 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867
Dec 05 15:20:32 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:32 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:32 user nova-compute[75080]: FIRMWARE:
Dec 05 15:20:32 user nova-compute[75080]: No targets found.
Dec 05 15:20:32 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:20:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20ac8de-bba7-498b-87b7-973377ac983f tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:20:32 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:20:32 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:20:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20ac8de-bba7-498b-87b7-973377ac983f tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:20:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2feb31df-e296-4aae-a55e-d46f210d6ad1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[984c7307-6559-43d7-b870-7cff5444cac8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20ac8de-bba7-498b-87b7-973377ac983f tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)
Dec 05 15:20:32 user nova-compute[75080]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a (non-flash)
Dec 05 15:20:32 user nova-compute[75080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:32 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:20:32 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:20:32 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:20:32 user nova-compute[75080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 (non-flash)
Dec 05 15:20:32 user nova-compute[75080]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 (non-flash)
Dec 05 15:20:32 user nova-compute[75080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e (non-flash)
Dec 05 15:20:32 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:20:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20ac8de-bba7-498b-87b7-973377ac983f tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)
Dec 05 15:20:32 user nova-compute[75080]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a (non-flash)
Dec 05 15:20:32 user nova-compute[75080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:32 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:20:32 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:20:32 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:20:32 user nova-compute[75080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 (non-flash)
Dec 05 15:20:32 user nova-compute[75080]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 (non-flash)
Dec 05 15:20:32 user nova-compute[75080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e (non-flash)
Dec 05 15:20:32 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:20:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20ac8de-bba7-498b-87b7-973377ac983f tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f665c7200d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570'): ({'sdg'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:20:32 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-c20ac8de-bba7-498b-87b7-973377ac983f tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Removing single pathed devices sdg {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:20:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[363eea1e-f7cb-4dd8-89e3-389c29455d8b]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9be453b2-d2f3-4415-825c-d7dc8484ab72 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Acquiring lock "33078a88-4858-4c6b-bfa9-c3d9b83cf78b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9be453b2-d2f3-4415-825c-d7dc8484ab72 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Lock "33078a88-4858-4c6b-bfa9-c3d9b83cf78b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e84dae-822c-4d66-9b8f-6215e6a35637]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:32 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-c20ac8de-bba7-498b-87b7-973377ac983f tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Flushing IO for device /dev/sdg {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:20:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:32 user nova-compute[75080]: INFO nova.compute.manager [None req-9be453b2-d2f3-4415-825c-d7dc8484ab72 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Detaching volume 892c0e92-c044-4b58-a91f-e139c8788d5a
Dec 05 15:20:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e58ed3d-6e9e-4c6e-9235-375dee11450a]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:32 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-c20ac8de-bba7-498b-87b7-973377ac983f tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:20:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.045s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:33 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1873e0-dbbb-41d9-ad05-8eba159c5dc7]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:33 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-c20ac8de-bba7-498b-87b7-973377ac983f tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:20:33 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-c20ac8de-bba7-498b-87b7-973377ac983f tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] SCSI volumes sdg have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:20:33 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20ac8de-bba7-498b-87b7-973377ac983f tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:20:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:33 user nova-compute[75080]: INFO nova.virt.block_device [None req-9be453b2-d2f3-4415-825c-d7dc8484ab72 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Attempting to driver detach volume 892c0e92-c044-4b58-a91f-e139c8788d5a from mountpoint /dev/vdb
Dec 05 15:20:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-9be453b2-d2f3-4415-825c-d7dc8484ab72 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Attempting to detach device vdb from instance 33078a88-4858-4c6b-bfa9-c3d9b83cf78b from the persistent domain config. {{(pid=75080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 15:20:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-9be453b2-d2f3-4415-825c-d7dc8484ab72 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] detach device xml: <disk type="block" device="disk">
Dec 05 15:20:33 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:20:33 user nova-compute[75080]:   <source dev="/dev/sdf"/>
Dec 05 15:20:33 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:20:33 user nova-compute[75080]:   <serial>892c0e92-c044-4b58-a91f-e139c8788d5a</serial>
Dec 05 15:20:33 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 15:20:33 user nova-compute[75080]: </disk>
Dec 05 15:20:33 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:20:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:33 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5687d72e-02a8-4de0-ae60-34d6377c7f42]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:33 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20ac8de-bba7-498b-87b7-973377ac983f tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:33 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-9be453b2-d2f3-4415-825c-d7dc8484ab72 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Successfully detached device vdb from instance 33078a88-4858-4c6b-bfa9-c3d9b83cf78b from the persistent domain config.
Dec 05 15:20:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-9be453b2-d2f3-4415-825c-d7dc8484ab72 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 33078a88-4858-4c6b-bfa9-c3d9b83cf78b from the live domain config. {{(pid=75080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 15:20:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-9be453b2-d2f3-4415-825c-d7dc8484ab72 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] detach device xml: <disk type="block" device="disk">
Dec 05 15:20:33 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:20:33 user nova-compute[75080]:   <source dev="/dev/sdf"/>
Dec 05 15:20:33 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:20:33 user nova-compute[75080]:   <serial>892c0e92-c044-4b58-a91f-e139c8788d5a</serial>
Dec 05 15:20:33 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 15:20:33 user nova-compute[75080]: </disk>
Dec 05 15:20:33 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:20:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:33 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c36bdc-4619-49b0-9613-f747d8d8d13a]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:33 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20ac8de-bba7-498b-87b7-973377ac983f tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570, portal: 172.16.0.220,3260]
Dec 05 15:20:33 user nova-compute[75080]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570, portal: 172.16.0.220,3260] successful.
Dec 05 15:20:33 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e9addf-dbf2-48a8-bcd9-c578e7f7c570 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:33 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[23256047-cd76-4533-9f4a-d88ee1b3e5e5]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:33 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20ac8de-bba7-498b-87b7-973377ac983f tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:33 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-c20ac8de-bba7-498b-87b7-973377ac983f tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:20:33 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20ac8de-bba7-498b-87b7-973377ac983f tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] <== disconnect_volume: return (371ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:20:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c20ac8de-bba7-498b-87b7-973377ac983f tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:20:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-9be453b2-d2f3-4415-825c-d7dc8484ab72 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 33078a88-4858-4c6b-bfa9-c3d9b83cf78b {{(pid=75080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG nova.objects.instance [None req-c20ac8de-bba7-498b-87b7-973377ac983f tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lazy-loading 'flavor' on Instance uuid 0259351f-617f-47be-bfb6-2fef1c35bf15 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c20ac8de-bba7-498b-87b7-973377ac983f tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lock "0259351f-617f-47be-bfb6-2fef1c35bf15" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.965s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-37c9b487-44d0-453a-a967-ab6ee8ed6fe1 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Acquiring lock "interface-0259351f-617f-47be-bfb6-2fef1c35bf15-dcdd907f-231e-4ca4-97b6-23f980fa55d9" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-37c9b487-44d0-453a-a967-ab6ee8ed6fe1 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lock "interface-0259351f-617f-47be-bfb6-2fef1c35bf15-dcdd907f-231e-4ca4-97b6-23f980fa55d9" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:34 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-d353e83d-3cd1-4058-a13f-54d2024195b6 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance f3cdfe20-7429-476d-9914-8141ba8b7488 is timed out.
Dec 05 15:20:34 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-d353e83d-3cd1-4058-a13f-54d2024195b6 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Successfully detached device sdc from instance f3cdfe20-7429-476d-9914-8141ba8b7488 from the live domain config.
Dec 05 15:20:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d353e83d-3cd1-4058-a13f-54d2024195b6 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d353e83d-3cd1-4058-a13f-54d2024195b6 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIXbkzSN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:20:34 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-d353e83d-3cd1-4058-a13f-54d2024195b6 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:20:34 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-d353e83d-3cd1-4058-a13f-54d2024195b6 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-d353e83d-3cd1-4058-a13f-54d2024195b6 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG nova.objects.instance [None req-37c9b487-44d0-453a-a967-ab6ee8ed6fe1 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lazy-loading 'flavor' on Instance uuid 0259351f-617f-47be-bfb6-2fef1c35bf15 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:20:34 user nova-compute[75080]: ERROR nova.volume.cinder [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Update attachment failed for attachment 2d31093f-c03d-4d8c-a248-f91e770981ee. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ade5cfa4-6f7b-4903-afee-6b2275a341b3) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ade5cfa4-6f7b-4903-afee-6b2275a341b3)
Dec 05 15:20:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b77ccd0-5490-49b7-9077-81dee2c514e7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-37c9b487-44d0-453a-a967-ab6ee8ed6fe1 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-640774861',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-640774861',id=4,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOcchwMQ/y1AsP3A0b3QpAgR94U3k1ch+DL7mOp5G4Jk3dTtQRet9PTuUq+tE9S2nFGwMJzhzoriFDCKnxJ67e/D1DfTAZHVMm0T9FYpXt1Eg6HZqWa1ZIEyx+Gye4eIQ==',key_name='tempest-keypair-1279310443',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:18:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='24e3fe3c0db24db598f947ebfe7a8b3d',ramdisk_id='',reservation_id='r-yuqxc4c9',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1860660485',owner_user_name='tempest-TaggedAttachmentsTest-1860660485-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:18:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bd4a8e35eed47d1b156037a6dda5668',uuid=0259351f-617f-47be-bfb6-2fef1c35bf15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dcdd907f-231e-4ca4-97b6-23f980fa55d9", "address": "fa:16:3e:3a:71:c4", "network": {"id": "c00c0358-c733-4598-b947-d6c502a0c5e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-376926346", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "24e3fe3c0db24db598f947ebfe7a8b3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcdd907f-23", "ovs_interfaceid": "dcdd907f-231e-4ca4-97b6-23f980fa55d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-37c9b487-44d0-453a-a967-ab6ee8ed6fe1 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Converting VIF {"id": "dcdd907f-231e-4ca4-97b6-23f980fa55d9", "address": "fa:16:3e:3a:71:c4", "network": {"id": "c00c0358-c733-4598-b947-d6c502a0c5e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-376926346", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "24e3fe3c0db24db598f947ebfe7a8b3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcdd907f-23", "ovs_interfaceid": "dcdd907f-231e-4ca4-97b6-23f980fa55d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-37c9b487-44d0-453a-a967-ab6ee8ed6fe1 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:71:c4,bridge_name='br-int',has_traffic_filtering=True,id=dcdd907f-231e-4ca4-97b6-23f980fa55d9,network=Network(c00c0358-c733-4598-b947-d6c502a0c5e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcdd907f-23') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d353e83d-3cd1-4058-a13f-54d2024195b6 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:20:34 user nova-compute[75080]: No targets found.
Dec 05 15:20:34 user nova-compute[75080]: iSNS:
Dec 05 15:20:34 user nova-compute[75080]: No targets found.
Dec 05 15:20:34 user nova-compute[75080]: STATIC:
Dec 05 15:20:34 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed
Dec 05 15:20:34 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:34 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:34 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058
Dec 05 15:20:34 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:34 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:34 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f
Dec 05 15:20:34 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:34 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:34 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e
Dec 05 15:20:34 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:34 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:34 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a
Dec 05 15:20:34 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:34 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:34 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8
Dec 05 15:20:34 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:34 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:34 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a
Dec 05 15:20:34 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:34 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:34 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867
Dec 05 15:20:34 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:34 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:34 user nova-compute[75080]: FIRMWARE:
Dec 05 15:20:34 user nova-compute[75080]: No targets found.
Dec 05 15:20:34 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d353e83d-3cd1-4058-a13f-54d2024195b6 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:20:34 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:20:34 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d353e83d-3cd1-4058-a13f-54d2024195b6 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-37c9b487-44d0-453a-a967-ab6ee8ed6fe1 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3a:71:c4"/><model type="virtio"/><mtu size="1442"/><target dev="tapdcdd907f-23"/></interface> {{(pid=75080) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-37c9b487-44d0-453a-a967-ab6ee8ed6fe1 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3a:71:c4"/><model type="virtio"/><mtu size="1442"/><target dev="tapdcdd907f-23"/></interface> {{(pid=75080) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-37c9b487-44d0-453a-a967-ab6ee8ed6fe1 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Attempting to detach device tapdcdd907f-23 from instance 0259351f-617f-47be-bfb6-2fef1c35bf15 from the persistent domain config. {{(pid=75080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-37c9b487-44d0-453a-a967-ab6ee8ed6fe1 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] detach device xml: <interface type="ethernet">
Dec 05 15:20:34 user nova-compute[75080]:   <mac address="fa:16:3e:3a:71:c4"/>
Dec 05 15:20:34 user nova-compute[75080]:   <model type="virtio"/>
Dec 05 15:20:34 user nova-compute[75080]:   <mtu size="1442"/>
Dec 05 15:20:34 user nova-compute[75080]:   <target dev="tapdcdd907f-23"/>
Dec 05 15:20:34 user nova-compute[75080]: </interface>
Dec 05 15:20:34 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-37c9b487-44d0-453a-a967-ab6ee8ed6fe1 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3a:71:c4"/><model type="virtio"/><mtu size="1442"/><target dev="tapdcdd907f-23"/></interface> {{(pid=75080) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea25b4e-6e03-467b-87c8-71b5871d5a49]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-37c9b487-44d0-453a-a967-ab6ee8ed6fe1 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:3a:71:c4"/><model type="virtio"/><mtu size="1442"/><target dev="tapdcdd907f-23"/></interface>not found in domain: <domain type='kvm' id='4'>
Dec 05 15:20:34 user nova-compute[75080]:   <name>instance-00000004</name>
Dec 05 15:20:34 user nova-compute[75080]:   <uuid>0259351f-617f-47be-bfb6-2fef1c35bf15</uuid>
Dec 05 15:20:34 user nova-compute[75080]:   <metadata>
Dec 05 15:20:34 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:20:34 user nova-compute[75080]:   <nova:package version="0.0.0"/>
Dec 05 15:20:34 user nova-compute[75080]:   <nova:name>tempest-device-tagging-server-640774861</nova:name>
Dec 05 15:20:34 user nova-compute[75080]:   <nova:creationTime>2023-12-05 15:19:47</nova:creationTime>
Dec 05 15:20:34 user nova-compute[75080]:   <nova:flavor name="m1.tiny">
Dec 05 15:20:34 user nova-compute[75080]:     <nova:memory>512</nova:memory>
Dec 05 15:20:34 user nova-compute[75080]:     <nova:disk>1</nova:disk>
Dec 05 15:20:34 user nova-compute[75080]:     <nova:swap>0</nova:swap>
Dec 05 15:20:34 user nova-compute[75080]:     <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:20:34 user nova-compute[75080]:     <nova:vcpus>1</nova:vcpus>
Dec 05 15:20:34 user nova-compute[75080]:   </nova:flavor>
Dec 05 15:20:34 user nova-compute[75080]:   <nova:owner>
Dec 05 15:20:34 user nova-compute[75080]:     <nova:user uuid="2bd4a8e35eed47d1b156037a6dda5668">tempest-TaggedAttachmentsTest-1860660485-project-member</nova:user>
Dec 05 15:20:34 user nova-compute[75080]:     <nova:project uuid="24e3fe3c0db24db598f947ebfe7a8b3d">tempest-TaggedAttachmentsTest-1860660485</nova:project>
Dec 05 15:20:34 user nova-compute[75080]:   </nova:owner>
Dec 05 15:20:34 user nova-compute[75080]:   <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:20:34 user nova-compute[75080]:   <nova:ports>
Dec 05 15:20:34 user nova-compute[75080]:     <nova:port uuid="3e2379bd-6e97-45dc-917b-e8e4478a3be0">
Dec 05 15:20:34 user nova-compute[75080]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 05 15:20:34 user nova-compute[75080]:     </nova:port>
Dec 05 15:20:34 user nova-compute[75080]:     <nova:port uuid="dcdd907f-231e-4ca4-97b6-23f980fa55d9">
Dec 05 15:20:34 user nova-compute[75080]:       <nova:ip type="fixed" address="10.10.10.34" ipVersion="4"/>
Dec 05 15:20:34 user nova-compute[75080]:     </nova:port>
Dec 05 15:20:34 user nova-compute[75080]:   </nova:ports>
Dec 05 15:20:34 user nova-compute[75080]: </nova:instance>
Dec 05 15:20:34 user nova-compute[75080]:   </metadata>
Dec 05 15:20:34 user nova-compute[75080]:   <memory unit='KiB'>524288</memory>
Dec 05 15:20:34 user nova-compute[75080]:   <currentMemory unit='KiB'>524288</currentMemory>
Dec 05 15:20:34 user nova-compute[75080]:   <vcpu placement='static'>1</vcpu>
Dec 05 15:20:34 user nova-compute[75080]:   <resource>
Dec 05 15:20:34 user nova-compute[75080]:     <partition>/machine</partition>
Dec 05 15:20:34 user nova-compute[75080]:   </resource>
Dec 05 15:20:34 user nova-compute[75080]:   <sysinfo type='smbios'>
Dec 05 15:20:34 user nova-compute[75080]:     <system>
Dec 05 15:20:34 user nova-compute[75080]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Dec 05 15:20:34 user nova-compute[75080]:       <entry name='product'>OpenStack Nova</entry>
Dec 05 15:20:34 user nova-compute[75080]:       <entry name='version'>0.0.0</entry>
Dec 05 15:20:34 user nova-compute[75080]:       <entry name='serial'>0259351f-617f-47be-bfb6-2fef1c35bf15</entry>
Dec 05 15:20:34 user nova-compute[75080]:       <entry name='uuid'>0259351f-617f-47be-bfb6-2fef1c35bf15</entry>
Dec 05 15:20:34 user nova-compute[75080]:       <entry name='family'>Virtual Machine</entry>
Dec 05 15:20:34 user nova-compute[75080]:     </system>
Dec 05 15:20:34 user nova-compute[75080]:   </sysinfo>
Dec 05 15:20:34 user nova-compute[75080]:   <os>
Dec 05 15:20:34 user nova-compute[75080]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Dec 05 15:20:34 user nova-compute[75080]:     <boot dev='hd'/>
Dec 05 15:20:34 user nova-compute[75080]:     <smbios mode='sysinfo'/>
Dec 05 15:20:34 user nova-compute[75080]:   </os>
Dec 05 15:20:34 user nova-compute[75080]:   <features>
Dec 05 15:20:34 user nova-compute[75080]:     <acpi/>
Dec 05 15:20:34 user nova-compute[75080]:     <apic/>
Dec 05 15:20:34 user nova-compute[75080]:     <vmcoreinfo state='on'/>
Dec 05 15:20:34 user nova-compute[75080]:   </features>
Dec 05 15:20:34 user nova-compute[75080]:   <cpu mode='custom' match='exact' check='full'>
Dec 05 15:20:34 user nova-compute[75080]:     <model fallback='forbid'>Nehalem</model>
Dec 05 15:20:34 user nova-compute[75080]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Dec 05 15:20:34 user nova-compute[75080]:     <feature policy='require' name='vme'/>
Dec 05 15:20:34 user nova-compute[75080]:     <feature policy='require' name='x2apic'/>
Dec 05 15:20:34 user nova-compute[75080]:     <feature policy='require' name='hypervisor'/>
Dec 05 15:20:34 user nova-compute[75080]:   </cpu>
Dec 05 15:20:34 user nova-compute[75080]:   <clock offset='utc'>
Dec 05 15:20:34 user nova-compute[75080]:     <timer name='pit' tickpolicy='delay'/>
Dec 05 15:20:34 user nova-compute[75080]:     <timer name='rtc' tickpolicy='catchup'/>
Dec 05 15:20:34 user nova-compute[75080]:     <timer name='hpet' present='no'/>
Dec 05 15:20:34 user nova-compute[75080]:   </clock>
Dec 05 15:20:34 user nova-compute[75080]:   <on_poweroff>destroy</on_poweroff>
Dec 05 15:20:34 user nova-compute[75080]:   <on_reboot>restart</on_reboot>
Dec 05 15:20:34 user nova-compute[75080]:   <on_crash>destroy</on_crash>
Dec 05 15:20:34 user nova-compute[75080]:   <devices>
Dec 05 15:20:34 user nova-compute[75080]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 05 15:20:34 user nova-compute[75080]:     <disk type='file' device='disk'>
Dec 05 15:20:34 user nova-compute[75080]:       <driver name='qemu' type='qcow2' cache='none'/>
Dec 05 15:20:34 user nova-compute[75080]:       <source file='/opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/disk' index='2'/>
Dec 05 15:20:34 user nova-compute[75080]:       <backingStore type='file' index='3'>
Dec 05 15:20:34 user nova-compute[75080]:         <format type='raw'/>
Dec 05 15:20:34 user nova-compute[75080]:         <source file='/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee'/>
Dec 05 15:20:34 user nova-compute[75080]:         <backingStore/>
Dec 05 15:20:34 user nova-compute[75080]:       </backingStore>
Dec 05 15:20:34 user nova-compute[75080]:       <target dev='vda' bus='virtio'/>
Dec 05 15:20:34 user nova-compute[75080]:       <alias name='virtio-disk0'/>
Dec 05 15:20:34 user nova-compute[75080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Dec 05 15:20:34 user nova-compute[75080]:     </disk>
Dec 05 15:20:34 user nova-compute[75080]:     <disk type='file' device='cdrom'>
Dec 05 15:20:34 user nova-compute[75080]:       <driver name='qemu' type='raw' cache='none'/>
Dec 05 15:20:34 user nova-compute[75080]:       <source file='/opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/disk.config' index='1'/>
Dec 05 15:20:34 user nova-compute[75080]:       <backingStore/>
Dec 05 15:20:34 user nova-compute[75080]:       <target dev='hda' bus='ide'/>
Dec 05 15:20:34 user nova-compute[75080]:       <readonly/>
Dec 05 15:20:34 user nova-compute[75080]:       <alias name='ide0-0-0'/>
Dec 05 15:20:34 user nova-compute[75080]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Dec 05 15:20:34 user nova-compute[75080]:     </disk>
Dec 05 15:20:34 user nova-compute[75080]:     <controller type='usb' index='0' model='none'>
Dec 05 15:20:34 user nova-compute[75080]:       <alias name='usb'/>
Dec 05 15:20:34 user nova-compute[75080]:     </controller>
Dec 05 15:20:34 user nova-compute[75080]:     <controller type='pci' index='0' model='pci-root'>
Dec 05 15:20:34 user nova-compute[75080]:       <alias name='pci.0'/>
Dec 05 15:20:34 user nova-compute[75080]:     </controller>
Dec 05 15:20:34 user nova-compute[75080]:     <controller type='ide' index='0'>
Dec 05 15:20:34 user nova-compute[75080]:       <alias name='ide'/>
Dec 05 15:20:34 user nova-compute[75080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Dec 05 15:20:34 user nova-compute[75080]:     </controller>
Dec 05 15:20:34 user nova-compute[75080]:     <interface type='ethernet'>
Dec 05 15:20:34 user nova-compute[75080]:       <mac address='fa:16:3e:68:6e:ba'/>
Dec 05 15:20:34 user nova-compute[75080]:       <target dev='tap3e2379bd-6e'/>
Dec 05 15:20:34 user nova-compute[75080]:       <model type='virtio'/>
Dec 05 15:20:34 user nova-compute[75080]:       <mtu size='1442'/>
Dec 05 15:20:34 user nova-compute[75080]:       <alias name='net0'/>
Dec 05 15:20:34 user nova-compute[75080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Dec 05 15:20:34 user nova-compute[75080]:     </interface>
Dec 05 15:20:34 user nova-compute[75080]:     <interface type='ethernet'>
Dec 05 15:20:34 user nova-compute[75080]:       <mac address='fa:16:3e:3a:71:c4'/>
Dec 05 15:20:34 user nova-compute[75080]:       <target dev='tapdcdd907f-23'/>
Dec 05 15:20:34 user nova-compute[75080]:       <model type='virtio'/>
Dec 05 15:20:34 user nova-compute[75080]:       <mtu size='1442'/>
Dec 05 15:20:34 user nova-compute[75080]:       <alias name='net1'/>
Dec 05 15:20:34 user nova-compute[75080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Dec 05 15:20:34 user nova-compute[75080]:     </interface>
Dec 05 15:20:34 user nova-compute[75080]:     <serial type='pty'>
Dec 05 15:20:34 user nova-compute[75080]:       <source path='/dev/pts/4'/>
Dec 05 15:20:34 user nova-compute[75080]:       <log file='/opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/console.log' append='off'/>
Dec 05 15:20:34 user nova-compute[75080]:       <target type='isa-serial' port='0'>
Dec 05 15:20:34 user nova-compute[75080]:         <model name='isa-serial'/>
Dec 05 15:20:34 user nova-compute[75080]:       </target>
Dec 05 15:20:34 user nova-compute[75080]:       <alias name='serial0'/>
Dec 05 15:20:34 user nova-compute[75080]:     </serial>
Dec 05 15:20:34 user nova-compute[75080]:     <console type='pty' tty='/dev/pts/4'>
Dec 05 15:20:34 user nova-compute[75080]:       <source path='/dev/pts/4'/>
Dec 05 15:20:34 user nova-compute[75080]:       <log file='/opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/console.log' append='off'/>
Dec 05 15:20:34 user nova-compute[75080]:       <target type='serial' port='0'/>
Dec 05 15:20:34 user nova-compute[75080]:       <alias name='serial0'/>
Dec 05 15:20:34 user nova-compute[75080]:     </console>
Dec 05 15:20:34 user nova-compute[75080]:     <input type='mouse' bus='ps2'>
Dec 05 15:20:34 user nova-compute[75080]:       <alias name='input0'/>
Dec 05 15:20:34 user nova-compute[75080]:     </input>
Dec 05 15:20:34 user nova-compute[75080]:     <input type='keyboard' bus='ps2'>
Dec 05 15:20:34 user nova-compute[75080]:       <alias name='input1'/>
Dec 05 15:20:34 user nova-compute[75080]:     </input>
Dec 05 15:20:34 user nova-compute[75080]:     <graphics type='vnc' port='5903' autoport='yes' listen='0.0.0.0'>
Dec 05 15:20:34 user nova-compute[75080]:       <listen type='address' address='0.0.0.0'/>
Dec 05 15:20:34 user nova-compute[75080]:     </graphics>
Dec 05 15:20:34 user nova-compute[75080]:     <audio id='1' type='none'/>
Dec 05 15:20:34 user nova-compute[75080]:     <video>
Dec 05 15:20:34 user nova-compute[75080]:       <model type='virtio' heads='1' primary='yes'/>
Dec 05 15:20:34 user nova-compute[75080]:       <alias name='video0'/>
Dec 05 15:20:34 user nova-compute[75080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Dec 05 15:20:34 user nova-compute[75080]:     </video>
Dec 05 15:20:34 user nova-compute[75080]:     <memballoon model='virtio'>
Dec 05 15:20:34 user nova-compute[75080]:       <stats period='10'/>
Dec 05 15:20:34 user nova-compute[75080]:       <alias name='balloon0'/>
Dec 05 15:20:34 user nova-compute[75080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Dec 05 15:20:34 user nova-compute[75080]:     </memballoon>
Dec 05 15:20:34 user nova-compute[75080]:     <rng model='virtio'>
Dec 05 15:20:34 user nova-compute[75080]:       <backend model='random'>/dev/urandom</backend>
Dec 05 15:20:34 user nova-compute[75080]:       <alias name='rng0'/>
Dec 05 15:20:34 user nova-compute[75080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Dec 05 15:20:34 user nova-compute[75080]:     </rng>
Dec 05 15:20:34 user nova-compute[75080]:   </devices>
Dec 05 15:20:34 user nova-compute[75080]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Dec 05 15:20:34 user nova-compute[75080]:     <label>libvirt-0259351f-617f-47be-bfb6-2fef1c35bf15</label>
Dec 05 15:20:34 user nova-compute[75080]:     <imagelabel>libvirt-0259351f-617f-47be-bfb6-2fef1c35bf15</imagelabel>
Dec 05 15:20:34 user nova-compute[75080]:   </seclabel>
Dec 05 15:20:34 user nova-compute[75080]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Dec 05 15:20:34 user nova-compute[75080]:     <label>+64055:+108</label>
Dec 05 15:20:34 user nova-compute[75080]:     <imagelabel>+64055:+108</imagelabel>
Dec 05 15:20:34 user nova-compute[75080]:   </seclabel>
Dec 05 15:20:34 user nova-compute[75080]: </domain>
Dec 05 15:20:34 user nova-compute[75080]:  {{(pid=75080) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Dec 05 15:20:34 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-37c9b487-44d0-453a-a967-ab6ee8ed6fe1 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Successfully detached device tapdcdd907f-23 from instance 0259351f-617f-47be-bfb6-2fef1c35bf15 from the persistent domain config.
Dec 05 15:20:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-37c9b487-44d0-453a-a967-ab6ee8ed6fe1 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] (1/8): Attempting to detach device tapdcdd907f-23 with device alias net1 from instance 0259351f-617f-47be-bfb6-2fef1c35bf15 from the live domain config. {{(pid=75080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-37c9b487-44d0-453a-a967-ab6ee8ed6fe1 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] detach device xml: <interface type="ethernet">
Dec 05 15:20:34 user nova-compute[75080]:   <mac address="fa:16:3e:3a:71:c4"/>
Dec 05 15:20:34 user nova-compute[75080]:   <model type="virtio"/>
Dec 05 15:20:34 user nova-compute[75080]:   <mtu size="1442"/>
Dec 05 15:20:34 user nova-compute[75080]:   <target dev="tapdcdd907f-23"/>
Dec 05 15:20:34 user nova-compute[75080]: </interface>
Dec 05 15:20:34 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b14c7a-8de7-4c46-af1e-b2f58ea3669f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d353e83d-3cd1-4058-a13f-54d2024195b6 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)
Dec 05 15:20:34 user nova-compute[75080]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a (non-flash)
Dec 05 15:20:34 user nova-compute[75080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:34 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:20:34 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:20:34 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:20:34 user nova-compute[75080]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 (non-flash)
Dec 05 15:20:34 user nova-compute[75080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e (non-flash)
Dec 05 15:20:34 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d353e83d-3cd1-4058-a13f-54d2024195b6 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)
Dec 05 15:20:34 user nova-compute[75080]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a (non-flash)
Dec 05 15:20:34 user nova-compute[75080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:34 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:20:34 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:20:34 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:20:34 user nova-compute[75080]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 (non-flash)
Dec 05 15:20:34 user nova-compute[75080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e (non-flash)
Dec 05 15:20:34 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d353e83d-3cd1-4058-a13f-54d2024195b6 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6638523e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8'): ({'sdh'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-d353e83d-3cd1-4058-a13f-54d2024195b6 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Removing single pathed devices sdh {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee02dd2-2519-4775-85c7-d555bfdc03ed]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec403df-aa1d-4159-ab5f-9ad0c3c5b050]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-d353e83d-3cd1-4058-a13f-54d2024195b6 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Flushing IO for device /dev/sdh {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efac449-5f65-43e1-934e-2c15c761ef4a]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-d353e83d-3cd1-4058-a13f-54d2024195b6 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.049s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[30217eba-ab4b-4ede-be0f-8acd72d00ec9]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-d353e83d-3cd1-4058-a13f-54d2024195b6 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-d353e83d-3cd1-4058-a13f-54d2024195b6 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] SCSI volumes sdh have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d353e83d-3cd1-4058-a13f-54d2024195b6 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[987de4f3-fb95-4cac-afb1-230f4073e903]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d353e83d-3cd1-4058-a13f-54d2024195b6 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6581ec39-cd97-4c45-8eba-63cfa8f63337]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d353e83d-3cd1-4058-a13f-54d2024195b6 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8, portal: 172.16.0.220,3260]
Dec 05 15:20:34 user nova-compute[75080]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8, portal: 172.16.0.220,3260] successful.
Dec 05 15:20:34 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba054005-ad45-4d43-80e7-8d3c6a7f6ff8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[34280bf5-ee59-4b36-83c2-26163506c960]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d353e83d-3cd1-4058-a13f-54d2024195b6 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-d353e83d-3cd1-4058-a13f-54d2024195b6 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d353e83d-3cd1-4058-a13f-54d2024195b6 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] <== disconnect_volume: return (361ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d353e83d-3cd1-4058-a13f-54d2024195b6 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-37c9b487-44d0-453a-a967-ab6ee8ed6fe1 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Start waiting for the detach event from libvirt for device tapdcdd907f-23 with device alias net1 for instance 0259351f-617f-47be-bfb6-2fef1c35bf15 {{(pid=75080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG nova.compute.manager [req-a92340d6-00e9-4dc1-9525-d04cad18b578 req-717ee25c-9a72-4606-8394-69b0b490089d service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Received event network-vif-unplugged-dcdd907f-231e-4ca4-97b6-23f980fa55d9 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a92340d6-00e9-4dc1-9525-d04cad18b578 req-717ee25c-9a72-4606-8394-69b0b490089d service nova] Acquiring lock "0259351f-617f-47be-bfb6-2fef1c35bf15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a92340d6-00e9-4dc1-9525-d04cad18b578 req-717ee25c-9a72-4606-8394-69b0b490089d service nova] Lock "0259351f-617f-47be-bfb6-2fef1c35bf15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a92340d6-00e9-4dc1-9525-d04cad18b578 req-717ee25c-9a72-4606-8394-69b0b490089d service nova] Lock "0259351f-617f-47be-bfb6-2fef1c35bf15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:34 user nova-compute[75080]: DEBUG nova.compute.manager [req-a92340d6-00e9-4dc1-9525-d04cad18b578 req-717ee25c-9a72-4606-8394-69b0b490089d service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] No waiting events found dispatching network-vif-unplugged-dcdd907f-231e-4ca4-97b6-23f980fa55d9 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:20:34 user nova-compute[75080]: WARNING nova.compute.manager [req-a92340d6-00e9-4dc1-9525-d04cad18b578 req-717ee25c-9a72-4606-8394-69b0b490089d service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Received unexpected event network-vif-unplugged-dcdd907f-231e-4ca4-97b6-23f980fa55d9 for instance with vm_state active and task_state None.
Dec 05 15:20:35 user nova-compute[75080]: DEBUG nova.objects.instance [None req-d353e83d-3cd1-4058-a13f-54d2024195b6 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Lazy-loading 'flavor' on Instance uuid f3cdfe20-7429-476d-9914-8141ba8b7488 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:20:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d353e83d-3cd1-4058-a13f-54d2024195b6 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Lock "f3cdfe20-7429-476d-9914-8141ba8b7488" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.736s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:35 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-22bc2dd4-4e4b-4b07-8c7b-4dbcc2d6a707 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1 is timed out.
Dec 05 15:20:35 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-22bc2dd4-4e4b-4b07-8c7b-4dbcc2d6a707 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Successfully detached device vdb from instance a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1 from the live domain config.
Dec 05 15:20:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22bc2dd4-4e4b-4b07-8c7b-4dbcc2d6a707 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:20:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bc2dd4-4e4b-4b07-8c7b-4dbcc2d6a707 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QUlnuBiN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:20:35 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-22bc2dd4-4e4b-4b07-8c7b-4dbcc2d6a707 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:20:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-22bc2dd4-4e4b-4b07-8c7b-4dbcc2d6a707 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:20:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-22bc2dd4-4e4b-4b07-8c7b-4dbcc2d6a707 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:20:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:35 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[698f5d5b-c486-42a5-b71d-5e0b296c7171]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bc2dd4-4e4b-4b07-8c7b-4dbcc2d6a707 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:20:35 user nova-compute[75080]: No targets found.
Dec 05 15:20:35 user nova-compute[75080]: iSNS:
Dec 05 15:20:35 user nova-compute[75080]: No targets found.
Dec 05 15:20:35 user nova-compute[75080]: STATIC:
Dec 05 15:20:35 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed
Dec 05 15:20:35 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:35 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:35 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058
Dec 05 15:20:35 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:35 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:35 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f
Dec 05 15:20:35 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:35 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:35 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e
Dec 05 15:20:35 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:35 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:35 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a
Dec 05 15:20:35 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:35 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:35 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a
Dec 05 15:20:35 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:35 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:35 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867
Dec 05 15:20:35 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:35 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:35 user nova-compute[75080]: FIRMWARE:
Dec 05 15:20:35 user nova-compute[75080]: No targets found.
Dec 05 15:20:35 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:20:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bc2dd4-4e4b-4b07-8c7b-4dbcc2d6a707 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:20:35 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:20:35 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:20:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bc2dd4-4e4b-4b07-8c7b-4dbcc2d6a707 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:20:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:35 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7d68ce-a03c-44e4-8f82-01b6a28166d8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a602bf21-2986-473c-9b3f-400eb9680828]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bc2dd4-4e4b-4b07-8c7b-4dbcc2d6a707 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)
Dec 05 15:20:36 user nova-compute[75080]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a (non-flash)
Dec 05 15:20:36 user nova-compute[75080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:36 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:20:36 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:20:36 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:20:36 user nova-compute[75080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e (non-flash)
Dec 05 15:20:36 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bc2dd4-4e4b-4b07-8c7b-4dbcc2d6a707 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)
Dec 05 15:20:36 user nova-compute[75080]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a (non-flash)
Dec 05 15:20:36 user nova-compute[75080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:36 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:20:36 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:20:36 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:20:36 user nova-compute[75080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e (non-flash)
Dec 05 15:20:36 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bc2dd4-4e4b-4b07-8c7b-4dbcc2d6a707 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f66384b00d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e'): ({'sdi'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-22bc2dd4-4e4b-4b07-8c7b-4dbcc2d6a707 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Removing single pathed devices sdi {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbec3f2e-ed2a-4c0f-9163-8cfe6f9d8d8c]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b733df-da3f-42f9-8807-32cf01d9b06e]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-22bc2dd4-4e4b-4b07-8c7b-4dbcc2d6a707 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Flushing IO for device /dev/sdi {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9b7cfb-6446-4f4f-a1d5-df83071f3209]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-22bc2dd4-4e4b-4b07-8c7b-4dbcc2d6a707 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.036s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9111024-3c5c-4b13-8dd1-032ce6e8f265]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-22bc2dd4-4e4b-4b07-8c7b-4dbcc2d6a707 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-22bc2dd4-4e4b-4b07-8c7b-4dbcc2d6a707 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] SCSI volumes sdi have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bc2dd4-4e4b-4b07-8c7b-4dbcc2d6a707 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[328d798e-dcaa-4f3d-afd9-b38f60338a4b]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bc2dd4-4e4b-4b07-8c7b-4dbcc2d6a707 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e4c3a3-c849-457e-beac-c25b47e4b670]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bc2dd4-4e4b-4b07-8c7b-4dbcc2d6a707 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e, portal: 172.16.0.220,3260]
Dec 05 15:20:36 user nova-compute[75080]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e, portal: 172.16.0.220,3260] successful.
Dec 05 15:20:36 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f18db39-ee9a-4f2d-a3cf-7609453eec5e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44120c4-0b94-40b1-ad26-706000a420a1]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bc2dd4-4e4b-4b07-8c7b-4dbcc2d6a707 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-22bc2dd4-4e4b-4b07-8c7b-4dbcc2d6a707 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-22bc2dd4-4e4b-4b07-8c7b-4dbcc2d6a707 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] <== disconnect_volume: return (337ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22bc2dd4-4e4b-4b07-8c7b-4dbcc2d6a707 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d88ab3a7-8d01-4829-b8c6-8f2b3d80a795 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Acquiring lock "f3cdfe20-7429-476d-9914-8141ba8b7488" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d88ab3a7-8d01-4829-b8c6-8f2b3d80a795 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Lock "f3cdfe20-7429-476d-9914-8141ba8b7488" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d88ab3a7-8d01-4829-b8c6-8f2b3d80a795 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Acquiring lock "f3cdfe20-7429-476d-9914-8141ba8b7488-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d88ab3a7-8d01-4829-b8c6-8f2b3d80a795 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Lock "f3cdfe20-7429-476d-9914-8141ba8b7488-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d88ab3a7-8d01-4829-b8c6-8f2b3d80a795 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Lock "f3cdfe20-7429-476d-9914-8141ba8b7488-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:36 user nova-compute[75080]: INFO nova.compute.manager [None req-d88ab3a7-8d01-4829-b8c6-8f2b3d80a795 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Terminating instance
Dec 05 15:20:36 user nova-compute[75080]: DEBUG nova.compute.manager [None req-d88ab3a7-8d01-4829-b8c6-8f2b3d80a795 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-417ef52d-773d-4d0d-a2a8-6ecc525e014b tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Acquiring lock "63b86f43-a8f7-4b1d-a2e2-e0f614e6d764" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-417ef52d-773d-4d0d-a2a8-6ecc525e014b tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Lock "63b86f43-a8f7-4b1d-a2e2-e0f614e6d764" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-417ef52d-773d-4d0d-a2a8-6ecc525e014b tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Acquiring lock "63b86f43-a8f7-4b1d-a2e2-e0f614e6d764-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-417ef52d-773d-4d0d-a2a8-6ecc525e014b tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Lock "63b86f43-a8f7-4b1d-a2e2-e0f614e6d764-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-417ef52d-773d-4d0d-a2a8-6ecc525e014b tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Lock "63b86f43-a8f7-4b1d-a2e2-e0f614e6d764-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:36 user nova-compute[75080]: INFO nova.compute.manager [None req-417ef52d-773d-4d0d-a2a8-6ecc525e014b tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Terminating instance
Dec 05 15:20:36 user nova-compute[75080]: DEBUG nova.compute.manager [None req-417ef52d-773d-4d0d-a2a8-6ecc525e014b tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG nova.compute.manager [req-333c52cc-5626-43db-94bc-b0754dcbb09f req-08bd57b9-50cf-46b6-bc08-96cfb64e4ede service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Received event network-vif-plugged-dcdd907f-231e-4ca4-97b6-23f980fa55d9 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-333c52cc-5626-43db-94bc-b0754dcbb09f req-08bd57b9-50cf-46b6-bc08-96cfb64e4ede service nova] Acquiring lock "0259351f-617f-47be-bfb6-2fef1c35bf15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-333c52cc-5626-43db-94bc-b0754dcbb09f req-08bd57b9-50cf-46b6-bc08-96cfb64e4ede service nova] Lock "0259351f-617f-47be-bfb6-2fef1c35bf15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-333c52cc-5626-43db-94bc-b0754dcbb09f req-08bd57b9-50cf-46b6-bc08-96cfb64e4ede service nova] Lock "0259351f-617f-47be-bfb6-2fef1c35bf15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:36 user nova-compute[75080]: DEBUG nova.compute.manager [req-333c52cc-5626-43db-94bc-b0754dcbb09f req-08bd57b9-50cf-46b6-bc08-96cfb64e4ede service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] No waiting events found dispatching network-vif-plugged-dcdd907f-231e-4ca4-97b6-23f980fa55d9 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:20:36 user nova-compute[75080]: WARNING nova.compute.manager [req-333c52cc-5626-43db-94bc-b0754dcbb09f req-08bd57b9-50cf-46b6-bc08-96cfb64e4ede service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Received unexpected event network-vif-plugged-dcdd907f-231e-4ca4-97b6-23f980fa55d9 for instance with vm_state active and task_state None.
Dec 05 15:20:37 user nova-compute[75080]: DEBUG nova.compute.manager [req-d307aef2-7ccc-4a4f-9ed1-76db7dc25ee9 req-33f559c2-648d-479d-acc0-9d56786682b1 service nova] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Received event network-vif-unplugged-a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d307aef2-7ccc-4a4f-9ed1-76db7dc25ee9 req-33f559c2-648d-479d-acc0-9d56786682b1 service nova] Acquiring lock "f3cdfe20-7429-476d-9914-8141ba8b7488-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d307aef2-7ccc-4a4f-9ed1-76db7dc25ee9 req-33f559c2-648d-479d-acc0-9d56786682b1 service nova] Lock "f3cdfe20-7429-476d-9914-8141ba8b7488-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d307aef2-7ccc-4a4f-9ed1-76db7dc25ee9 req-33f559c2-648d-479d-acc0-9d56786682b1 service nova] Lock "f3cdfe20-7429-476d-9914-8141ba8b7488-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG nova.compute.manager [req-d307aef2-7ccc-4a4f-9ed1-76db7dc25ee9 req-33f559c2-648d-479d-acc0-9d56786682b1 service nova] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] No waiting events found dispatching network-vif-unplugged-a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG nova.compute.manager [req-d307aef2-7ccc-4a4f-9ed1-76db7dc25ee9 req-33f559c2-648d-479d-acc0-9d56786682b1 service nova] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Received event network-vif-unplugged-a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347 for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:20:37 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Instance destroyed successfully.
Dec 05 15:20:37 user nova-compute[75080]: DEBUG nova.objects.instance [None req-417ef52d-773d-4d0d-a2a8-6ecc525e014b tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Lazy-loading 'resources' on Instance uuid 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-417ef52d-773d-4d0d-a2a8-6ecc525e014b tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:18:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1812956123',display_name='tempest-VolumesActionsTest-instance-1812956123',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1812956123',id=9,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:18:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='902ae7a7ca524dfa83b98c3baebc42eb',ramdisk_id='',reservation_id='r-x6g6xe7v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-10205127',owner_user_name='tempest-VolumesActionsTest-10205127-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:18:52Z,user_data=None,user_id='fc3019c10eb549e984490b34eee7814e',uuid=63b86f43-a8f7-4b1d-a2e2-e0f614e6d764,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "367c561b-8d85-4af4-9abb-3e020c3b3cea", "address": "fa:16:3e:b4:73:45", "network": {"id": "6d5934bf-c431-4a09-8065-8928349e88a0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-238283929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "902ae7a7ca524dfa83b98c3baebc42eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap367c561b-8d", "ovs_interfaceid": "367c561b-8d85-4af4-9abb-3e020c3b3cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-417ef52d-773d-4d0d-a2a8-6ecc525e014b tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Converting VIF {"id": "367c561b-8d85-4af4-9abb-3e020c3b3cea", "address": "fa:16:3e:b4:73:45", "network": {"id": "6d5934bf-c431-4a09-8065-8928349e88a0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-238283929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "902ae7a7ca524dfa83b98c3baebc42eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap367c561b-8d", "ovs_interfaceid": "367c561b-8d85-4af4-9abb-3e020c3b3cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-417ef52d-773d-4d0d-a2a8-6ecc525e014b tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:73:45,bridge_name='br-int',has_traffic_filtering=True,id=367c561b-8d85-4af4-9abb-3e020c3b3cea,network=Network(6d5934bf-c431-4a09-8065-8928349e88a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap367c561b-8d') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG os_vif [None req-417ef52d-773d-4d0d-a2a8-6ecc525e014b tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:73:45,bridge_name='br-int',has_traffic_filtering=True,id=367c561b-8d85-4af4-9abb-3e020c3b3cea,network=Network(6d5934bf-c431-4a09-8065-8928349e88a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap367c561b-8d') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG nova.compute.manager [req-9dd52d73-8d20-4ed0-b964-333ee2a38fb4 req-8a9ae5a4-1e4e-4fb2-ae49-30a1667c3923 service nova] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Received event network-vif-unplugged-367c561b-8d85-4af4-9abb-3e020c3b3cea {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9dd52d73-8d20-4ed0-b964-333ee2a38fb4 req-8a9ae5a4-1e4e-4fb2-ae49-30a1667c3923 service nova] Acquiring lock "63b86f43-a8f7-4b1d-a2e2-e0f614e6d764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9dd52d73-8d20-4ed0-b964-333ee2a38fb4 req-8a9ae5a4-1e4e-4fb2-ae49-30a1667c3923 service nova] Lock "63b86f43-a8f7-4b1d-a2e2-e0f614e6d764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9dd52d73-8d20-4ed0-b964-333ee2a38fb4 req-8a9ae5a4-1e4e-4fb2-ae49-30a1667c3923 service nova] Lock "63b86f43-a8f7-4b1d-a2e2-e0f614e6d764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG nova.compute.manager [req-9dd52d73-8d20-4ed0-b964-333ee2a38fb4 req-8a9ae5a4-1e4e-4fb2-ae49-30a1667c3923 service nova] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] No waiting events found dispatching network-vif-unplugged-367c561b-8d85-4af4-9abb-3e020c3b3cea {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG nova.compute.manager [req-9dd52d73-8d20-4ed0-b964-333ee2a38fb4 req-8a9ae5a4-1e4e-4fb2-ae49-30a1667c3923 service nova] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Received event network-vif-unplugged-367c561b-8d85-4af4-9abb-3e020c3b3cea for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap367c561b-8d, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=98e9d71c-f0d9-4bac-9a3d-8d5bafbff2d7) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:37 user nova-compute[75080]: INFO os_vif [None req-417ef52d-773d-4d0d-a2a8-6ecc525e014b tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:73:45,bridge_name='br-int',has_traffic_filtering=True,id=367c561b-8d85-4af4-9abb-3e020c3b3cea,network=Network(6d5934bf-c431-4a09-8065-8928349e88a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap367c561b-8d')
Dec 05 15:20:37 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-417ef52d-773d-4d0d-a2a8-6ecc525e014b tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Deleting instance files /opt/stack/data/nova/instances/63b86f43-a8f7-4b1d-a2e2-e0f614e6d764_del
Dec 05 15:20:37 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-417ef52d-773d-4d0d-a2a8-6ecc525e014b tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Deletion of /opt/stack/data/nova/instances/63b86f43-a8f7-4b1d-a2e2-e0f614e6d764_del complete
Dec 05 15:20:37 user nova-compute[75080]: INFO nova.compute.manager [None req-417ef52d-773d-4d0d-a2a8-6ecc525e014b tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Took 1.00 seconds to destroy the instance on the hypervisor.
Dec 05 15:20:37 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-417ef52d-773d-4d0d-a2a8-6ecc525e014b tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:20:37 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Instance destroyed successfully.
Dec 05 15:20:37 user nova-compute[75080]: DEBUG nova.objects.instance [None req-d88ab3a7-8d01-4829-b8c6-8f2b3d80a795 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Lazy-loading 'resources' on Instance uuid f3cdfe20-7429-476d-9914-8141ba8b7488 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-d88ab3a7-8d01-4829-b8c6-8f2b3d80a795 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:17:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1665648734',display_name='tempest-AttachSCSIVolumeTestJSON-server-1665648734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1665648734',id=5,image_ref='d433c1b8-6238-4615-b3e0-770c9979eaa3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3H7IrGvwJnVimVL3mSFLR4Ol5APRQWonNfqRxeQqo3RIzRkDUzcLtdZmolBIAkNis+VEu6VRYhkBV3Qowx1pDHyM4iaHjG2Rl0Tg9+bZQlw/cqLvUPQa3pYth9HwWPPA==',key_name='tempest-keypair-1114107675',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:18:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e2a6722602c4978b5eb12cdce13bb1b',ramdisk_id='',reservation_id='r-qwvx6ck6',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d433c1b8-6238-4615-b3e0-770c9979eaa3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1974012192',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1974012192-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:18:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e7816a5ba3b4d0c91cd742070069bba',uuid=f3cdfe20-7429-476d-9914-8141ba8b7488,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347", "address": "fa:16:3e:cd:52:36", "network": {"id": "eed25aef-3f43-4c98-8113-f5720a304787", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1510992179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e2a6722602c4978b5eb12cdce13bb1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa66b89bf-3d", "ovs_interfaceid": "a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-d88ab3a7-8d01-4829-b8c6-8f2b3d80a795 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Converting VIF {"id": "a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347", "address": "fa:16:3e:cd:52:36", "network": {"id": "eed25aef-3f43-4c98-8113-f5720a304787", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1510992179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e2a6722602c4978b5eb12cdce13bb1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa66b89bf-3d", "ovs_interfaceid": "a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-d88ab3a7-8d01-4829-b8c6-8f2b3d80a795 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:52:36,bridge_name='br-int',has_traffic_filtering=True,id=a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347,network=Network(eed25aef-3f43-4c98-8113-f5720a304787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa66b89bf-3d') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG os_vif [None req-d88ab3a7-8d01-4829-b8c6-8f2b3d80a795 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:52:36,bridge_name='br-int',has_traffic_filtering=True,id=a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347,network=Network(eed25aef-3f43-4c98-8113-f5720a304787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa66b89bf-3d') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG nova.objects.instance [None req-22bc2dd4-4e4b-4b07-8c7b-4dbcc2d6a707 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lazy-loading 'flavor' on Instance uuid a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa66b89bf-3d, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9e01b089-a337-4cb6-bc91-648f60c5b3fb) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:37 user nova-compute[75080]: INFO os_vif [None req-d88ab3a7-8d01-4829-b8c6-8f2b3d80a795 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:52:36,bridge_name='br-int',has_traffic_filtering=True,id=a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347,network=Network(eed25aef-3f43-4c98-8113-f5720a304787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa66b89bf-3d')
Dec 05 15:20:37 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-d88ab3a7-8d01-4829-b8c6-8f2b3d80a795 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Deleting instance files /opt/stack/data/nova/instances/f3cdfe20-7429-476d-9914-8141ba8b7488_del
Dec 05 15:20:37 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-d88ab3a7-8d01-4829-b8c6-8f2b3d80a795 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Deletion of /opt/stack/data/nova/instances/f3cdfe20-7429-476d-9914-8141ba8b7488_del complete
Dec 05 15:20:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-22bc2dd4-4e4b-4b07-8c7b-4dbcc2d6a707 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.379s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:37 user nova-compute[75080]: INFO nova.compute.manager [None req-d88ab3a7-8d01-4829-b8c6-8f2b3d80a795 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Took 1.44 seconds to destroy the instance on the hypervisor.
Dec 05 15:20:37 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-d88ab3a7-8d01-4829-b8c6-8f2b3d80a795 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:20:37 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:20:38 user nova-compute[75080]: ERROR nova.volume.cinder [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Update attachment failed for attachment b88d6a31-622f-48c7-8e49-e6a2b0f7f747. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-df5eca45-76ea-4636-971d-36b918aa98bb) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-df5eca45-76ea-4636-971d-36b918aa98bb)
Dec 05 15:20:38 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:20:38 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Took 0.76 seconds to deallocate network for instance.
Dec 05 15:20:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-417ef52d-773d-4d0d-a2a8-6ecc525e014b tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-417ef52d-773d-4d0d-a2a8-6ecc525e014b tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:38 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-417ef52d-773d-4d0d-a2a8-6ecc525e014b tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:20:38 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-417ef52d-773d-4d0d-a2a8-6ecc525e014b tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:20:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-417ef52d-773d-4d0d-a2a8-6ecc525e014b tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.406s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:38 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:20:38 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-417ef52d-773d-4d0d-a2a8-6ecc525e014b tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Deleted allocations for instance 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764
Dec 05 15:20:38 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Took 0.94 seconds to deallocate network for instance.
Dec 05 15:20:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d88ab3a7-8d01-4829-b8c6-8f2b3d80a795 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d88ab3a7-8d01-4829-b8c6-8f2b3d80a795 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-417ef52d-773d-4d0d-a2a8-6ecc525e014b tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Lock "63b86f43-a8f7-4b1d-a2e2-e0f614e6d764" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.399s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:38 user nova-compute[75080]: DEBUG nova.compute.manager [req-6f2b6254-72be-448d-811f-8a5c5d4386f2 req-79966c17-5a1e-47fe-9eee-b6cd3be213da service nova] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Received event network-vif-deleted-367c561b-8d85-4af4-9abb-3e020c3b3cea {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:20:39 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-d88ab3a7-8d01-4829-b8c6-8f2b3d80a795 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:20:39 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-d88ab3a7-8d01-4829-b8c6-8f2b3d80a795 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:20:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d88ab3a7-8d01-4829-b8c6-8f2b3d80a795 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.352s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:39 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-d88ab3a7-8d01-4829-b8c6-8f2b3d80a795 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Deleted allocations for instance f3cdfe20-7429-476d-9914-8141ba8b7488
Dec 05 15:20:39 user nova-compute[75080]: DEBUG nova.compute.manager [req-a42c7df5-5330-4c9c-adc1-09be1ee937ba req-07183b4f-f702-4c6d-b85d-828099617341 service nova] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Received event network-vif-plugged-a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:20:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a42c7df5-5330-4c9c-adc1-09be1ee937ba req-07183b4f-f702-4c6d-b85d-828099617341 service nova] Acquiring lock "f3cdfe20-7429-476d-9914-8141ba8b7488-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a42c7df5-5330-4c9c-adc1-09be1ee937ba req-07183b4f-f702-4c6d-b85d-828099617341 service nova] Lock "f3cdfe20-7429-476d-9914-8141ba8b7488-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a42c7df5-5330-4c9c-adc1-09be1ee937ba req-07183b4f-f702-4c6d-b85d-828099617341 service nova] Lock "f3cdfe20-7429-476d-9914-8141ba8b7488-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:39 user nova-compute[75080]: DEBUG nova.compute.manager [req-a42c7df5-5330-4c9c-adc1-09be1ee937ba req-07183b4f-f702-4c6d-b85d-828099617341 service nova] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] No waiting events found dispatching network-vif-plugged-a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:20:39 user nova-compute[75080]: WARNING nova.compute.manager [req-a42c7df5-5330-4c9c-adc1-09be1ee937ba req-07183b4f-f702-4c6d-b85d-828099617341 service nova] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Received unexpected event network-vif-plugged-a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347 for instance with vm_state deleted and task_state None.
Dec 05 15:20:39 user nova-compute[75080]: DEBUG nova.compute.manager [req-e404fa5e-6654-42cc-adb6-b6b13d0eddaf req-1b8201f6-1750-4d5e-af4f-3d216dad8b4f service nova] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Received event network-vif-plugged-367c561b-8d85-4af4-9abb-3e020c3b3cea {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:20:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-e404fa5e-6654-42cc-adb6-b6b13d0eddaf req-1b8201f6-1750-4d5e-af4f-3d216dad8b4f service nova] Acquiring lock "63b86f43-a8f7-4b1d-a2e2-e0f614e6d764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-e404fa5e-6654-42cc-adb6-b6b13d0eddaf req-1b8201f6-1750-4d5e-af4f-3d216dad8b4f service nova] Lock "63b86f43-a8f7-4b1d-a2e2-e0f614e6d764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-e404fa5e-6654-42cc-adb6-b6b13d0eddaf req-1b8201f6-1750-4d5e-af4f-3d216dad8b4f service nova] Lock "63b86f43-a8f7-4b1d-a2e2-e0f614e6d764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:39 user nova-compute[75080]: DEBUG nova.compute.manager [req-e404fa5e-6654-42cc-adb6-b6b13d0eddaf req-1b8201f6-1750-4d5e-af4f-3d216dad8b4f service nova] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] No waiting events found dispatching network-vif-plugged-367c561b-8d85-4af4-9abb-3e020c3b3cea {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:20:39 user nova-compute[75080]: WARNING nova.compute.manager [req-e404fa5e-6654-42cc-adb6-b6b13d0eddaf req-1b8201f6-1750-4d5e-af4f-3d216dad8b4f service nova] [instance: 63b86f43-a8f7-4b1d-a2e2-e0f614e6d764] Received unexpected event network-vif-plugged-367c561b-8d85-4af4-9abb-3e020c3b3cea for instance with vm_state deleted and task_state None.
Dec 05 15:20:39 user nova-compute[75080]: DEBUG nova.compute.manager [req-e404fa5e-6654-42cc-adb6-b6b13d0eddaf req-1b8201f6-1750-4d5e-af4f-3d216dad8b4f service nova] [instance: f3cdfe20-7429-476d-9914-8141ba8b7488] Received event network-vif-deleted-a66b89bf-3dcd-46e9-b4b9-3f7dfaeca347 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:20:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d88ab3a7-8d01-4829-b8c6-8f2b3d80a795 tempest-AttachSCSIVolumeTestJSON-1974012192 tempest-AttachSCSIVolumeTestJSON-1974012192-project-member] Lock "f3cdfe20-7429-476d-9914-8141ba8b7488" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.938s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:46 user nova-compute[75080]: DEBUG nova.compute.manager [req-53766171-c522-4c4d-887e-0baf12586276 req-e87b15c2-a336-460a-8810-723d2fce335d service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-changed-6fc199c0-dcfd-4c56-a910-37478f4c85bb {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:20:46 user nova-compute[75080]: DEBUG nova.compute.manager [req-53766171-c522-4c4d-887e-0baf12586276 req-e87b15c2-a336-460a-8810-723d2fce335d service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Refreshing instance network info cache due to event network-changed-6fc199c0-dcfd-4c56-a910-37478f4c85bb. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:20:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-53766171-c522-4c4d-887e-0baf12586276 req-e87b15c2-a336-460a-8810-723d2fce335d service nova] Acquiring lock "refresh_cache-912b0528-be16-427f-84fc-8a6cf89d5000" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:20:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-53766171-c522-4c4d-887e-0baf12586276 req-e87b15c2-a336-460a-8810-723d2fce335d service nova] Acquired lock "refresh_cache-912b0528-be16-427f-84fc-8a6cf89d5000" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:20:46 user nova-compute[75080]: DEBUG nova.network.neutron [req-53766171-c522-4c4d-887e-0baf12586276 req-e87b15c2-a336-460a-8810-723d2fce335d service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Refreshing network info cache for port 6fc199c0-dcfd-4c56-a910-37478f4c85bb {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:20:46 user nova-compute[75080]: DEBUG nova.network.neutron [req-53766171-c522-4c4d-887e-0baf12586276 req-e87b15c2-a336-460a-8810-723d2fce335d service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Updated VIF entry in instance network info cache for port 6fc199c0-dcfd-4c56-a910-37478f4c85bb. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:20:46 user nova-compute[75080]: DEBUG nova.network.neutron [req-53766171-c522-4c4d-887e-0baf12586276 req-e87b15c2-a336-460a-8810-723d2fce335d service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Updating instance_info_cache with network_info: [{"id": "6fc199c0-dcfd-4c56-a910-37478f4c85bb", "address": "fa:16:3e:74:76:f4", "network": {"id": "a9446f1c-bd4f-47f6-a76d-8e479fe32437", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-273850890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fc199c0-dc", "ovs_interfaceid": "6fc199c0-dcfd-4c56-a910-37478f4c85bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ac602c3-db8c-42fd-a71f-1664e7a33d9a", "address": "fa:16:3e:4a:ae:17", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac602c3-db", "ovs_interfaceid": "4ac602c3-db8c-42fd-a71f-1664e7a33d9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "05511460-e0ce-4cd0-9d83-f61d776230e3", "address": "fa:16:3e:4c:56:ff", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05511460-e0", "ovs_interfaceid": "05511460-e0ce-4cd0-9d83-f61d776230e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b5f4ea2a-ca87-42b4-a7fe-0234b8567230", "address": "fa:16:3e:86:2e:34", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f4ea2a-ca", "ovs_interfaceid": "b5f4ea2a-ca87-42b4-a7fe-0234b8567230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08064378-9b0c-4b96-a818-6bbd4e31b553", "address": "fa:16:3e:58:dc:50", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08064378-9b", "ovs_interfaceid": "08064378-9b0c-4b96-a818-6bbd4e31b553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d89c793b-d55a-47b5-a857-bfb4b02d9781", "address": "fa:16:3e:38:ba:63", "network": {"id": "552adb39-e03e-4478-ac90-a3ca91fdce4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1038445196", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd89c793b-d5", "ovs_interfaceid": "d89c793b-d55a-47b5-a857-bfb4b02d9781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c", "address": "fa:16:3e:4a:8d:8f", "network": {"id": "552adb39-e03e-4478-ac90-a3ca91fdce4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1038445196", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac25d6a-4e", "ovs_interfaceid": "eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:20:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-53766171-c522-4c4d-887e-0baf12586276 req-e87b15c2-a336-460a-8810-723d2fce335d service nova] Releasing lock "refresh_cache-912b0528-be16-427f-84fc-8a6cf89d5000" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:20:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Acquiring lock "912b0528-be16-427f-84fc-8a6cf89d5000" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Lock "912b0528-be16-427f-84fc-8a6cf89d5000" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Acquiring lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:48 user nova-compute[75080]: INFO nova.compute.manager [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Terminating instance
Dec 05 15:20:48 user nova-compute[75080]: DEBUG nova.compute.manager [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:20:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:48 user nova-compute[75080]: DEBUG nova.compute.manager [req-a0862634-6262-4ad3-8bd2-f2a3ded15f50 req-f7e597ba-f59e-4517-b27d-f0f827c54fab service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-unplugged-6fc199c0-dcfd-4c56-a910-37478f4c85bb {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:20:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a0862634-6262-4ad3-8bd2-f2a3ded15f50 req-f7e597ba-f59e-4517-b27d-f0f827c54fab service nova] Acquiring lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a0862634-6262-4ad3-8bd2-f2a3ded15f50 req-f7e597ba-f59e-4517-b27d-f0f827c54fab service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a0862634-6262-4ad3-8bd2-f2a3ded15f50 req-f7e597ba-f59e-4517-b27d-f0f827c54fab service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:48 user nova-compute[75080]: DEBUG nova.compute.manager [req-a0862634-6262-4ad3-8bd2-f2a3ded15f50 req-f7e597ba-f59e-4517-b27d-f0f827c54fab service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] No waiting events found dispatching network-vif-unplugged-6fc199c0-dcfd-4c56-a910-37478f4c85bb {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:20:48 user nova-compute[75080]: DEBUG nova.compute.manager [req-a0862634-6262-4ad3-8bd2-f2a3ded15f50 req-f7e597ba-f59e-4517-b27d-f0f827c54fab service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-unplugged-6fc199c0-dcfd-4c56-a910-37478f4c85bb for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:20:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:49 user nova-compute[75080]: DEBUG nova.compute.manager [req-96b1b78c-f420-407c-a6fc-594b32a4c5ea req-ce03e0ed-5cb5-4fa9-ab4a-03dc10f72757 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-unplugged-4ac602c3-db8c-42fd-a71f-1664e7a33d9a {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:20:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-96b1b78c-f420-407c-a6fc-594b32a4c5ea req-ce03e0ed-5cb5-4fa9-ab4a-03dc10f72757 service nova] Acquiring lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-96b1b78c-f420-407c-a6fc-594b32a4c5ea req-ce03e0ed-5cb5-4fa9-ab4a-03dc10f72757 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-96b1b78c-f420-407c-a6fc-594b32a4c5ea req-ce03e0ed-5cb5-4fa9-ab4a-03dc10f72757 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:49 user nova-compute[75080]: DEBUG nova.compute.manager [req-96b1b78c-f420-407c-a6fc-594b32a4c5ea req-ce03e0ed-5cb5-4fa9-ab4a-03dc10f72757 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] No waiting events found dispatching network-vif-unplugged-4ac602c3-db8c-42fd-a71f-1664e7a33d9a {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:20:49 user nova-compute[75080]: DEBUG nova.compute.manager [req-96b1b78c-f420-407c-a6fc-594b32a4c5ea req-ce03e0ed-5cb5-4fa9-ab4a-03dc10f72757 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-unplugged-4ac602c3-db8c-42fd-a71f-1664e7a33d9a for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:20:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:49 user nova-compute[75080]: DEBUG nova.compute.manager [req-a6cff21c-778d-49d7-8a54-c8a94d5ef50b req-225220a4-46f6-45dc-b192-20c92ecbd261 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-unplugged-b5f4ea2a-ca87-42b4-a7fe-0234b8567230 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:20:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a6cff21c-778d-49d7-8a54-c8a94d5ef50b req-225220a4-46f6-45dc-b192-20c92ecbd261 service nova] Acquiring lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a6cff21c-778d-49d7-8a54-c8a94d5ef50b req-225220a4-46f6-45dc-b192-20c92ecbd261 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a6cff21c-778d-49d7-8a54-c8a94d5ef50b req-225220a4-46f6-45dc-b192-20c92ecbd261 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:49 user nova-compute[75080]: DEBUG nova.compute.manager [req-a6cff21c-778d-49d7-8a54-c8a94d5ef50b req-225220a4-46f6-45dc-b192-20c92ecbd261 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] No waiting events found dispatching network-vif-unplugged-b5f4ea2a-ca87-42b4-a7fe-0234b8567230 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:20:49 user nova-compute[75080]: DEBUG nova.compute.manager [req-a6cff21c-778d-49d7-8a54-c8a94d5ef50b req-225220a4-46f6-45dc-b192-20c92ecbd261 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-unplugged-b5f4ea2a-ca87-42b4-a7fe-0234b8567230 for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:20:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:50 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Instance destroyed successfully.
Dec 05 15:20:50 user nova-compute[75080]: DEBUG nova.objects.instance [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Lazy-loading 'resources' on Instance uuid 912b0528-be16-427f-84fc-8a6cf89d5000 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:18:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174925668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174925668',id=10,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHK7Ceny/4wgBfAUwFIy0jKcP3pm9AXL1VYOmtUxhFboGcu4M4VBVSnAyAsPHPSjfIfcCdCI36JPaLWtGUaQKjuFjNLj9cN1QOT++IwetaV0zm/g0TGwm5lA9cWkw5Shw==',key_name='tempest-keypair-1933341906',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:19:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3bd42ae707642a09acd3c394fd36a88',ramdisk_id='',reservation_id='r-faxly3br',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-987206712',owner_user_name='tempest-TaggedBootDevicesTest-987206712-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:19:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05a2411551904db193548223ad5e3be8',uuid=912b0528-be16-427f-84fc-8a6cf89d5000,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6fc199c0-dcfd-4c56-a910-37478f4c85bb", "address": "fa:16:3e:74:76:f4", "network": {"id": "a9446f1c-bd4f-47f6-a76d-8e479fe32437", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-273850890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fc199c0-dc", "ovs_interfaceid": "6fc199c0-dcfd-4c56-a910-37478f4c85bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converting VIF {"id": "6fc199c0-dcfd-4c56-a910-37478f4c85bb", "address": "fa:16:3e:74:76:f4", "network": {"id": "a9446f1c-bd4f-47f6-a76d-8e479fe32437", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-273850890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fc199c0-dc", "ovs_interfaceid": "6fc199c0-dcfd-4c56-a910-37478f4c85bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:76:f4,bridge_name='br-int',has_traffic_filtering=True,id=6fc199c0-dcfd-4c56-a910-37478f4c85bb,network=Network(a9446f1c-bd4f-47f6-a76d-8e479fe32437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fc199c0-dc') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG os_vif [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:76:f4,bridge_name='br-int',has_traffic_filtering=True,id=6fc199c0-dcfd-4c56-a910-37478f4c85bb,network=Network(a9446f1c-bd4f-47f6-a76d-8e479fe32437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fc199c0-dc') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6fc199c0-dc, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7ceedcf8-c040-41aa-84a6-25519794ad7f) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:50 user nova-compute[75080]: INFO os_vif [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:76:f4,bridge_name='br-int',has_traffic_filtering=True,id=6fc199c0-dcfd-4c56-a910-37478f4c85bb,network=Network(a9446f1c-bd4f-47f6-a76d-8e479fe32437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fc199c0-dc')
Dec 05 15:20:50 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:18:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174925668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174925668',id=10,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHK7Ceny/4wgBfAUwFIy0jKcP3pm9AXL1VYOmtUxhFboGcu4M4VBVSnAyAsPHPSjfIfcCdCI36JPaLWtGUaQKjuFjNLj9cN1QOT++IwetaV0zm/g0TGwm5lA9cWkw5Shw==',key_name='tempest-keypair-1933341906',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:19:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3bd42ae707642a09acd3c394fd36a88',ramdisk_id='',reservation_id='r-faxly3br',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-987206712',owner_user_name='tempest-TaggedBootDevicesTest-987206712-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:19:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05a2411551904db193548223ad5e3be8',uuid=912b0528-be16-427f-84fc-8a6cf89d5000,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ac602c3-db8c-42fd-a71f-1664e7a33d9a", "address": "fa:16:3e:4a:ae:17", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac602c3-db", "ovs_interfaceid": "4ac602c3-db8c-42fd-a71f-1664e7a33d9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converting VIF {"id": "4ac602c3-db8c-42fd-a71f-1664e7a33d9a", "address": "fa:16:3e:4a:ae:17", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac602c3-db", "ovs_interfaceid": "4ac602c3-db8c-42fd-a71f-1664e7a33d9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ae:17,bridge_name='br-int',has_traffic_filtering=True,id=4ac602c3-db8c-42fd-a71f-1664e7a33d9a,network=Network(2c38d0dd-fd3c-45ea-8455-3c9bea79261c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4ac602c3-db') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG os_vif [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ae:17,bridge_name='br-int',has_traffic_filtering=True,id=4ac602c3-db8c-42fd-a71f-1664e7a33d9a,network=Network(2c38d0dd-fd3c-45ea-8455-3c9bea79261c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4ac602c3-db') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ac602c3-db, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bd69ffd1-0f9b-42a2-80b9-278a198443b3) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:50 user nova-compute[75080]: INFO os_vif [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ae:17,bridge_name='br-int',has_traffic_filtering=True,id=4ac602c3-db8c-42fd-a71f-1664e7a33d9a,network=Network(2c38d0dd-fd3c-45ea-8455-3c9bea79261c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4ac602c3-db')
Dec 05 15:20:50 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:18:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174925668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174925668',id=10,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHK7Ceny/4wgBfAUwFIy0jKcP3pm9AXL1VYOmtUxhFboGcu4M4VBVSnAyAsPHPSjfIfcCdCI36JPaLWtGUaQKjuFjNLj9cN1QOT++IwetaV0zm/g0TGwm5lA9cWkw5Shw==',key_name='tempest-keypair-1933341906',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:19:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3bd42ae707642a09acd3c394fd36a88',ramdisk_id='',reservation_id='r-faxly3br',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-987206712',owner_user_name='tempest-TaggedBootDevicesTest-987206712-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:19:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05a2411551904db193548223ad5e3be8',uuid=912b0528-be16-427f-84fc-8a6cf89d5000,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05511460-e0ce-4cd0-9d83-f61d776230e3", "address": "fa:16:3e:4c:56:ff", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05511460-e0", "ovs_interfaceid": "05511460-e0ce-4cd0-9d83-f61d776230e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converting VIF {"id": "05511460-e0ce-4cd0-9d83-f61d776230e3", "address": "fa:16:3e:4c:56:ff", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05511460-e0", "ovs_interfaceid": "05511460-e0ce-4cd0-9d83-f61d776230e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:56:ff,bridge_name='br-int',has_traffic_filtering=True,id=05511460-e0ce-4cd0-9d83-f61d776230e3,network=Network(2c38d0dd-fd3c-45ea-8455-3c9bea79261c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap05511460-e0') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG os_vif [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:56:ff,bridge_name='br-int',has_traffic_filtering=True,id=05511460-e0ce-4cd0-9d83-f61d776230e3,network=Network(2c38d0dd-fd3c-45ea-8455-3c9bea79261c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap05511460-e0') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05511460-e0, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5bbe2cbf-4165-4dcb-907a-14f0ae19b515) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:50 user nova-compute[75080]: INFO os_vif [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:56:ff,bridge_name='br-int',has_traffic_filtering=True,id=05511460-e0ce-4cd0-9d83-f61d776230e3,network=Network(2c38d0dd-fd3c-45ea-8455-3c9bea79261c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap05511460-e0')
Dec 05 15:20:50 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:18:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174925668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174925668',id=10,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHK7Ceny/4wgBfAUwFIy0jKcP3pm9AXL1VYOmtUxhFboGcu4M4VBVSnAyAsPHPSjfIfcCdCI36JPaLWtGUaQKjuFjNLj9cN1QOT++IwetaV0zm/g0TGwm5lA9cWkw5Shw==',key_name='tempest-keypair-1933341906',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:19:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3bd42ae707642a09acd3c394fd36a88',ramdisk_id='',reservation_id='r-faxly3br',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-987206712',owner_user_name='tempest-TaggedBootDevicesTest-987206712-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:19:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05a2411551904db193548223ad5e3be8',uuid=912b0528-be16-427f-84fc-8a6cf89d5000,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5f4ea2a-ca87-42b4-a7fe-0234b8567230", "address": "fa:16:3e:86:2e:34", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f4ea2a-ca", "ovs_interfaceid": "b5f4ea2a-ca87-42b4-a7fe-0234b8567230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converting VIF {"id": "b5f4ea2a-ca87-42b4-a7fe-0234b8567230", "address": "fa:16:3e:86:2e:34", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f4ea2a-ca", "ovs_interfaceid": "b5f4ea2a-ca87-42b4-a7fe-0234b8567230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:2e:34,bridge_name='br-int',has_traffic_filtering=True,id=b5f4ea2a-ca87-42b4-a7fe-0234b8567230,network=Network(2c38d0dd-fd3c-45ea-8455-3c9bea79261c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f4ea2a-ca') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG os_vif [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:2e:34,bridge_name='br-int',has_traffic_filtering=True,id=b5f4ea2a-ca87-42b4-a7fe-0234b8567230,network=Network(2c38d0dd-fd3c-45ea-8455-3c9bea79261c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f4ea2a-ca') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5f4ea2a-ca, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cddcb3cb-f547-4dc4-8267-700e1ddaa0ae) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:50 user nova-compute[75080]: INFO os_vif [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:2e:34,bridge_name='br-int',has_traffic_filtering=True,id=b5f4ea2a-ca87-42b4-a7fe-0234b8567230,network=Network(2c38d0dd-fd3c-45ea-8455-3c9bea79261c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f4ea2a-ca')
Dec 05 15:20:50 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:18:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174925668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174925668',id=10,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHK7Ceny/4wgBfAUwFIy0jKcP3pm9AXL1VYOmtUxhFboGcu4M4VBVSnAyAsPHPSjfIfcCdCI36JPaLWtGUaQKjuFjNLj9cN1QOT++IwetaV0zm/g0TGwm5lA9cWkw5Shw==',key_name='tempest-keypair-1933341906',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:19:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3bd42ae707642a09acd3c394fd36a88',ramdisk_id='',reservation_id='r-faxly3br',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-987206712',owner_user_name='tempest-TaggedBootDevicesTest-987206712-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:19:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05a2411551904db193548223ad5e3be8',uuid=912b0528-be16-427f-84fc-8a6cf89d5000,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08064378-9b0c-4b96-a818-6bbd4e31b553", "address": "fa:16:3e:58:dc:50", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08064378-9b", "ovs_interfaceid": "08064378-9b0c-4b96-a818-6bbd4e31b553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converting VIF {"id": "08064378-9b0c-4b96-a818-6bbd4e31b553", "address": "fa:16:3e:58:dc:50", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08064378-9b", "ovs_interfaceid": "08064378-9b0c-4b96-a818-6bbd4e31b553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:dc:50,bridge_name='br-int',has_traffic_filtering=True,id=08064378-9b0c-4b96-a818-6bbd4e31b553,network=Network(2c38d0dd-fd3c-45ea-8455-3c9bea79261c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08064378-9b') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG os_vif [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:dc:50,bridge_name='br-int',has_traffic_filtering=True,id=08064378-9b0c-4b96-a818-6bbd4e31b553,network=Network(2c38d0dd-fd3c-45ea-8455-3c9bea79261c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08064378-9b') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08064378-9b, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=be301673-54f1-4521-bd42-073e18de0bca) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-c88c6084-3695-4270-a9ff-dfb0d0caa130 req-58c6ae4a-51fd-4ff2-b03e-b95cd5b1e077 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-plugged-6fc199c0-dcfd-4c56-a910-37478f4c85bb {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c88c6084-3695-4270-a9ff-dfb0d0caa130 req-58c6ae4a-51fd-4ff2-b03e-b95cd5b1e077 service nova] Acquiring lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c88c6084-3695-4270-a9ff-dfb0d0caa130 req-58c6ae4a-51fd-4ff2-b03e-b95cd5b1e077 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c88c6084-3695-4270-a9ff-dfb0d0caa130 req-58c6ae4a-51fd-4ff2-b03e-b95cd5b1e077 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-c88c6084-3695-4270-a9ff-dfb0d0caa130 req-58c6ae4a-51fd-4ff2-b03e-b95cd5b1e077 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] No waiting events found dispatching network-vif-plugged-6fc199c0-dcfd-4c56-a910-37478f4c85bb {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:20:51 user nova-compute[75080]: WARNING nova.compute.manager [req-c88c6084-3695-4270-a9ff-dfb0d0caa130 req-58c6ae4a-51fd-4ff2-b03e-b95cd5b1e077 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received unexpected event network-vif-plugged-6fc199c0-dcfd-4c56-a910-37478f4c85bb for instance with vm_state active and task_state deleting.
Dec 05 15:20:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-c88c6084-3695-4270-a9ff-dfb0d0caa130 req-58c6ae4a-51fd-4ff2-b03e-b95cd5b1e077 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-unplugged-08064378-9b0c-4b96-a818-6bbd4e31b553 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c88c6084-3695-4270-a9ff-dfb0d0caa130 req-58c6ae4a-51fd-4ff2-b03e-b95cd5b1e077 service nova] Acquiring lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c88c6084-3695-4270-a9ff-dfb0d0caa130 req-58c6ae4a-51fd-4ff2-b03e-b95cd5b1e077 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c88c6084-3695-4270-a9ff-dfb0d0caa130 req-58c6ae4a-51fd-4ff2-b03e-b95cd5b1e077 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-c88c6084-3695-4270-a9ff-dfb0d0caa130 req-58c6ae4a-51fd-4ff2-b03e-b95cd5b1e077 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] No waiting events found dispatching network-vif-unplugged-08064378-9b0c-4b96-a818-6bbd4e31b553 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-c88c6084-3695-4270-a9ff-dfb0d0caa130 req-58c6ae4a-51fd-4ff2-b03e-b95cd5b1e077 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-unplugged-08064378-9b0c-4b96-a818-6bbd4e31b553 for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-c88c6084-3695-4270-a9ff-dfb0d0caa130 req-58c6ae4a-51fd-4ff2-b03e-b95cd5b1e077 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-plugged-08064378-9b0c-4b96-a818-6bbd4e31b553 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c88c6084-3695-4270-a9ff-dfb0d0caa130 req-58c6ae4a-51fd-4ff2-b03e-b95cd5b1e077 service nova] Acquiring lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c88c6084-3695-4270-a9ff-dfb0d0caa130 req-58c6ae4a-51fd-4ff2-b03e-b95cd5b1e077 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c88c6084-3695-4270-a9ff-dfb0d0caa130 req-58c6ae4a-51fd-4ff2-b03e-b95cd5b1e077 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-c88c6084-3695-4270-a9ff-dfb0d0caa130 req-58c6ae4a-51fd-4ff2-b03e-b95cd5b1e077 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] No waiting events found dispatching network-vif-plugged-08064378-9b0c-4b96-a818-6bbd4e31b553 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:20:51 user nova-compute[75080]: WARNING nova.compute.manager [req-c88c6084-3695-4270-a9ff-dfb0d0caa130 req-58c6ae4a-51fd-4ff2-b03e-b95cd5b1e077 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received unexpected event network-vif-plugged-08064378-9b0c-4b96-a818-6bbd4e31b553 for instance with vm_state active and task_state deleting.
Dec 05 15:20:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-c88c6084-3695-4270-a9ff-dfb0d0caa130 req-58c6ae4a-51fd-4ff2-b03e-b95cd5b1e077 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-unplugged-eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c88c6084-3695-4270-a9ff-dfb0d0caa130 req-58c6ae4a-51fd-4ff2-b03e-b95cd5b1e077 service nova] Acquiring lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c88c6084-3695-4270-a9ff-dfb0d0caa130 req-58c6ae4a-51fd-4ff2-b03e-b95cd5b1e077 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c88c6084-3695-4270-a9ff-dfb0d0caa130 req-58c6ae4a-51fd-4ff2-b03e-b95cd5b1e077 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-c88c6084-3695-4270-a9ff-dfb0d0caa130 req-58c6ae4a-51fd-4ff2-b03e-b95cd5b1e077 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] No waiting events found dispatching network-vif-unplugged-eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-c88c6084-3695-4270-a9ff-dfb0d0caa130 req-58c6ae4a-51fd-4ff2-b03e-b95cd5b1e077 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-unplugged-eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-c88c6084-3695-4270-a9ff-dfb0d0caa130 req-58c6ae4a-51fd-4ff2-b03e-b95cd5b1e077 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-plugged-eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c88c6084-3695-4270-a9ff-dfb0d0caa130 req-58c6ae4a-51fd-4ff2-b03e-b95cd5b1e077 service nova] Acquiring lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c88c6084-3695-4270-a9ff-dfb0d0caa130 req-58c6ae4a-51fd-4ff2-b03e-b95cd5b1e077 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c88c6084-3695-4270-a9ff-dfb0d0caa130 req-58c6ae4a-51fd-4ff2-b03e-b95cd5b1e077 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-c88c6084-3695-4270-a9ff-dfb0d0caa130 req-58c6ae4a-51fd-4ff2-b03e-b95cd5b1e077 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] No waiting events found dispatching network-vif-plugged-eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:20:51 user nova-compute[75080]: WARNING nova.compute.manager [req-c88c6084-3695-4270-a9ff-dfb0d0caa130 req-58c6ae4a-51fd-4ff2-b03e-b95cd5b1e077 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received unexpected event network-vif-plugged-eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c for instance with vm_state active and task_state deleting.
Dec 05 15:20:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:51 user nova-compute[75080]: INFO os_vif [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:dc:50,bridge_name='br-int',has_traffic_filtering=True,id=08064378-9b0c-4b96-a818-6bbd4e31b553,network=Network(2c38d0dd-fd3c-45ea-8455-3c9bea79261c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08064378-9b')
Dec 05 15:20:51 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:18:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174925668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174925668',id=10,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHK7Ceny/4wgBfAUwFIy0jKcP3pm9AXL1VYOmtUxhFboGcu4M4VBVSnAyAsPHPSjfIfcCdCI36JPaLWtGUaQKjuFjNLj9cN1QOT++IwetaV0zm/g0TGwm5lA9cWkw5Shw==',key_name='tempest-keypair-1933341906',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:19:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3bd42ae707642a09acd3c394fd36a88',ramdisk_id='',reservation_id='r-faxly3br',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-987206712',owner_user_name='tempest-TaggedBootDevicesTest-987206712-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:19:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05a2411551904db193548223ad5e3be8',uuid=912b0528-be16-427f-84fc-8a6cf89d5000,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d89c793b-d55a-47b5-a857-bfb4b02d9781", "address": "fa:16:3e:38:ba:63", "network": {"id": "552adb39-e03e-4478-ac90-a3ca91fdce4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1038445196", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd89c793b-d5", "ovs_interfaceid": "d89c793b-d55a-47b5-a857-bfb4b02d9781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converting VIF {"id": "d89c793b-d55a-47b5-a857-bfb4b02d9781", "address": "fa:16:3e:38:ba:63", "network": {"id": "552adb39-e03e-4478-ac90-a3ca91fdce4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1038445196", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd89c793b-d5", "ovs_interfaceid": "d89c793b-d55a-47b5-a857-bfb4b02d9781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:ba:63,bridge_name='br-int',has_traffic_filtering=True,id=d89c793b-d55a-47b5-a857-bfb4b02d9781,network=Network(552adb39-e03e-4478-ac90-a3ca91fdce4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd89c793b-d5') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_vif [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:ba:63,bridge_name='br-int',has_traffic_filtering=True,id=d89c793b-d55a-47b5-a857-bfb4b02d9781,network=Network(552adb39-e03e-4478-ac90-a3ca91fdce4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd89c793b-d5') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd89c793b-d5, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e514ceba-5e02-42bb-bdde-cfe3a851f44a) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:51 user nova-compute[75080]: INFO os_vif [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:ba:63,bridge_name='br-int',has_traffic_filtering=True,id=d89c793b-d55a-47b5-a857-bfb4b02d9781,network=Network(552adb39-e03e-4478-ac90-a3ca91fdce4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd89c793b-d5')
Dec 05 15:20:51 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:18:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174925668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174925668',id=10,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHK7Ceny/4wgBfAUwFIy0jKcP3pm9AXL1VYOmtUxhFboGcu4M4VBVSnAyAsPHPSjfIfcCdCI36JPaLWtGUaQKjuFjNLj9cN1QOT++IwetaV0zm/g0TGwm5lA9cWkw5Shw==',key_name='tempest-keypair-1933341906',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:19:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3bd42ae707642a09acd3c394fd36a88',ramdisk_id='',reservation_id='r-faxly3br',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-987206712',owner_user_name='tempest-TaggedBootDevicesTest-987206712-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:19:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05a2411551904db193548223ad5e3be8',uuid=912b0528-be16-427f-84fc-8a6cf89d5000,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c", "address": "fa:16:3e:4a:8d:8f", "network": {"id": "552adb39-e03e-4478-ac90-a3ca91fdce4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1038445196", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac25d6a-4e", "ovs_interfaceid": "eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converting VIF {"id": "eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c", "address": "fa:16:3e:4a:8d:8f", "network": {"id": "552adb39-e03e-4478-ac90-a3ca91fdce4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1038445196", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac25d6a-4e", "ovs_interfaceid": "eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:8d:8f,bridge_name='br-int',has_traffic_filtering=True,id=eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c,network=Network(552adb39-e03e-4478-ac90-a3ca91fdce4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac25d6a-4e') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_vif [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:8d:8f,bridge_name='br-int',has_traffic_filtering=True,id=eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c,network=Network(552adb39-e03e-4478-ac90-a3ca91fdce4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac25d6a-4e') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-2dd099bd-ed05-4040-a0dd-b69bf0a40149 req-99564c64-5b1b-437b-9ccb-f267d80c2889 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-plugged-4ac602c3-db8c-42fd-a71f-1664e7a33d9a {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2dd099bd-ed05-4040-a0dd-b69bf0a40149 req-99564c64-5b1b-437b-9ccb-f267d80c2889 service nova] Acquiring lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2dd099bd-ed05-4040-a0dd-b69bf0a40149 req-99564c64-5b1b-437b-9ccb-f267d80c2889 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2dd099bd-ed05-4040-a0dd-b69bf0a40149 req-99564c64-5b1b-437b-9ccb-f267d80c2889 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-2dd099bd-ed05-4040-a0dd-b69bf0a40149 req-99564c64-5b1b-437b-9ccb-f267d80c2889 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] No waiting events found dispatching network-vif-plugged-4ac602c3-db8c-42fd-a71f-1664e7a33d9a {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:20:51 user nova-compute[75080]: WARNING nova.compute.manager [req-2dd099bd-ed05-4040-a0dd-b69bf0a40149 req-99564c64-5b1b-437b-9ccb-f267d80c2889 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received unexpected event network-vif-plugged-4ac602c3-db8c-42fd-a71f-1664e7a33d9a for instance with vm_state active and task_state deleting.
Dec 05 15:20:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-2dd099bd-ed05-4040-a0dd-b69bf0a40149 req-99564c64-5b1b-437b-9ccb-f267d80c2889 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-unplugged-05511460-e0ce-4cd0-9d83-f61d776230e3 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2dd099bd-ed05-4040-a0dd-b69bf0a40149 req-99564c64-5b1b-437b-9ccb-f267d80c2889 service nova] Acquiring lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2dd099bd-ed05-4040-a0dd-b69bf0a40149 req-99564c64-5b1b-437b-9ccb-f267d80c2889 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2dd099bd-ed05-4040-a0dd-b69bf0a40149 req-99564c64-5b1b-437b-9ccb-f267d80c2889 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-2dd099bd-ed05-4040-a0dd-b69bf0a40149 req-99564c64-5b1b-437b-9ccb-f267d80c2889 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] No waiting events found dispatching network-vif-unplugged-05511460-e0ce-4cd0-9d83-f61d776230e3 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-2dd099bd-ed05-4040-a0dd-b69bf0a40149 req-99564c64-5b1b-437b-9ccb-f267d80c2889 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-unplugged-05511460-e0ce-4cd0-9d83-f61d776230e3 for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-2dd099bd-ed05-4040-a0dd-b69bf0a40149 req-99564c64-5b1b-437b-9ccb-f267d80c2889 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-plugged-05511460-e0ce-4cd0-9d83-f61d776230e3 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2dd099bd-ed05-4040-a0dd-b69bf0a40149 req-99564c64-5b1b-437b-9ccb-f267d80c2889 service nova] Acquiring lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2dd099bd-ed05-4040-a0dd-b69bf0a40149 req-99564c64-5b1b-437b-9ccb-f267d80c2889 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2dd099bd-ed05-4040-a0dd-b69bf0a40149 req-99564c64-5b1b-437b-9ccb-f267d80c2889 service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-2dd099bd-ed05-4040-a0dd-b69bf0a40149 req-99564c64-5b1b-437b-9ccb-f267d80c2889 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] No waiting events found dispatching network-vif-plugged-05511460-e0ce-4cd0-9d83-f61d776230e3 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:20:51 user nova-compute[75080]: WARNING nova.compute.manager [req-2dd099bd-ed05-4040-a0dd-b69bf0a40149 req-99564c64-5b1b-437b-9ccb-f267d80c2889 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received unexpected event network-vif-plugged-05511460-e0ce-4cd0-9d83-f61d776230e3 for instance with vm_state active and task_state deleting.
Dec 05 15:20:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeac25d6a-4e, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=86b01991-6cad-4e81-b1a7-8936c8d38632) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:51 user nova-compute[75080]: INFO os_vif [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:8d:8f,bridge_name='br-int',has_traffic_filtering=True,id=eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c,network=Network(552adb39-e03e-4478-ac90-a3ca91fdce4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac25d6a-4e')
Dec 05 15:20:51 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FAgGrBRk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:20:51 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2759933f-9fcf-44f7-b1cb-052fb05a6ee9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:20:51 user nova-compute[75080]: No targets found.
Dec 05 15:20:51 user nova-compute[75080]: iSNS:
Dec 05 15:20:51 user nova-compute[75080]: No targets found.
Dec 05 15:20:51 user nova-compute[75080]: STATIC:
Dec 05 15:20:51 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed
Dec 05 15:20:51 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:51 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:51 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058
Dec 05 15:20:51 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:51 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:51 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f
Dec 05 15:20:51 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:51 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:51 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a
Dec 05 15:20:51 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:51 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:51 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a
Dec 05 15:20:51 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:51 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:51 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867
Dec 05 15:20:51 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:51 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:51 user nova-compute[75080]: FIRMWARE:
Dec 05 15:20:51 user nova-compute[75080]: No targets found.
Dec 05 15:20:51 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:20:51 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:20:51 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c58e45-657c-4306-9d14-deb5edb4dd7a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[120521f1-9b2d-450f-baac-64e9482ccc8a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)
Dec 05 15:20:51 user nova-compute[75080]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a (non-flash)
Dec 05 15:20:51 user nova-compute[75080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:51 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:20:51 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:20:51 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:20:51 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)
Dec 05 15:20:51 user nova-compute[75080]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a (non-flash)
Dec 05 15:20:51 user nova-compute[75080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:51 user nova-compute[75080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed (non-flash)
Dec 05 15:20:51 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:20:51 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:20:51 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f66385232e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed'): ({'sdc'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Removing single pathed devices sdc {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cc2c17-380c-4626-a869-1f2473a946ce]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a1c8b6-f2d8-427d-9eae-c614956b088e]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Flushing IO for device /dev/sdc {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-ae892ae9-b714-4399-91a8-08056131996d req-2d778e95-ffd0-4929-acbc-16e3908e3e9d service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-plugged-b5f4ea2a-ca87-42b4-a7fe-0234b8567230 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-ae892ae9-b714-4399-91a8-08056131996d req-2d778e95-ffd0-4929-acbc-16e3908e3e9d service nova] Acquiring lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-ae892ae9-b714-4399-91a8-08056131996d req-2d778e95-ffd0-4929-acbc-16e3908e3e9d service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-ae892ae9-b714-4399-91a8-08056131996d req-2d778e95-ffd0-4929-acbc-16e3908e3e9d service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-ae892ae9-b714-4399-91a8-08056131996d req-2d778e95-ffd0-4929-acbc-16e3908e3e9d service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] No waiting events found dispatching network-vif-plugged-b5f4ea2a-ca87-42b4-a7fe-0234b8567230 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:20:51 user nova-compute[75080]: WARNING nova.compute.manager [req-ae892ae9-b714-4399-91a8-08056131996d req-2d778e95-ffd0-4929-acbc-16e3908e3e9d service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received unexpected event network-vif-plugged-b5f4ea2a-ca87-42b4-a7fe-0234b8567230 for instance with vm_state active and task_state deleting.
Dec 05 15:20:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-ae892ae9-b714-4399-91a8-08056131996d req-2d778e95-ffd0-4929-acbc-16e3908e3e9d service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-unplugged-d89c793b-d55a-47b5-a857-bfb4b02d9781 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-ae892ae9-b714-4399-91a8-08056131996d req-2d778e95-ffd0-4929-acbc-16e3908e3e9d service nova] Acquiring lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-ae892ae9-b714-4399-91a8-08056131996d req-2d778e95-ffd0-4929-acbc-16e3908e3e9d service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-ae892ae9-b714-4399-91a8-08056131996d req-2d778e95-ffd0-4929-acbc-16e3908e3e9d service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-ae892ae9-b714-4399-91a8-08056131996d req-2d778e95-ffd0-4929-acbc-16e3908e3e9d service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] No waiting events found dispatching network-vif-unplugged-d89c793b-d55a-47b5-a857-bfb4b02d9781 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-ae892ae9-b714-4399-91a8-08056131996d req-2d778e95-ffd0-4929-acbc-16e3908e3e9d service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-unplugged-d89c793b-d55a-47b5-a857-bfb4b02d9781 for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-ae892ae9-b714-4399-91a8-08056131996d req-2d778e95-ffd0-4929-acbc-16e3908e3e9d service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-plugged-d89c793b-d55a-47b5-a857-bfb4b02d9781 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-ae892ae9-b714-4399-91a8-08056131996d req-2d778e95-ffd0-4929-acbc-16e3908e3e9d service nova] Acquiring lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-ae892ae9-b714-4399-91a8-08056131996d req-2d778e95-ffd0-4929-acbc-16e3908e3e9d service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-ae892ae9-b714-4399-91a8-08056131996d req-2d778e95-ffd0-4929-acbc-16e3908e3e9d service nova] Lock "912b0528-be16-427f-84fc-8a6cf89d5000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-ae892ae9-b714-4399-91a8-08056131996d req-2d778e95-ffd0-4929-acbc-16e3908e3e9d service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] No waiting events found dispatching network-vif-plugged-d89c793b-d55a-47b5-a857-bfb4b02d9781 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:20:51 user nova-compute[75080]: WARNING nova.compute.manager [req-ae892ae9-b714-4399-91a8-08056131996d req-2d778e95-ffd0-4929-acbc-16e3908e3e9d service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received unexpected event network-vif-plugged-d89c793b-d55a-47b5-a857-bfb4b02d9781 for instance with vm_state active and task_state deleting.
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7969323-34d8-43d5-ad4f-bfe7ae3656fb]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[997678f2-310a-4d8d-ba8c-d698659fb7fd]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] SCSI volumes sdc have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc215e38-27a0-42cb-9d1b-99c42c4cc785]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[209b9391-2ec1-49f8-8791-5e276df5587b]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed, portal: 172.16.0.220,3260]
Dec 05 15:20:51 user nova-compute[75080]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed, portal: 172.16.0.220,3260] successful.
Dec 05 15:20:51 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dcf2180-a9e8-4068-825b-1d71c9ec54ed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89fdfd3-b193-4560-bf09-c1842ff58cc0]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] <== disconnect_volume: return (337ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZGIkRYsx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:20:51 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e026fc-5db4-4309-a863-9d654c124fe0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:20:51 user nova-compute[75080]: No targets found.
Dec 05 15:20:51 user nova-compute[75080]: iSNS:
Dec 05 15:20:51 user nova-compute[75080]: No targets found.
Dec 05 15:20:51 user nova-compute[75080]: STATIC:
Dec 05 15:20:51 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058
Dec 05 15:20:51 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:51 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:51 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f
Dec 05 15:20:51 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:51 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:51 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a
Dec 05 15:20:51 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:51 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:51 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a
Dec 05 15:20:51 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:51 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:51 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867
Dec 05 15:20:51 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:51 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:51 user nova-compute[75080]: FIRMWARE:
Dec 05 15:20:51 user nova-compute[75080]: No targets found.
Dec 05 15:20:51 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:20:51 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:20:51 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c948bc-20aa-4eee-9bb1-a3a658ed0686]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[188b7c35-d77f-48c8-af2e-803ce378db07]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)
Dec 05 15:20:51 user nova-compute[75080]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a (non-flash)
Dec 05 15:20:51 user nova-compute[75080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:51 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:20:51 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:20:51 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)
Dec 05 15:20:51 user nova-compute[75080]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a (non-flash)
Dec 05 15:20:51 user nova-compute[75080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:51 user nova-compute[75080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f (non-flash)
Dec 05 15:20:51 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:20:51 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f66385232e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f'): ({'sdd'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Removing single pathed devices sdd {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9e053b-2bff-4a2d-a622-f6e5c293a4b5]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5281b8ac-0e75-4d0b-aa80-7bd814082478]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Flushing IO for device /dev/sdd {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb9f48e-f1c4-4a5f-a719-51f2eb32178e]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4a66ae-a0b3-48e8-a522-5fe99d5b9db3]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] SCSI volumes sdd have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e393f3e-f870-4b8a-83ed-0d6b4ee010a1]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[940f66f0-e28a-4720-8929-43cf659e54e2]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f, portal: 172.16.0.220,3260]
Dec 05 15:20:51 user nova-compute[75080]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f, portal: 172.16.0.220,3260] successful.
Dec 05 15:20:51 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c4e8fc-305e-4461-b96c-43cff51cf25f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bdf896-3120-41ba-8ded-2b0c536b5064]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] <== disconnect_volume: return (324ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pUAzRPOI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:20:51 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5c7819-750e-4ecf-8770-1d7e287e157f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:20:51 user nova-compute[75080]: No targets found.
Dec 05 15:20:51 user nova-compute[75080]: iSNS:
Dec 05 15:20:51 user nova-compute[75080]: No targets found.
Dec 05 15:20:51 user nova-compute[75080]: STATIC:
Dec 05 15:20:51 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058
Dec 05 15:20:51 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:51 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:51 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a
Dec 05 15:20:51 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:51 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:51 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a
Dec 05 15:20:51 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:51 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:51 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867
Dec 05 15:20:51 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:51 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:51 user nova-compute[75080]: FIRMWARE:
Dec 05 15:20:51 user nova-compute[75080]: No targets found.
Dec 05 15:20:51 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:20:51 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:20:51 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c982786-658a-4eb1-b721-abd6b8b96ff0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b589c4-cca1-4f1f-bee6-1205e54f9880]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)
Dec 05 15:20:51 user nova-compute[75080]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a (non-flash)
Dec 05 15:20:51 user nova-compute[75080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:51 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:20:51 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)
Dec 05 15:20:51 user nova-compute[75080]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a (non-flash)
Dec 05 15:20:51 user nova-compute[75080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:51 user nova-compute[75080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 (non-flash)
Dec 05 15:20:51 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f66384b2950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058'): ({'sde'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Removing single pathed devices sde {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c9de07-7886-4543-a821-99d26b34d19e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc32ba34-b011-4819-8124-1fecbc1318a5]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Flushing IO for device /dev/sde {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:20:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:52 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51cab72-af2e-42a0-975e-2ac81eaf0180]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:52 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:20:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:52 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc68813-4b57-4d89-9e67-00c67c33a28f]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:52 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:20:52 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] SCSI volumes sde have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:20:52 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:20:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:52 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0ecafc-3d68-46eb-98b5-39f87b3830c1]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:52 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:52 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97f635e-e040-49b3-b7a0-2d60da0d6ef3]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:52 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058, portal: 172.16.0.220,3260]
Dec 05 15:20:52 user nova-compute[75080]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058, portal: 172.16.0.220,3260] successful.
Dec 05 15:20:52 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b31e078-8572-43ca-8a7a-337916550058 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:52 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfa55ad-8d4a-4ce0-bc78-c2cf7261363a]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:52 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:52 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:20:52 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] <== disconnect_volume: return (316ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:20:52 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:20:52 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Deleting instance files /opt/stack/data/nova/instances/912b0528-be16-427f-84fc-8a6cf89d5000_del
Dec 05 15:20:52 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Deletion of /opt/stack/data/nova/instances/912b0528-be16-427f-84fc-8a6cf89d5000_del complete
Dec 05 15:20:52 user nova-compute[75080]: INFO nova.compute.manager [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Took 3.68 seconds to destroy the instance on the hypervisor.
Dec 05 15:20:52 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:20:52 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:20:52 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:20:53 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-9be453b2-d2f3-4415-825c-d7dc8484ab72 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 33078a88-4858-4c6b-bfa9-c3d9b83cf78b is timed out.
Dec 05 15:20:53 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-9be453b2-d2f3-4415-825c-d7dc8484ab72 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Successfully detached device vdb from instance 33078a88-4858-4c6b-bfa9-c3d9b83cf78b from the live domain config.
Dec 05 15:20:53 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9be453b2-d2f3-4415-825c-d7dc8484ab72 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be453b2-d2f3-4415-825c-d7dc8484ab72 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jLbdtQSD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:20:53 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-9be453b2-d2f3-4415-825c-d7dc8484ab72 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:20:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-9be453b2-d2f3-4415-825c-d7dc8484ab72 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-9be453b2-d2f3-4415-825c-d7dc8484ab72 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfd8190-620b-404b-85b9-888fbf0ed5a2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be453b2-d2f3-4415-825c-d7dc8484ab72 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:20:53 user nova-compute[75080]: No targets found.
Dec 05 15:20:53 user nova-compute[75080]: iSNS:
Dec 05 15:20:53 user nova-compute[75080]: No targets found.
Dec 05 15:20:53 user nova-compute[75080]: STATIC:
Dec 05 15:20:53 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a
Dec 05 15:20:53 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:53 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:53 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a
Dec 05 15:20:53 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:53 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:53 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867
Dec 05 15:20:53 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:53 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:53 user nova-compute[75080]: FIRMWARE:
Dec 05 15:20:53 user nova-compute[75080]: No targets found.
Dec 05 15:20:53 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be453b2-d2f3-4415-825c-d7dc8484ab72 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:20:53 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:20:53 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be453b2-d2f3-4415-825c-d7dc8484ab72 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[07afe44a-9a4b-495a-86c9-8a9d771a8ac3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c711cf4d-2ee0-4d40-ac2d-6efc4761efce]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be453b2-d2f3-4415-825c-d7dc8484ab72 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)
Dec 05 15:20:53 user nova-compute[75080]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a (non-flash)
Dec 05 15:20:53 user nova-compute[75080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:53 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be453b2-d2f3-4415-825c-d7dc8484ab72 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)
Dec 05 15:20:53 user nova-compute[75080]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a (non-flash)
Dec 05 15:20:53 user nova-compute[75080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:53 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be453b2-d2f3-4415-825c-d7dc8484ab72 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f66384b0790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a'): ({'sdf'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-9be453b2-d2f3-4415-825c-d7dc8484ab72 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Removing single pathed devices sdf {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d4a645-964f-49a9-8b79-960fa6a63653]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7258abbf-0ce9-4ea5-aed6-161d6a0f77b1]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-9be453b2-d2f3-4415-825c-d7dc8484ab72 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Flushing IO for device /dev/sdf {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[096cf934-3d3e-400a-892e-91802c9020b2]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-9be453b2-d2f3-4415-825c-d7dc8484ab72 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4468b1b-f437-4b09-9eb7-e9af7fff78be]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-9be453b2-d2f3-4415-825c-d7dc8484ab72 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-9be453b2-d2f3-4415-825c-d7dc8484ab72 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] SCSI volumes sdf have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be453b2-d2f3-4415-825c-d7dc8484ab72 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19a725c-e60e-4c35-bb7a-ed0ecf2c17f7]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be453b2-d2f3-4415-825c-d7dc8484ab72 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b1c7d5-4e02-4f31-baa0-98562f522cd0]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be453b2-d2f3-4415-825c-d7dc8484ab72 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a, portal: 172.16.0.220,3260]
Dec 05 15:20:53 user nova-compute[75080]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a, portal: 172.16.0.220,3260] successful.
Dec 05 15:20:53 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:892c0e92-c044-4b58-a91f-e139c8788d5a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dac4263-2022-4514-b588-197fc683d62a]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be453b2-d2f3-4415-825c-d7dc8484ab72 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-9be453b2-d2f3-4415-825c-d7dc8484ab72 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be453b2-d2f3-4415-825c-d7dc8484ab72 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] <== disconnect_volume: return (309ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:20:53 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9be453b2-d2f3-4415-825c-d7dc8484ab72 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG nova.compute.manager [req-ac401e5c-790f-436d-833d-ec62472b230e req-a69e786f-b81d-4125-bc17-87d4ad26a739 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-deleted-6fc199c0-dcfd-4c56-a910-37478f4c85bb {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:20:54 user nova-compute[75080]: INFO nova.compute.manager [req-ac401e5c-790f-436d-833d-ec62472b230e req-a69e786f-b81d-4125-bc17-87d4ad26a739 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Neutron deleted interface 6fc199c0-dcfd-4c56-a910-37478f4c85bb; detaching it from the instance and deleting it from the info cache
Dec 05 15:20:54 user nova-compute[75080]: DEBUG nova.network.neutron [req-ac401e5c-790f-436d-833d-ec62472b230e req-a69e786f-b81d-4125-bc17-87d4ad26a739 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Updating instance_info_cache with network_info: [{"id": "4ac602c3-db8c-42fd-a71f-1664e7a33d9a", "address": "fa:16:3e:4a:ae:17", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac602c3-db", "ovs_interfaceid": "4ac602c3-db8c-42fd-a71f-1664e7a33d9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "05511460-e0ce-4cd0-9d83-f61d776230e3", "address": "fa:16:3e:4c:56:ff", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05511460-e0", "ovs_interfaceid": "05511460-e0ce-4cd0-9d83-f61d776230e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b5f4ea2a-ca87-42b4-a7fe-0234b8567230", "address": "fa:16:3e:86:2e:34", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f4ea2a-ca", "ovs_interfaceid": "b5f4ea2a-ca87-42b4-a7fe-0234b8567230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08064378-9b0c-4b96-a818-6bbd4e31b553", "address": "fa:16:3e:58:dc:50", "network": {"id": "2c38d0dd-fd3c-45ea-8455-3c9bea79261c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1159203163", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08064378-9b", "ovs_interfaceid": "08064378-9b0c-4b96-a818-6bbd4e31b553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d89c793b-d55a-47b5-a857-bfb4b02d9781", "address": "fa:16:3e:38:ba:63", "network": {"id": "552adb39-e03e-4478-ac90-a3ca91fdce4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1038445196", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd89c793b-d5", "ovs_interfaceid": "d89c793b-d55a-47b5-a857-bfb4b02d9781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c", "address": "fa:16:3e:4a:8d:8f", "network": {"id": "552adb39-e03e-4478-ac90-a3ca91fdce4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1038445196", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3bd42ae707642a09acd3c394fd36a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac25d6a-4e", "ovs_interfaceid": "eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG nova.compute.manager [req-ac401e5c-790f-436d-833d-ec62472b230e req-a69e786f-b81d-4125-bc17-87d4ad26a739 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Detach interface failed, port_id=6fc199c0-dcfd-4c56-a910-37478f4c85bb, reason: Instance 912b0528-be16-427f-84fc-8a6cf89d5000 could not be found. {{(pid=75080) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 15:20:54 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-37c9b487-44d0-453a-a967-ab6ee8ed6fe1 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Waiting for libvirt event about the detach of device tapdcdd907f-23 with device alias net1 from instance 0259351f-617f-47be-bfb6-2fef1c35bf15 is timed out.
Dec 05 15:20:54 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-37c9b487-44d0-453a-a967-ab6ee8ed6fe1 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3a:71:c4"/><model type="virtio"/><mtu size="1442"/><target dev="tapdcdd907f-23"/></interface> {{(pid=75080) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-37c9b487-44d0-453a-a967-ab6ee8ed6fe1 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:3a:71:c4"/><model type="virtio"/><mtu size="1442"/><target dev="tapdcdd907f-23"/></interface>not found in domain: <domain type='kvm' id='4'>
Dec 05 15:20:54 user nova-compute[75080]:   <name>instance-00000004</name>
Dec 05 15:20:54 user nova-compute[75080]:   <uuid>0259351f-617f-47be-bfb6-2fef1c35bf15</uuid>
Dec 05 15:20:54 user nova-compute[75080]:   <metadata>
Dec 05 15:20:54 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:20:54 user nova-compute[75080]:   <nova:package version="0.0.0"/>
Dec 05 15:20:54 user nova-compute[75080]:   <nova:name>tempest-device-tagging-server-640774861</nova:name>
Dec 05 15:20:54 user nova-compute[75080]:   <nova:creationTime>2023-12-05 15:19:47</nova:creationTime>
Dec 05 15:20:54 user nova-compute[75080]:   <nova:flavor name="m1.tiny">
Dec 05 15:20:54 user nova-compute[75080]:     <nova:memory>512</nova:memory>
Dec 05 15:20:54 user nova-compute[75080]:     <nova:disk>1</nova:disk>
Dec 05 15:20:54 user nova-compute[75080]:     <nova:swap>0</nova:swap>
Dec 05 15:20:54 user nova-compute[75080]:     <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:20:54 user nova-compute[75080]:     <nova:vcpus>1</nova:vcpus>
Dec 05 15:20:54 user nova-compute[75080]:   </nova:flavor>
Dec 05 15:20:54 user nova-compute[75080]:   <nova:owner>
Dec 05 15:20:54 user nova-compute[75080]:     <nova:user uuid="2bd4a8e35eed47d1b156037a6dda5668">tempest-TaggedAttachmentsTest-1860660485-project-member</nova:user>
Dec 05 15:20:54 user nova-compute[75080]:     <nova:project uuid="24e3fe3c0db24db598f947ebfe7a8b3d">tempest-TaggedAttachmentsTest-1860660485</nova:project>
Dec 05 15:20:54 user nova-compute[75080]:   </nova:owner>
Dec 05 15:20:54 user nova-compute[75080]:   <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:20:54 user nova-compute[75080]:   <nova:ports>
Dec 05 15:20:54 user nova-compute[75080]:     <nova:port uuid="3e2379bd-6e97-45dc-917b-e8e4478a3be0">
Dec 05 15:20:54 user nova-compute[75080]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 05 15:20:54 user nova-compute[75080]:     </nova:port>
Dec 05 15:20:54 user nova-compute[75080]:     <nova:port uuid="dcdd907f-231e-4ca4-97b6-23f980fa55d9">
Dec 05 15:20:54 user nova-compute[75080]:       <nova:ip type="fixed" address="10.10.10.34" ipVersion="4"/>
Dec 05 15:20:54 user nova-compute[75080]:     </nova:port>
Dec 05 15:20:54 user nova-compute[75080]:   </nova:ports>
Dec 05 15:20:54 user nova-compute[75080]: </nova:instance>
Dec 05 15:20:54 user nova-compute[75080]:   </metadata>
Dec 05 15:20:54 user nova-compute[75080]:   <memory unit='KiB'>524288</memory>
Dec 05 15:20:54 user nova-compute[75080]:   <currentMemory unit='KiB'>524288</currentMemory>
Dec 05 15:20:54 user nova-compute[75080]:   <vcpu placement='static'>1</vcpu>
Dec 05 15:20:54 user nova-compute[75080]:   <resource>
Dec 05 15:20:54 user nova-compute[75080]:     <partition>/machine</partition>
Dec 05 15:20:54 user nova-compute[75080]:   </resource>
Dec 05 15:20:54 user nova-compute[75080]:   <sysinfo type='smbios'>
Dec 05 15:20:54 user nova-compute[75080]:     <system>
Dec 05 15:20:54 user nova-compute[75080]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Dec 05 15:20:54 user nova-compute[75080]:       <entry name='product'>OpenStack Nova</entry>
Dec 05 15:20:54 user nova-compute[75080]:       <entry name='version'>0.0.0</entry>
Dec 05 15:20:54 user nova-compute[75080]:       <entry name='serial'>0259351f-617f-47be-bfb6-2fef1c35bf15</entry>
Dec 05 15:20:54 user nova-compute[75080]:       <entry name='uuid'>0259351f-617f-47be-bfb6-2fef1c35bf15</entry>
Dec 05 15:20:54 user nova-compute[75080]:       <entry name='family'>Virtual Machine</entry>
Dec 05 15:20:54 user nova-compute[75080]:     </system>
Dec 05 15:20:54 user nova-compute[75080]:   </sysinfo>
Dec 05 15:20:54 user nova-compute[75080]:   <os>
Dec 05 15:20:54 user nova-compute[75080]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Dec 05 15:20:54 user nova-compute[75080]:     <boot dev='hd'/>
Dec 05 15:20:54 user nova-compute[75080]:     <smbios mode='sysinfo'/>
Dec 05 15:20:54 user nova-compute[75080]:   </os>
Dec 05 15:20:54 user nova-compute[75080]:   <features>
Dec 05 15:20:54 user nova-compute[75080]:     <acpi/>
Dec 05 15:20:54 user nova-compute[75080]:     <apic/>
Dec 05 15:20:54 user nova-compute[75080]:     <vmcoreinfo state='on'/>
Dec 05 15:20:54 user nova-compute[75080]:   </features>
Dec 05 15:20:54 user nova-compute[75080]:   <cpu mode='custom' match='exact' check='full'>
Dec 05 15:20:54 user nova-compute[75080]:     <model fallback='forbid'>Nehalem</model>
Dec 05 15:20:54 user nova-compute[75080]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Dec 05 15:20:54 user nova-compute[75080]:     <feature policy='require' name='vme'/>
Dec 05 15:20:54 user nova-compute[75080]:     <feature policy='require' name='x2apic'/>
Dec 05 15:20:54 user nova-compute[75080]:     <feature policy='require' name='hypervisor'/>
Dec 05 15:20:54 user nova-compute[75080]:   </cpu>
Dec 05 15:20:54 user nova-compute[75080]:   <clock offset='utc'>
Dec 05 15:20:54 user nova-compute[75080]:     <timer name='pit' tickpolicy='delay'/>
Dec 05 15:20:54 user nova-compute[75080]:     <timer name='rtc' tickpolicy='catchup'/>
Dec 05 15:20:54 user nova-compute[75080]:     <timer name='hpet' present='no'/>
Dec 05 15:20:54 user nova-compute[75080]:   </clock>
Dec 05 15:20:54 user nova-compute[75080]:   <on_poweroff>destroy</on_poweroff>
Dec 05 15:20:54 user nova-compute[75080]:   <on_reboot>restart</on_reboot>
Dec 05 15:20:54 user nova-compute[75080]:   <on_crash>destroy</on_crash>
Dec 05 15:20:54 user nova-compute[75080]:   <devices>
Dec 05 15:20:54 user nova-compute[75080]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 05 15:20:54 user nova-compute[75080]:     <disk type='file' device='disk'>
Dec 05 15:20:54 user nova-compute[75080]:       <driver name='qemu' type='qcow2' cache='none'/>
Dec 05 15:20:54 user nova-compute[75080]:       <source file='/opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/disk' index='2'/>
Dec 05 15:20:54 user nova-compute[75080]:       <backingStore type='file' index='3'>
Dec 05 15:20:54 user nova-compute[75080]:         <format type='raw'/>
Dec 05 15:20:54 user nova-compute[75080]:         <source file='/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee'/>
Dec 05 15:20:54 user nova-compute[75080]:         <backingStore/>
Dec 05 15:20:54 user nova-compute[75080]:       </backingStore>
Dec 05 15:20:54 user nova-compute[75080]:       <target dev='vda' bus='virtio'/>
Dec 05 15:20:54 user nova-compute[75080]:       <alias name='virtio-disk0'/>
Dec 05 15:20:54 user nova-compute[75080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Dec 05 15:20:54 user nova-compute[75080]:     </disk>
Dec 05 15:20:54 user nova-compute[75080]:     <disk type='file' device='cdrom'>
Dec 05 15:20:54 user nova-compute[75080]:       <driver name='qemu' type='raw' cache='none'/>
Dec 05 15:20:54 user nova-compute[75080]:       <source file='/opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/disk.config' index='1'/>
Dec 05 15:20:54 user nova-compute[75080]:       <backingStore/>
Dec 05 15:20:54 user nova-compute[75080]:       <target dev='hda' bus='ide'/>
Dec 05 15:20:54 user nova-compute[75080]:       <readonly/>
Dec 05 15:20:54 user nova-compute[75080]:       <alias name='ide0-0-0'/>
Dec 05 15:20:54 user nova-compute[75080]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Dec 05 15:20:54 user nova-compute[75080]:     </disk>
Dec 05 15:20:54 user nova-compute[75080]:     <controller type='usb' index='0' model='none'>
Dec 05 15:20:54 user nova-compute[75080]:       <alias name='usb'/>
Dec 05 15:20:54 user nova-compute[75080]:     </controller>
Dec 05 15:20:54 user nova-compute[75080]:     <controller type='pci' index='0' model='pci-root'>
Dec 05 15:20:54 user nova-compute[75080]:       <alias name='pci.0'/>
Dec 05 15:20:54 user nova-compute[75080]:     </controller>
Dec 05 15:20:54 user nova-compute[75080]:     <controller type='ide' index='0'>
Dec 05 15:20:54 user nova-compute[75080]:       <alias name='ide'/>
Dec 05 15:20:54 user nova-compute[75080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Dec 05 15:20:54 user nova-compute[75080]:     </controller>
Dec 05 15:20:54 user nova-compute[75080]:     <interface type='ethernet'>
Dec 05 15:20:54 user nova-compute[75080]:       <mac address='fa:16:3e:68:6e:ba'/>
Dec 05 15:20:54 user nova-compute[75080]:       <target dev='tap3e2379bd-6e'/>
Dec 05 15:20:54 user nova-compute[75080]:       <model type='virtio'/>
Dec 05 15:20:54 user nova-compute[75080]:       <mtu size='1442'/>
Dec 05 15:20:54 user nova-compute[75080]:       <alias name='net0'/>
Dec 05 15:20:54 user nova-compute[75080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Dec 05 15:20:54 user nova-compute[75080]:     </interface>
Dec 05 15:20:54 user nova-compute[75080]:     <serial type='pty'>
Dec 05 15:20:54 user nova-compute[75080]:       <source path='/dev/pts/4'/>
Dec 05 15:20:54 user nova-compute[75080]:       <log file='/opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/console.log' append='off'/>
Dec 05 15:20:54 user nova-compute[75080]:       <target type='isa-serial' port='0'>
Dec 05 15:20:54 user nova-compute[75080]:         <model name='isa-serial'/>
Dec 05 15:20:54 user nova-compute[75080]:       </target>
Dec 05 15:20:54 user nova-compute[75080]:       <alias name='serial0'/>
Dec 05 15:20:54 user nova-compute[75080]:     </serial>
Dec 05 15:20:54 user nova-compute[75080]:     <console type='pty' tty='/dev/pts/4'>
Dec 05 15:20:54 user nova-compute[75080]:       <source path='/dev/pts/4'/>
Dec 05 15:20:54 user nova-compute[75080]:       <log file='/opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/console.log' append='off'/>
Dec 05 15:20:54 user nova-compute[75080]:       <target type='serial' port='0'/>
Dec 05 15:20:54 user nova-compute[75080]:       <alias name='serial0'/>
Dec 05 15:20:54 user nova-compute[75080]:     </console>
Dec 05 15:20:54 user nova-compute[75080]:     <input type='mouse' bus='ps2'>
Dec 05 15:20:54 user nova-compute[75080]:       <alias name='input0'/>
Dec 05 15:20:54 user nova-compute[75080]:     </input>
Dec 05 15:20:54 user nova-compute[75080]:     <input type='keyboard' bus='ps2'>
Dec 05 15:20:54 user nova-compute[75080]:       <alias name='input1'/>
Dec 05 15:20:54 user nova-compute[75080]:     </input>
Dec 05 15:20:54 user nova-compute[75080]:     <graphics type='vnc' port='5903' autoport='yes' listen='0.0.0.0'>
Dec 05 15:20:54 user nova-compute[75080]:       <listen type='address' address='0.0.0.0'/>
Dec 05 15:20:54 user nova-compute[75080]:     </graphics>
Dec 05 15:20:54 user nova-compute[75080]:     <audio id='1' type='none'/>
Dec 05 15:20:54 user nova-compute[75080]:     <video>
Dec 05 15:20:54 user nova-compute[75080]:       <model type='virtio' heads='1' primary='yes'/>
Dec 05 15:20:54 user nova-compute[75080]:       <alias name='video0'/>
Dec 05 15:20:54 user nova-compute[75080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Dec 05 15:20:54 user nova-compute[75080]:     </video>
Dec 05 15:20:54 user nova-compute[75080]:     <memballoon model='virtio'>
Dec 05 15:20:54 user nova-compute[75080]:       <stats period='10'/>
Dec 05 15:20:54 user nova-compute[75080]:       <alias name='balloon0'/>
Dec 05 15:20:54 user nova-compute[75080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Dec 05 15:20:54 user nova-compute[75080]:     </memballoon>
Dec 05 15:20:54 user nova-compute[75080]:     <rng model='virtio'>
Dec 05 15:20:54 user nova-compute[75080]:       <backend model='random'>/dev/urandom</backend>
Dec 05 15:20:54 user nova-compute[75080]:       <alias name='rng0'/>
Dec 05 15:20:54 user nova-compute[75080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Dec 05 15:20:54 user nova-compute[75080]:     </rng>
Dec 05 15:20:54 user nova-compute[75080]:   </devices>
Dec 05 15:20:54 user nova-compute[75080]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Dec 05 15:20:54 user nova-compute[75080]:     <label>libvirt-0259351f-617f-47be-bfb6-2fef1c35bf15</label>
Dec 05 15:20:54 user nova-compute[75080]:     <imagelabel>libvirt-0259351f-617f-47be-bfb6-2fef1c35bf15</imagelabel>
Dec 05 15:20:54 user nova-compute[75080]:   </seclabel>
Dec 05 15:20:54 user nova-compute[75080]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Dec 05 15:20:54 user nova-compute[75080]:     <label>+64055:+108</label>
Dec 05 15:20:54 user nova-compute[75080]:     <imagelabel>+64055:+108</imagelabel>
Dec 05 15:20:54 user nova-compute[75080]:   </seclabel>
Dec 05 15:20:54 user nova-compute[75080]: </domain>
Dec 05 15:20:54 user nova-compute[75080]:  {{(pid=75080) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Dec 05 15:20:54 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-37c9b487-44d0-453a-a967-ab6ee8ed6fe1 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Successfully detached device tapdcdd907f-23 from instance 0259351f-617f-47be-bfb6-2fef1c35bf15 from the live domain config.
Dec 05 15:20:54 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-37c9b487-44d0-453a-a967-ab6ee8ed6fe1 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-640774861',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-640774861',id=4,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOcchwMQ/y1AsP3A0b3QpAgR94U3k1ch+DL7mOp5G4Jk3dTtQRet9PTuUq+tE9S2nFGwMJzhzoriFDCKnxJ67e/D1DfTAZHVMm0T9FYpXt1Eg6HZqWa1ZIEyx+Gye4eIQ==',key_name='tempest-keypair-1279310443',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:18:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='24e3fe3c0db24db598f947ebfe7a8b3d',ramdisk_id='',reservation_id='r-yuqxc4c9',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1860660485',owner_user_name='tempest-TaggedAttachmentsTest-1860660485-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:18:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bd4a8e35eed47d1b156037a6dda5668',uuid=0259351f-617f-47be-bfb6-2fef1c35bf15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dcdd907f-231e-4ca4-97b6-23f980fa55d9", "address": "fa:16:3e:3a:71:c4", "network": {"id": "c00c0358-c733-4598-b947-d6c502a0c5e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-376926346", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "24e3fe3c0db24db598f947ebfe7a8b3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcdd907f-23", "ovs_interfaceid": "dcdd907f-231e-4ca4-97b6-23f980fa55d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-37c9b487-44d0-453a-a967-ab6ee8ed6fe1 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Converting VIF {"id": "dcdd907f-231e-4ca4-97b6-23f980fa55d9", "address": "fa:16:3e:3a:71:c4", "network": {"id": "c00c0358-c733-4598-b947-d6c502a0c5e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-376926346", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "24e3fe3c0db24db598f947ebfe7a8b3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcdd907f-23", "ovs_interfaceid": "dcdd907f-231e-4ca4-97b6-23f980fa55d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-37c9b487-44d0-453a-a967-ab6ee8ed6fe1 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:71:c4,bridge_name='br-int',has_traffic_filtering=True,id=dcdd907f-231e-4ca4-97b6-23f980fa55d9,network=Network(c00c0358-c733-4598-b947-d6c502a0c5e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcdd907f-23') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG os_vif [None req-37c9b487-44d0-453a-a967-ab6ee8ed6fe1 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:71:c4,bridge_name='br-int',has_traffic_filtering=True,id=dcdd907f-231e-4ca4-97b6-23f980fa55d9,network=Network(c00c0358-c733-4598-b947-d6c502a0c5e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcdd907f-23') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdcdd907f-23, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f763ab12-efd1-4016-89f8-d08783cf1ea1) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG nova.compute.manager [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jfDBzNcE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1830878a-71e0-48f1-85b8-9ed83b1419cd', 'attached_at': '', 'detached_at': '', 'volume_id': '22aea242-c46e-4ce0-bc46-c34a56465dd9', 'serial': '22aea242-c46e-4ce0-bc46-c34a56465dd9'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xiXwjGRP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': 'dd92e10f-dace-4099-ba5d-c7fcbe8a1867'}, 'status': 'reserved', 'instance': '1830878a-71e0-48f1-85b8-9ed83b1419cd', 'attached_at': '', 'detached_at': '', 'volume_id': 'dd92e10f-dace-4099-ba5d-c7fcbe8a1867', 'serial'} {{(pid=75080) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:54 user nova-compute[75080]: INFO os_vif [None req-37c9b487-44d0-453a-a967-ab6ee8ed6fe1 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:71:c4,bridge_name='br-int',has_traffic_filtering=True,id=dcdd907f-231e-4ca4-97b6-23f980fa55d9,network=Network(c00c0358-c733-4598-b947-d6c502a0c5e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcdd907f-23')
Dec 05 15:20:54 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-37c9b487-44d0-453a-a967-ab6ee8ed6fe1 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:20:54 user nova-compute[75080]:   <nova:package version="0.0.0"/>
Dec 05 15:20:54 user nova-compute[75080]:   <nova:name>tempest-device-tagging-server-640774861</nova:name>
Dec 05 15:20:54 user nova-compute[75080]:   <nova:creationTime>2023-12-05 15:20:54</nova:creationTime>
Dec 05 15:20:54 user nova-compute[75080]:   <nova:flavor name="m1.tiny">
Dec 05 15:20:54 user nova-compute[75080]:     <nova:memory>512</nova:memory>
Dec 05 15:20:54 user nova-compute[75080]:     <nova:disk>1</nova:disk>
Dec 05 15:20:54 user nova-compute[75080]:     <nova:swap>0</nova:swap>
Dec 05 15:20:54 user nova-compute[75080]:     <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:20:54 user nova-compute[75080]:     <nova:vcpus>1</nova:vcpus>
Dec 05 15:20:54 user nova-compute[75080]:   </nova:flavor>
Dec 05 15:20:54 user nova-compute[75080]:   <nova:owner>
Dec 05 15:20:54 user nova-compute[75080]:     <nova:user uuid="2bd4a8e35eed47d1b156037a6dda5668">tempest-TaggedAttachmentsTest-1860660485-project-member</nova:user>
Dec 05 15:20:54 user nova-compute[75080]:     <nova:project uuid="24e3fe3c0db24db598f947ebfe7a8b3d">tempest-TaggedAttachmentsTest-1860660485</nova:project>
Dec 05 15:20:54 user nova-compute[75080]:   </nova:owner>
Dec 05 15:20:54 user nova-compute[75080]:   <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:20:54 user nova-compute[75080]:   <nova:ports>
Dec 05 15:20:54 user nova-compute[75080]:     <nova:port uuid="3e2379bd-6e97-45dc-917b-e8e4478a3be0">
Dec 05 15:20:54 user nova-compute[75080]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 05 15:20:54 user nova-compute[75080]:     </nova:port>
Dec 05 15:20:54 user nova-compute[75080]:   </nova:ports>
Dec 05 15:20:54 user nova-compute[75080]: </nova:instance>
Dec 05 15:20:54 user nova-compute[75080]:  {{(pid=75080) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG nova.objects.instance [None req-9be453b2-d2f3-4415-825c-d7dc8484ab72 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Lazy-loading 'flavor' on Instance uuid 33078a88-4858-4c6b-bfa9-c3d9b83cf78b {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jfDBzNcE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:20:54 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:20:54 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:20:54 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:20:54 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:20:54 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:20:54 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WwcFtnfv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:20:54 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:20:54 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[46301f03-d2d2-4da9-aae7-b63b6a1cea75]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:20:54 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5c6a77-1cde-45c2-86fe-5a8d13d9c045]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9] added
Dec 05 15:20:54 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9be453b2-d2f3-4415-825c-d7dc8484ab72 tempest-VolumesAssistedSnapshotsTest-1372552206 tempest-VolumesAssistedSnapshotsTest-1372552206-project-admin] Lock "33078a88-4858-4c6b-bfa9-c3d9b83cf78b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.903s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ad296e-52d1-411b-ac59-a1b62ed5bdc6]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab169ee4-1ed3-460b-a0d6-8f4763ef30f5]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jfDBzNcE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jfDBzNcE" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b637fd22-ad3f-4a0b-b227-64bbf50a7170]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jfDBzNcE'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[81190960-7d0e-4b76-9ed3-095be6107f08]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ead06a-010e-45a1-97a5-6f7fecbd3abb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)
Dec 05 15:20:54 user nova-compute[75080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:54 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)
Dec 05 15:20:54 user nova-compute[75080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:54 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:20:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec96953-faf2-4198-8661-dfa4e93f8553]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9, portal: 172.16.0.220,3260]
Dec 05 15:20:55 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9, portal: 172.16.0.220,3260] successful.
Dec 05 15:20:55 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[755eada1-84a9-4eec-9b67-0c415ab1aeb5]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[32def7a3-30f6-4ac4-be55-b07cc6c25a19]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)
Dec 05 15:20:55 user nova-compute[75080]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)
Dec 05 15:20:55 user nova-compute[75080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:55 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)
Dec 05 15:20:55 user nova-compute[75080]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)
Dec 05 15:20:55 user nova-compute[75080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:55 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] HCTL ('34', '-', '-', 0) found on session 12 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[214b9aef-ea64-45dd-8a6b-7beac8494315]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jfDBzNcE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:55 user nova-compute[75080]: INFO nova.compute.manager [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Terminating instance
Dec 05 15:20:55 user nova-compute[75080]: DEBUG nova.compute.manager [req-bc0a6bb7-e0fd-42b9-9bca-6034e73d549e req-35f6d5e3-9681-4f56-84d5-0dc67a9241cd service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Received event network-vif-deleted-dcdd907f-231e-4ca4-97b6-23f980fa55d9 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:20:55 user nova-compute[75080]: INFO nova.compute.manager [req-bc0a6bb7-e0fd-42b9-9bca-6034e73d549e req-35f6d5e3-9681-4f56-84d5-0dc67a9241cd service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Neutron deleted interface dcdd907f-231e-4ca4-97b6-23f980fa55d9; detaching it from the instance and deleting it from the info cache
Dec 05 15:20:55 user nova-compute[75080]: DEBUG nova.network.neutron [req-bc0a6bb7-e0fd-42b9-9bca-6034e73d549e req-35f6d5e3-9681-4f56-84d5-0dc67a9241cd service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Updating instance_info_cache with network_info: [{"id": "3e2379bd-6e97-45dc-917b-e8e4478a3be0", "address": "fa:16:3e:68:6e:ba", "network": {"id": "1adc7b37-8fcb-4b25-92e7-e746874f778b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-490224437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24e3fe3c0db24db598f947ebfe7a8b3d", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2379bd-6e", "ovs_interfaceid": "3e2379bd-6e97-45dc-917b-e8e4478a3be0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG nova.compute.manager [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-37c9b487-44d0-453a-a967-ab6ee8ed6fe1 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Acquiring lock "refresh_cache-0259351f-617f-47be-bfb6-2fef1c35bf15" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-37c9b487-44d0-453a-a967-ab6ee8ed6fe1 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Acquired lock "refresh_cache-0259351f-617f-47be-bfb6-2fef1c35bf15" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG nova.network.neutron [None req-37c9b487-44d0-453a-a967-ab6ee8ed6fe1 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG nova.objects.instance [req-bc0a6bb7-e0fd-42b9-9bca-6034e73d549e req-35f6d5e3-9681-4f56-84d5-0dc67a9241cd service nova] Lazy-loading 'system_metadata' on Instance uuid 0259351f-617f-47be-bfb6-2fef1c35bf15 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG nova.objects.instance [req-bc0a6bb7-e0fd-42b9-9bca-6034e73d549e req-35f6d5e3-9681-4f56-84d5-0dc67a9241cd service nova] Lazy-loading 'flavor' on Instance uuid 0259351f-617f-47be-bfb6-2fef1c35bf15 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG nova.objects.base [req-bc0a6bb7-e0fd-42b9-9bca-6034e73d549e req-35f6d5e3-9681-4f56-84d5-0dc67a9241cd service nova] Object Instance<0259351f-617f-47be-bfb6-2fef1c35bf15> lazy-loaded attributes: system_metadata,flavor {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [req-bc0a6bb7-e0fd-42b9-9bca-6034e73d549e req-35f6d5e3-9681-4f56-84d5-0dc67a9241cd service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-640774861',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-640774861',id=4,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOcchwMQ/y1AsP3A0b3QpAgR94U3k1ch+DL7mOp5G4Jk3dTtQRet9PTuUq+tE9S2nFGwMJzhzoriFDCKnxJ67e/D1DfTAZHVMm0T9FYpXt1Eg6HZqWa1ZIEyx+Gye4eIQ==',key_name='tempest-keypair-1279310443',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:18:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='24e3fe3c0db24db598f947ebfe7a8b3d',ramdisk_id='',reservation_id='r-yuqxc4c9',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1860660485',owner_user_name='tempest-TaggedAttachmentsTest-1860660485-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:18:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bd4a8e35eed47d1b156037a6dda5668',uuid=0259351f-617f-47be-bfb6-2fef1c35bf15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dcdd907f-231e-4ca4-97b6-23f980fa55d9", "address": "fa:16:3e:3a:71:c4", "network": {"id": "c00c0358-c733-4598-b947-d6c502a0c5e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-376926346", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "24e3fe3c0db24db598f947ebfe7a8b3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcdd907f-23", "ovs_interfaceid": "dcdd907f-231e-4ca4-97b6-23f980fa55d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG nova.network.os_vif_util [req-bc0a6bb7-e0fd-42b9-9bca-6034e73d549e req-35f6d5e3-9681-4f56-84d5-0dc67a9241cd service nova] Converting VIF {"id": "dcdd907f-231e-4ca4-97b6-23f980fa55d9", "address": "fa:16:3e:3a:71:c4", "network": {"id": "c00c0358-c733-4598-b947-d6c502a0c5e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-376926346", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "24e3fe3c0db24db598f947ebfe7a8b3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcdd907f-23", "ovs_interfaceid": "dcdd907f-231e-4ca4-97b6-23f980fa55d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG nova.network.os_vif_util [req-bc0a6bb7-e0fd-42b9-9bca-6034e73d549e req-35f6d5e3-9681-4f56-84d5-0dc67a9241cd service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:71:c4,bridge_name='br-int',has_traffic_filtering=True,id=dcdd907f-231e-4ca4-97b6-23f980fa55d9,network=Network(c00c0358-c733-4598-b947-d6c502a0c5e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcdd907f-23') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [req-bc0a6bb7-e0fd-42b9-9bca-6034e73d549e req-35f6d5e3-9681-4f56-84d5-0dc67a9241cd service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3a:71:c4"/><model type="virtio"/><mtu size="1442"/><target dev="tapdcdd907f-23"/></interface> {{(pid=75080) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [req-bc0a6bb7-e0fd-42b9-9bca-6034e73d549e req-35f6d5e3-9681-4f56-84d5-0dc67a9241cd service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:3a:71:c4"/><model type="virtio"/><mtu size="1442"/><target dev="tapdcdd907f-23"/></interface>not found in domain: <domain type='kvm' id='4'>
Dec 05 15:20:55 user nova-compute[75080]:   <name>instance-00000004</name>
Dec 05 15:20:55 user nova-compute[75080]:   <uuid>0259351f-617f-47be-bfb6-2fef1c35bf15</uuid>
Dec 05 15:20:55 user nova-compute[75080]:   <metadata>
Dec 05 15:20:55 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:20:55 user nova-compute[75080]:   <nova:package version="0.0.0"/>
Dec 05 15:20:55 user nova-compute[75080]:   <nova:name>tempest-device-tagging-server-640774861</nova:name>
Dec 05 15:20:55 user nova-compute[75080]:   <nova:creationTime>2023-12-05 15:20:54</nova:creationTime>
Dec 05 15:20:55 user nova-compute[75080]:   <nova:flavor name="m1.tiny">
Dec 05 15:20:55 user nova-compute[75080]:     <nova:memory>512</nova:memory>
Dec 05 15:20:55 user nova-compute[75080]:     <nova:disk>1</nova:disk>
Dec 05 15:20:55 user nova-compute[75080]:     <nova:swap>0</nova:swap>
Dec 05 15:20:55 user nova-compute[75080]:     <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:20:55 user nova-compute[75080]:     <nova:vcpus>1</nova:vcpus>
Dec 05 15:20:55 user nova-compute[75080]:   </nova:flavor>
Dec 05 15:20:55 user nova-compute[75080]:   <nova:owner>
Dec 05 15:20:55 user nova-compute[75080]:     <nova:user uuid="2bd4a8e35eed47d1b156037a6dda5668">tempest-TaggedAttachmentsTest-1860660485-project-member</nova:user>
Dec 05 15:20:55 user nova-compute[75080]:     <nova:project uuid="24e3fe3c0db24db598f947ebfe7a8b3d">tempest-TaggedAttachmentsTest-1860660485</nova:project>
Dec 05 15:20:55 user nova-compute[75080]:   </nova:owner>
Dec 05 15:20:55 user nova-compute[75080]:   <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:20:55 user nova-compute[75080]:   <nova:ports>
Dec 05 15:20:55 user nova-compute[75080]:     <nova:port uuid="3e2379bd-6e97-45dc-917b-e8e4478a3be0">
Dec 05 15:20:55 user nova-compute[75080]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 05 15:20:55 user nova-compute[75080]:     </nova:port>
Dec 05 15:20:55 user nova-compute[75080]:   </nova:ports>
Dec 05 15:20:55 user nova-compute[75080]: </nova:instance>
Dec 05 15:20:55 user nova-compute[75080]:   </metadata>
Dec 05 15:20:55 user nova-compute[75080]:   <memory unit='KiB'>524288</memory>
Dec 05 15:20:55 user nova-compute[75080]:   <currentMemory unit='KiB'>524288</currentMemory>
Dec 05 15:20:55 user nova-compute[75080]:   <vcpu placement='static'>1</vcpu>
Dec 05 15:20:55 user nova-compute[75080]:   <resource>
Dec 05 15:20:55 user nova-compute[75080]:     <partition>/machine</partition>
Dec 05 15:20:55 user nova-compute[75080]:   </resource>
Dec 05 15:20:55 user nova-compute[75080]:   <sysinfo type='smbios'>
Dec 05 15:20:55 user nova-compute[75080]:     <system>
Dec 05 15:20:55 user nova-compute[75080]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Dec 05 15:20:55 user nova-compute[75080]:       <entry name='product'>OpenStack Nova</entry>
Dec 05 15:20:55 user nova-compute[75080]:       <entry name='version'>0.0.0</entry>
Dec 05 15:20:55 user nova-compute[75080]:       <entry name='serial'>0259351f-617f-47be-bfb6-2fef1c35bf15</entry>
Dec 05 15:20:55 user nova-compute[75080]:       <entry name='uuid'>0259351f-617f-47be-bfb6-2fef1c35bf15</entry>
Dec 05 15:20:55 user nova-compute[75080]:       <entry name='family'>Virtual Machine</entry>
Dec 05 15:20:55 user nova-compute[75080]:     </system>
Dec 05 15:20:55 user nova-compute[75080]:   </sysinfo>
Dec 05 15:20:55 user nova-compute[75080]:   <os>
Dec 05 15:20:55 user nova-compute[75080]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Dec 05 15:20:55 user nova-compute[75080]:     <boot dev='hd'/>
Dec 05 15:20:55 user nova-compute[75080]:     <smbios mode='sysinfo'/>
Dec 05 15:20:55 user nova-compute[75080]:   </os>
Dec 05 15:20:55 user nova-compute[75080]:   <features>
Dec 05 15:20:55 user nova-compute[75080]:     <acpi/>
Dec 05 15:20:55 user nova-compute[75080]:     <apic/>
Dec 05 15:20:55 user nova-compute[75080]:     <vmcoreinfo state='on'/>
Dec 05 15:20:55 user nova-compute[75080]:   </features>
Dec 05 15:20:55 user nova-compute[75080]:   <cpu mode='custom' match='exact' check='full'>
Dec 05 15:20:55 user nova-compute[75080]:     <model fallback='forbid'>Nehalem</model>
Dec 05 15:20:55 user nova-compute[75080]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Dec 05 15:20:55 user nova-compute[75080]:     <feature policy='require' name='vme'/>
Dec 05 15:20:55 user nova-compute[75080]:     <feature policy='require' name='x2apic'/>
Dec 05 15:20:55 user nova-compute[75080]:     <feature policy='require' name='hypervisor'/>
Dec 05 15:20:55 user nova-compute[75080]:   </cpu>
Dec 05 15:20:55 user nova-compute[75080]:   <clock offset='utc'>
Dec 05 15:20:55 user nova-compute[75080]:     <timer name='pit' tickpolicy='delay'/>
Dec 05 15:20:55 user nova-compute[75080]:     <timer name='rtc' tickpolicy='catchup'/>
Dec 05 15:20:55 user nova-compute[75080]:     <timer name='hpet' present='no'/>
Dec 05 15:20:55 user nova-compute[75080]:   </clock>
Dec 05 15:20:55 user nova-compute[75080]:   <on_poweroff>destroy</on_poweroff>
Dec 05 15:20:55 user nova-compute[75080]:   <on_reboot>restart</on_reboot>
Dec 05 15:20:55 user nova-compute[75080]:   <on_crash>destroy</on_crash>
Dec 05 15:20:55 user nova-compute[75080]:   <devices>
Dec 05 15:20:55 user nova-compute[75080]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 05 15:20:55 user nova-compute[75080]:     <disk type='file' device='disk'>
Dec 05 15:20:55 user nova-compute[75080]:       <driver name='qemu' type='qcow2' cache='none'/>
Dec 05 15:20:55 user nova-compute[75080]:       <source file='/opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/disk' index='2'/>
Dec 05 15:20:55 user nova-compute[75080]:       <backingStore type='file' index='3'>
Dec 05 15:20:55 user nova-compute[75080]:         <format type='raw'/>
Dec 05 15:20:55 user nova-compute[75080]:         <source file='/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee'/>
Dec 05 15:20:55 user nova-compute[75080]:         <backingStore/>
Dec 05 15:20:55 user nova-compute[75080]:       </backingStore>
Dec 05 15:20:55 user nova-compute[75080]:       <target dev='vda' bus='virtio'/>
Dec 05 15:20:55 user nova-compute[75080]:       <alias name='virtio-disk0'/>
Dec 05 15:20:55 user nova-compute[75080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Dec 05 15:20:55 user nova-compute[75080]:     </disk>
Dec 05 15:20:55 user nova-compute[75080]:     <disk type='file' device='cdrom'>
Dec 05 15:20:55 user nova-compute[75080]:       <driver name='qemu' type='raw' cache='none'/>
Dec 05 15:20:55 user nova-compute[75080]:       <source file='/opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/disk.config' index='1'/>
Dec 05 15:20:55 user nova-compute[75080]:       <backingStore/>
Dec 05 15:20:55 user nova-compute[75080]:       <target dev='hda' bus='ide'/>
Dec 05 15:20:55 user nova-compute[75080]:       <readonly/>
Dec 05 15:20:55 user nova-compute[75080]:       <alias name='ide0-0-0'/>
Dec 05 15:20:55 user nova-compute[75080]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Dec 05 15:20:55 user nova-compute[75080]:     </disk>
Dec 05 15:20:55 user nova-compute[75080]:     <controller type='usb' index='0' model='none'>
Dec 05 15:20:55 user nova-compute[75080]:       <alias name='usb'/>
Dec 05 15:20:55 user nova-compute[75080]:     </controller>
Dec 05 15:20:55 user nova-compute[75080]:     <controller type='pci' index='0' model='pci-root'>
Dec 05 15:20:55 user nova-compute[75080]:       <alias name='pci.0'/>
Dec 05 15:20:55 user nova-compute[75080]:     </controller>
Dec 05 15:20:55 user nova-compute[75080]:     <controller type='ide' index='0'>
Dec 05 15:20:55 user nova-compute[75080]:       <alias name='ide'/>
Dec 05 15:20:55 user nova-compute[75080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Dec 05 15:20:55 user nova-compute[75080]:     </controller>
Dec 05 15:20:55 user nova-compute[75080]:     <interface type='ethernet'>
Dec 05 15:20:55 user nova-compute[75080]:       <mac address='fa:16:3e:68:6e:ba'/>
Dec 05 15:20:55 user nova-compute[75080]:       <target dev='tap3e2379bd-6e'/>
Dec 05 15:20:55 user nova-compute[75080]:       <model type='virtio'/>
Dec 05 15:20:55 user nova-compute[75080]:       <mtu size='1442'/>
Dec 05 15:20:55 user nova-compute[75080]:       <alias name='net0'/>
Dec 05 15:20:55 user nova-compute[75080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Dec 05 15:20:55 user nova-compute[75080]:     </interface>
Dec 05 15:20:55 user nova-compute[75080]:     <serial type='pty'>
Dec 05 15:20:55 user nova-compute[75080]:       <source path='/dev/pts/4'/>
Dec 05 15:20:55 user nova-compute[75080]:       <log file='/opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/console.log' append='off'/>
Dec 05 15:20:55 user nova-compute[75080]:       <target type='isa-serial' port='0'>
Dec 05 15:20:55 user nova-compute[75080]:         <model name='isa-serial'/>
Dec 05 15:20:55 user nova-compute[75080]:       </target>
Dec 05 15:20:55 user nova-compute[75080]:       <alias name='serial0'/>
Dec 05 15:20:55 user nova-compute[75080]:     </serial>
Dec 05 15:20:55 user nova-compute[75080]:     <console type='pty' tty='/dev/pts/4'>
Dec 05 15:20:55 user nova-compute[75080]:       <source path='/dev/pts/4'/>
Dec 05 15:20:55 user nova-compute[75080]:       <log file='/opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/console.log' append='off'/>
Dec 05 15:20:55 user nova-compute[75080]:       <target type='serial' port='0'/>
Dec 05 15:20:55 user nova-compute[75080]:       <alias name='serial0'/>
Dec 05 15:20:55 user nova-compute[75080]:     </console>
Dec 05 15:20:55 user nova-compute[75080]:     <input type='mouse' bus='ps2'>
Dec 05 15:20:55 user nova-compute[75080]:       <alias name='input0'/>
Dec 05 15:20:55 user nova-compute[75080]:     </input>
Dec 05 15:20:55 user nova-compute[75080]:     <input type='keyboard' bus='ps2'>
Dec 05 15:20:55 user nova-compute[75080]:       <alias name='input1'/>
Dec 05 15:20:55 user nova-compute[75080]:     </input>
Dec 05 15:20:55 user nova-compute[75080]:     <graphics type='vnc' port='5903' autoport='yes' listen='0.0.0.0'>
Dec 05 15:20:55 user nova-compute[75080]:       <listen type='address' address='0.0.0.0'/>
Dec 05 15:20:55 user nova-compute[75080]:     </graphics>
Dec 05 15:20:55 user nova-compute[75080]:     <audio id='1' type='none'/>
Dec 05 15:20:55 user nova-compute[75080]:     <video>
Dec 05 15:20:55 user nova-compute[75080]:       <model type='virtio' heads='1' primary='yes'/>
Dec 05 15:20:55 user nova-compute[75080]:       <alias name='video0'/>
Dec 05 15:20:55 user nova-compute[75080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Dec 05 15:20:55 user nova-compute[75080]:     </video>
Dec 05 15:20:55 user nova-compute[75080]:     <memballoon model='virtio'>
Dec 05 15:20:55 user nova-compute[75080]:       <stats period='10'/>
Dec 05 15:20:55 user nova-compute[75080]:       <alias name='balloon0'/>
Dec 05 15:20:55 user nova-compute[75080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Dec 05 15:20:55 user nova-compute[75080]:     </memballoon>
Dec 05 15:20:55 user nova-compute[75080]:     <rng model='virtio'>
Dec 05 15:20:55 user nova-compute[75080]:       <backend model='random'>/dev/urandom</backend>
Dec 05 15:20:55 user nova-compute[75080]:       <alias name='rng0'/>
Dec 05 15:20:55 user nova-compute[75080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Dec 05 15:20:55 user nova-compute[75080]:     </rng>
Dec 05 15:20:55 user nova-compute[75080]:   </devices>
Dec 05 15:20:55 user nova-compute[75080]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Dec 05 15:20:55 user nova-compute[75080]:     <label>libvirt-0259351f-617f-47be-bfb6-2fef1c35bf15</label>
Dec 05 15:20:55 user nova-compute[75080]:     <imagelabel>libvirt-0259351f-617f-47be-bfb6-2fef1c35bf15</imagelabel>
Dec 05 15:20:55 user nova-compute[75080]:   </seclabel>
Dec 05 15:20:55 user nova-compute[75080]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Dec 05 15:20:55 user nova-compute[75080]:     <label>+64055:+108</label>
Dec 05 15:20:55 user nova-compute[75080]:     <imagelabel>+64055:+108</imagelabel>
Dec 05 15:20:55 user nova-compute[75080]:   </seclabel>
Dec 05 15:20:55 user nova-compute[75080]: </domain>
Dec 05 15:20:55 user nova-compute[75080]:  {{(pid=75080) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [req-bc0a6bb7-e0fd-42b9-9bca-6034e73d549e req-35f6d5e3-9681-4f56-84d5-0dc67a9241cd service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3a:71:c4"/><model type="virtio"/><mtu size="1442"/><target dev="tapdcdd907f-23"/></interface> {{(pid=75080) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [req-bc0a6bb7-e0fd-42b9-9bca-6034e73d549e req-35f6d5e3-9681-4f56-84d5-0dc67a9241cd service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:3a:71:c4"/><model type="virtio"/><mtu size="1442"/><target dev="tapdcdd907f-23"/></interface>not found in domain: <domain type='kvm' id='4'>
Dec 05 15:20:55 user nova-compute[75080]:   <name>instance-00000004</name>
Dec 05 15:20:55 user nova-compute[75080]:   <uuid>0259351f-617f-47be-bfb6-2fef1c35bf15</uuid>
Dec 05 15:20:55 user nova-compute[75080]:   <metadata>
Dec 05 15:20:55 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:20:55 user nova-compute[75080]:   <nova:package version="0.0.0"/>
Dec 05 15:20:55 user nova-compute[75080]:   <nova:name>tempest-device-tagging-server-640774861</nova:name>
Dec 05 15:20:55 user nova-compute[75080]:   <nova:creationTime>2023-12-05 15:20:54</nova:creationTime>
Dec 05 15:20:55 user nova-compute[75080]:   <nova:flavor name="m1.tiny">
Dec 05 15:20:55 user nova-compute[75080]:     <nova:memory>512</nova:memory>
Dec 05 15:20:55 user nova-compute[75080]:     <nova:disk>1</nova:disk>
Dec 05 15:20:55 user nova-compute[75080]:     <nova:swap>0</nova:swap>
Dec 05 15:20:55 user nova-compute[75080]:     <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:20:55 user nova-compute[75080]:     <nova:vcpus>1</nova:vcpus>
Dec 05 15:20:55 user nova-compute[75080]:   </nova:flavor>
Dec 05 15:20:55 user nova-compute[75080]:   <nova:owner>
Dec 05 15:20:55 user nova-compute[75080]:     <nova:user uuid="2bd4a8e35eed47d1b156037a6dda5668">tempest-TaggedAttachmentsTest-1860660485-project-member</nova:user>
Dec 05 15:20:55 user nova-compute[75080]:     <nova:project uuid="24e3fe3c0db24db598f947ebfe7a8b3d">tempest-TaggedAttachmentsTest-1860660485</nova:project>
Dec 05 15:20:55 user nova-compute[75080]:   </nova:owner>
Dec 05 15:20:55 user nova-compute[75080]:   <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:20:55 user nova-compute[75080]:   <nova:ports>
Dec 05 15:20:55 user nova-compute[75080]:     <nova:port uuid="3e2379bd-6e97-45dc-917b-e8e4478a3be0">
Dec 05 15:20:55 user nova-compute[75080]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 05 15:20:55 user nova-compute[75080]:     </nova:port>
Dec 05 15:20:55 user nova-compute[75080]:   </nova:ports>
Dec 05 15:20:55 user nova-compute[75080]: </nova:instance>
Dec 05 15:20:55 user nova-compute[75080]:   </metadata>
Dec 05 15:20:55 user nova-compute[75080]:   <memory unit='KiB'>524288</memory>
Dec 05 15:20:55 user nova-compute[75080]:   <currentMemory unit='KiB'>524288</currentMemory>
Dec 05 15:20:55 user nova-compute[75080]:   <vcpu placement='static'>1</vcpu>
Dec 05 15:20:55 user nova-compute[75080]:   <resource>
Dec 05 15:20:55 user nova-compute[75080]:     <partition>/machine</partition>
Dec 05 15:20:55 user nova-compute[75080]:   </resource>
Dec 05 15:20:55 user nova-compute[75080]:   <sysinfo type='smbios'>
Dec 05 15:20:55 user nova-compute[75080]:     <system>
Dec 05 15:20:55 user nova-compute[75080]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Dec 05 15:20:55 user nova-compute[75080]:       <entry name='product'>OpenStack Nova</entry>
Dec 05 15:20:55 user nova-compute[75080]:       <entry name='version'>0.0.0</entry>
Dec 05 15:20:55 user nova-compute[75080]:       <entry name='serial'>0259351f-617f-47be-bfb6-2fef1c35bf15</entry>
Dec 05 15:20:55 user nova-compute[75080]:       <entry name='uuid'>0259351f-617f-47be-bfb6-2fef1c35bf15</entry>
Dec 05 15:20:55 user nova-compute[75080]:       <entry name='family'>Virtual Machine</entry>
Dec 05 15:20:55 user nova-compute[75080]:     </system>
Dec 05 15:20:55 user nova-compute[75080]:   </sysinfo>
Dec 05 15:20:55 user nova-compute[75080]:   <os>
Dec 05 15:20:55 user nova-compute[75080]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Dec 05 15:20:55 user nova-compute[75080]:     <boot dev='hd'/>
Dec 05 15:20:55 user nova-compute[75080]:     <smbios mode='sysinfo'/>
Dec 05 15:20:55 user nova-compute[75080]:   </os>
Dec 05 15:20:55 user nova-compute[75080]:   <features>
Dec 05 15:20:55 user nova-compute[75080]:     <acpi/>
Dec 05 15:20:55 user nova-compute[75080]:     <apic/>
Dec 05 15:20:55 user nova-compute[75080]:     <vmcoreinfo state='on'/>
Dec 05 15:20:55 user nova-compute[75080]:   </features>
Dec 05 15:20:55 user nova-compute[75080]:   <cpu mode='custom' match='exact' check='full'>
Dec 05 15:20:55 user nova-compute[75080]:     <model fallback='forbid'>Nehalem</model>
Dec 05 15:20:55 user nova-compute[75080]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Dec 05 15:20:55 user nova-compute[75080]:     <feature policy='require' name='vme'/>
Dec 05 15:20:55 user nova-compute[75080]:     <feature policy='require' name='x2apic'/>
Dec 05 15:20:55 user nova-compute[75080]:     <feature policy='require' name='hypervisor'/>
Dec 05 15:20:55 user nova-compute[75080]:   </cpu>
Dec 05 15:20:55 user nova-compute[75080]:   <clock offset='utc'>
Dec 05 15:20:55 user nova-compute[75080]:     <timer name='pit' tickpolicy='delay'/>
Dec 05 15:20:55 user nova-compute[75080]:     <timer name='rtc' tickpolicy='catchup'/>
Dec 05 15:20:55 user nova-compute[75080]:     <timer name='hpet' present='no'/>
Dec 05 15:20:55 user nova-compute[75080]:   </clock>
Dec 05 15:20:55 user nova-compute[75080]:   <on_poweroff>destroy</on_poweroff>
Dec 05 15:20:55 user nova-compute[75080]:   <on_reboot>restart</on_reboot>
Dec 05 15:20:55 user nova-compute[75080]:   <on_crash>destroy</on_crash>
Dec 05 15:20:55 user nova-compute[75080]:   <devices>
Dec 05 15:20:55 user nova-compute[75080]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 05 15:20:55 user nova-compute[75080]:     <disk type='file' device='disk'>
Dec 05 15:20:55 user nova-compute[75080]:       <driver name='qemu' type='qcow2' cache='none'/>
Dec 05 15:20:55 user nova-compute[75080]:       <source file='/opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/disk' index='2'/>
Dec 05 15:20:55 user nova-compute[75080]:       <backingStore type='file' index='3'>
Dec 05 15:20:55 user nova-compute[75080]:         <format type='raw'/>
Dec 05 15:20:55 user nova-compute[75080]:         <source file='/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee'/>
Dec 05 15:20:55 user nova-compute[75080]:         <backingStore/>
Dec 05 15:20:55 user nova-compute[75080]:       </backingStore>
Dec 05 15:20:55 user nova-compute[75080]:       <target dev='vda' bus='virtio'/>
Dec 05 15:20:55 user nova-compute[75080]:       <alias name='virtio-disk0'/>
Dec 05 15:20:55 user nova-compute[75080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Dec 05 15:20:55 user nova-compute[75080]:     </disk>
Dec 05 15:20:55 user nova-compute[75080]:     <disk type='file' device='cdrom'>
Dec 05 15:20:55 user nova-compute[75080]:       <driver name='qemu' type='raw' cache='none'/>
Dec 05 15:20:55 user nova-compute[75080]:       <source file='/opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/disk.config' index='1'/>
Dec 05 15:20:55 user nova-compute[75080]:       <backingStore/>
Dec 05 15:20:55 user nova-compute[75080]:       <target dev='hda' bus='ide'/>
Dec 05 15:20:55 user nova-compute[75080]:       <readonly/>
Dec 05 15:20:55 user nova-compute[75080]:       <alias name='ide0-0-0'/>
Dec 05 15:20:55 user nova-compute[75080]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Dec 05 15:20:55 user nova-compute[75080]:     </disk>
Dec 05 15:20:55 user nova-compute[75080]:     <controller type='usb' index='0' model='none'>
Dec 05 15:20:55 user nova-compute[75080]:       <alias name='usb'/>
Dec 05 15:20:55 user nova-compute[75080]:     </controller>
Dec 05 15:20:55 user nova-compute[75080]:     <controller type='pci' index='0' model='pci-root'>
Dec 05 15:20:55 user nova-compute[75080]:       <alias name='pci.0'/>
Dec 05 15:20:55 user nova-compute[75080]:     </controller>
Dec 05 15:20:55 user nova-compute[75080]:     <controller type='ide' index='0'>
Dec 05 15:20:55 user nova-compute[75080]:       <alias name='ide'/>
Dec 05 15:20:55 user nova-compute[75080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Dec 05 15:20:55 user nova-compute[75080]:     </controller>
Dec 05 15:20:55 user nova-compute[75080]:     <interface type='ethernet'>
Dec 05 15:20:55 user nova-compute[75080]:       <mac address='fa:16:3e:68:6e:ba'/>
Dec 05 15:20:55 user nova-compute[75080]:       <target dev='tap3e2379bd-6e'/>
Dec 05 15:20:55 user nova-compute[75080]:       <model type='virtio'/>
Dec 05 15:20:55 user nova-compute[75080]:       <mtu size='1442'/>
Dec 05 15:20:55 user nova-compute[75080]:       <alias name='net0'/>
Dec 05 15:20:55 user nova-compute[75080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Dec 05 15:20:55 user nova-compute[75080]:     </interface>
Dec 05 15:20:55 user nova-compute[75080]:     <serial type='pty'>
Dec 05 15:20:55 user nova-compute[75080]:       <source path='/dev/pts/4'/>
Dec 05 15:20:55 user nova-compute[75080]:       <log file='/opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/console.log' append='off'/>
Dec 05 15:20:55 user nova-compute[75080]:       <target type='isa-serial' port='0'>
Dec 05 15:20:55 user nova-compute[75080]:         <model name='isa-serial'/>
Dec 05 15:20:55 user nova-compute[75080]:       </target>
Dec 05 15:20:55 user nova-compute[75080]:       <alias name='serial0'/>
Dec 05 15:20:55 user nova-compute[75080]:     </serial>
Dec 05 15:20:55 user nova-compute[75080]:     <console type='pty' tty='/dev/pts/4'>
Dec 05 15:20:55 user nova-compute[75080]:       <source path='/dev/pts/4'/>
Dec 05 15:20:55 user nova-compute[75080]:       <log file='/opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/console.log' append='off'/>
Dec 05 15:20:55 user nova-compute[75080]:       <target type='serial' port='0'/>
Dec 05 15:20:55 user nova-compute[75080]:       <alias name='serial0'/>
Dec 05 15:20:55 user nova-compute[75080]:     </console>
Dec 05 15:20:55 user nova-compute[75080]:     <input type='mouse' bus='ps2'>
Dec 05 15:20:55 user nova-compute[75080]:       <alias name='input0'/>
Dec 05 15:20:55 user nova-compute[75080]:     </input>
Dec 05 15:20:55 user nova-compute[75080]:     <input type='keyboard' bus='ps2'>
Dec 05 15:20:55 user nova-compute[75080]:       <alias name='input1'/>
Dec 05 15:20:55 user nova-compute[75080]:     </input>
Dec 05 15:20:55 user nova-compute[75080]:     <graphics type='vnc' port='5903' autoport='yes' listen='0.0.0.0'>
Dec 05 15:20:55 user nova-compute[75080]:       <listen type='address' address='0.0.0.0'/>
Dec 05 15:20:55 user nova-compute[75080]:     </graphics>
Dec 05 15:20:55 user nova-compute[75080]:     <audio id='1' type='none'/>
Dec 05 15:20:55 user nova-compute[75080]:     <video>
Dec 05 15:20:55 user nova-compute[75080]:       <model type='virtio' heads='1' primary='yes'/>
Dec 05 15:20:55 user nova-compute[75080]:       <alias name='video0'/>
Dec 05 15:20:55 user nova-compute[75080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Dec 05 15:20:55 user nova-compute[75080]:     </video>
Dec 05 15:20:55 user nova-compute[75080]:     <memballoon model='virtio'>
Dec 05 15:20:55 user nova-compute[75080]:       <stats period='10'/>
Dec 05 15:20:55 user nova-compute[75080]:       <alias name='balloon0'/>
Dec 05 15:20:55 user nova-compute[75080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Dec 05 15:20:55 user nova-compute[75080]:     </memballoon>
Dec 05 15:20:55 user nova-compute[75080]:     <rng model='virtio'>
Dec 05 15:20:55 user nova-compute[75080]:       <backend model='random'>/dev/urandom</backend>
Dec 05 15:20:55 user nova-compute[75080]:       <alias name='rng0'/>
Dec 05 15:20:55 user nova-compute[75080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Dec 05 15:20:55 user nova-compute[75080]:     </rng>
Dec 05 15:20:55 user nova-compute[75080]:   </devices>
Dec 05 15:20:55 user nova-compute[75080]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Dec 05 15:20:55 user nova-compute[75080]:     <label>libvirt-0259351f-617f-47be-bfb6-2fef1c35bf15</label>
Dec 05 15:20:55 user nova-compute[75080]:     <imagelabel>libvirt-0259351f-617f-47be-bfb6-2fef1c35bf15</imagelabel>
Dec 05 15:20:55 user nova-compute[75080]:   </seclabel>
Dec 05 15:20:55 user nova-compute[75080]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Dec 05 15:20:55 user nova-compute[75080]:     <label>+64055:+108</label>
Dec 05 15:20:55 user nova-compute[75080]:     <imagelabel>+64055:+108</imagelabel>
Dec 05 15:20:55 user nova-compute[75080]:   </seclabel>
Dec 05 15:20:55 user nova-compute[75080]: </domain>
Dec 05 15:20:55 user nova-compute[75080]:  {{(pid=75080) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Dec 05 15:20:55 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [req-bc0a6bb7-e0fd-42b9-9bca-6034e73d549e req-35f6d5e3-9681-4f56-84d5-0dc67a9241cd service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Detaching interface fa:16:3e:3a:71:c4 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapdcdd907f-23' not found.
Dec 05 15:20:55 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [req-bc0a6bb7-e0fd-42b9-9bca-6034e73d549e req-35f6d5e3-9681-4f56-84d5-0dc67a9241cd service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-640774861',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-640774861',id=4,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOcchwMQ/y1AsP3A0b3QpAgR94U3k1ch+DL7mOp5G4Jk3dTtQRet9PTuUq+tE9S2nFGwMJzhzoriFDCKnxJ67e/D1DfTAZHVMm0T9FYpXt1Eg6HZqWa1ZIEyx+Gye4eIQ==',key_name='tempest-keypair-1279310443',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:18:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='24e3fe3c0db24db598f947ebfe7a8b3d',ramdisk_id='',reservation_id='r-yuqxc4c9',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1860660485',owner_user_name='tempest-TaggedAttachmentsTest-1860660485-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:18:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bd4a8e35eed47d1b156037a6dda5668',uuid=0259351f-617f-47be-bfb6-2fef1c35bf15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dcdd907f-231e-4ca4-97b6-23f980fa55d9", "address": "fa:16:3e:3a:71:c4", "network": {"id": "c00c0358-c733-4598-b947-d6c502a0c5e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-376926346", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "24e3fe3c0db24db598f947ebfe7a8b3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcdd907f-23", "ovs_interfaceid": "dcdd907f-231e-4ca4-97b6-23f980fa55d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG nova.network.os_vif_util [req-bc0a6bb7-e0fd-42b9-9bca-6034e73d549e req-35f6d5e3-9681-4f56-84d5-0dc67a9241cd service nova] Converting VIF {"id": "dcdd907f-231e-4ca4-97b6-23f980fa55d9", "address": "fa:16:3e:3a:71:c4", "network": {"id": "c00c0358-c733-4598-b947-d6c502a0c5e8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-376926346", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "24e3fe3c0db24db598f947ebfe7a8b3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcdd907f-23", "ovs_interfaceid": "dcdd907f-231e-4ca4-97b6-23f980fa55d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG nova.network.os_vif_util [req-bc0a6bb7-e0fd-42b9-9bca-6034e73d549e req-35f6d5e3-9681-4f56-84d5-0dc67a9241cd service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:71:c4,bridge_name='br-int',has_traffic_filtering=True,id=dcdd907f-231e-4ca4-97b6-23f980fa55d9,network=Network(c00c0358-c733-4598-b947-d6c502a0c5e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcdd907f-23') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG os_vif [req-bc0a6bb7-e0fd-42b9-9bca-6034e73d549e req-35f6d5e3-9681-4f56-84d5-0dc67a9241cd service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:71:c4,bridge_name='br-int',has_traffic_filtering=True,id=dcdd907f-231e-4ca4-97b6-23f980fa55d9,network=Network(c00c0358-c733-4598-b947-d6c502a0c5e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcdd907f-23') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdcdd907f-23, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:20:55 user nova-compute[75080]: INFO os_vif [req-bc0a6bb7-e0fd-42b9-9bca-6034e73d549e req-35f6d5e3-9681-4f56-84d5-0dc67a9241cd service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:71:c4,bridge_name='br-int',has_traffic_filtering=True,id=dcdd907f-231e-4ca4-97b6-23f980fa55d9,network=Network(c00c0358-c733-4598-b947-d6c502a0c5e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcdd907f-23')
Dec 05 15:20:55 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [req-bc0a6bb7-e0fd-42b9-9bca-6034e73d549e req-35f6d5e3-9681-4f56-84d5-0dc67a9241cd service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:20:55 user nova-compute[75080]:   <nova:package version="0.0.0"/>
Dec 05 15:20:55 user nova-compute[75080]:   <nova:name>tempest-device-tagging-server-640774861</nova:name>
Dec 05 15:20:55 user nova-compute[75080]:   <nova:creationTime>2023-12-05 15:20:55</nova:creationTime>
Dec 05 15:20:55 user nova-compute[75080]:   <nova:flavor name="m1.tiny">
Dec 05 15:20:55 user nova-compute[75080]:     <nova:memory>512</nova:memory>
Dec 05 15:20:55 user nova-compute[75080]:     <nova:disk>1</nova:disk>
Dec 05 15:20:55 user nova-compute[75080]:     <nova:swap>0</nova:swap>
Dec 05 15:20:55 user nova-compute[75080]:     <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:20:55 user nova-compute[75080]:     <nova:vcpus>1</nova:vcpus>
Dec 05 15:20:55 user nova-compute[75080]:   </nova:flavor>
Dec 05 15:20:55 user nova-compute[75080]:   <nova:owner>
Dec 05 15:20:55 user nova-compute[75080]:     <nova:user uuid="2bd4a8e35eed47d1b156037a6dda5668">tempest-TaggedAttachmentsTest-1860660485-project-member</nova:user>
Dec 05 15:20:55 user nova-compute[75080]:     <nova:project uuid="24e3fe3c0db24db598f947ebfe7a8b3d">tempest-TaggedAttachmentsTest-1860660485</nova:project>
Dec 05 15:20:55 user nova-compute[75080]:   </nova:owner>
Dec 05 15:20:55 user nova-compute[75080]:   <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:20:55 user nova-compute[75080]:   <nova:ports>
Dec 05 15:20:55 user nova-compute[75080]:     <nova:port uuid="3e2379bd-6e97-45dc-917b-e8e4478a3be0">
Dec 05 15:20:55 user nova-compute[75080]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 05 15:20:55 user nova-compute[75080]:     </nova:port>
Dec 05 15:20:55 user nova-compute[75080]:   </nova:ports>
Dec 05 15:20:55 user nova-compute[75080]: </nova:instance>
Dec 05 15:20:55 user nova-compute[75080]:  {{(pid=75080) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:20:55 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Took 3.49 seconds to deallocate network for instance.
Dec 05 15:20:55 user nova-compute[75080]: DEBUG nova.compute.manager [req-edfb100f-005c-434c-b473-9f0d3ebe93fa req-8479c4cf-8606-4fda-94b0-6e17d005a748 service nova] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Received event network-vif-unplugged-a78e717e-684a-4255-b220-15faa1145a1e {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-edfb100f-005c-434c-b473-9f0d3ebe93fa req-8479c4cf-8606-4fda-94b0-6e17d005a748 service nova] Acquiring lock "e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-edfb100f-005c-434c-b473-9f0d3ebe93fa req-8479c4cf-8606-4fda-94b0-6e17d005a748 service nova] Lock "e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-edfb100f-005c-434c-b473-9f0d3ebe93fa req-8479c4cf-8606-4fda-94b0-6e17d005a748 service nova] Lock "e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG nova.compute.manager [req-edfb100f-005c-434c-b473-9f0d3ebe93fa req-8479c4cf-8606-4fda-94b0-6e17d005a748 service nova] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] No waiting events found dispatching network-vif-unplugged-a78e717e-684a-4255-b220-15faa1145a1e {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:20:55 user nova-compute[75080]: DEBUG nova.compute.manager [req-edfb100f-005c-434c-b473-9f0d3ebe93fa req-8479c4cf-8606-4fda-94b0-6e17d005a748 service nova] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Received event network-vif-unplugged-a78e717e-684a-4255-b220-15faa1145a1e for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG nova.network.neutron [None req-37c9b487-44d0-453a-a967-ab6ee8ed6fe1 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Updating instance_info_cache with network_info: [{"id": "3e2379bd-6e97-45dc-917b-e8e4478a3be0", "address": "fa:16:3e:68:6e:ba", "network": {"id": "1adc7b37-8fcb-4b25-92e7-e746874f778b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-490224437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24e3fe3c0db24db598f947ebfe7a8b3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2379bd-6e", "ovs_interfaceid": "3e2379bd-6e97-45dc-917b-e8e4478a3be0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-37c9b487-44d0-453a-a967-ab6ee8ed6fe1 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Releasing lock "refresh_cache-0259351f-617f-47be-bfb6-2fef1c35bf15" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-37c9b487-44d0-453a-a967-ab6ee8ed6fe1 tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lock "interface-0259351f-617f-47be-bfb6-2fef1c35bf15-dcdd907f-231e-4ca4-97b6-23f980fa55d9" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.838s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '26130333132393463', 'path': '/dev/sdc'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130333132393463', 'path': '/dev/sdc'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.346s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:20:56 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:20:56 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:20:56 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:20:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG nova.objects.instance [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Lazy-loading 'flavor' on Instance uuid 1830878a-71e0-48f1-85b8-9ed83b1419cd {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9058dedd-ac72-4636-91f7-cf8e84603a4a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:20:56 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fa9899-8a7d-4926-8040-c82fd27d0ea5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a] added
Dec 05 15:20:56 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[356ff44b-9998-4982-8c5a-b41f38ad831a]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9444f74-fb36-4f95-aa6f-252011740862]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WwcFtnfv {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WwcFtnfv" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[694c42cc-b4ab-4651-913e-9dee97607bd2]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WwcFtnfv'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG nova.compute.manager [req-dcd6f4a6-ae04-4ab7-9a15-51a80b87d8fa req-f4e5e051-348d-4526-b679-78815f75d5d5 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-deleted-d89c793b-d55a-47b5-a857-bfb4b02d9781 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG nova.compute.manager [req-dcd6f4a6-ae04-4ab7-9a15-51a80b87d8fa req-f4e5e051-348d-4526-b679-78815f75d5d5 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-deleted-eac25d6a-4e87-4b1b-9eb5-fb857c49cf7c {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG nova.compute.manager [req-dcd6f4a6-ae04-4ab7-9a15-51a80b87d8fa req-f4e5e051-348d-4526-b679-78815f75d5d5 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-deleted-08064378-9b0c-4b96-a818-6bbd4e31b553 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG nova.compute.manager [req-dcd6f4a6-ae04-4ab7-9a15-51a80b87d8fa req-f4e5e051-348d-4526-b679-78815f75d5d5 service nova] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Received event network-vif-deleted-b5f4ea2a-ca87-42b4-a7fe-0234b8567230 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30585fc-3c8d-489a-8a5d-34f698608088]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[167a1ba7-e8a7-46f9-935c-33d1793db9ae]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)
Dec 05 15:20:56 user nova-compute[75080]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)
Dec 05 15:20:56 user nova-compute[75080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:56 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)
Dec 05 15:20:56 user nova-compute[75080]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)
Dec 05 15:20:56 user nova-compute[75080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:56 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1fbca4-dc95-4e2c-9e3e-ebbb0d33607f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a, portal: 172.16.0.220,3260]
Dec 05 15:20:56 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a, portal: 172.16.0.220,3260] successful.
Dec 05 15:20:56 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fb3adb-e6cb-4d29-bb62-7c97974572f1]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae67672-1540-4179-b7b3-17cab141183e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)
Dec 05 15:20:56 user nova-compute[75080]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)
Dec 05 15:20:56 user nova-compute[75080]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a (non-flash)
Dec 05 15:20:56 user nova-compute[75080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:56 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)
Dec 05 15:20:56 user nova-compute[75080]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)
Dec 05 15:20:56 user nova-compute[75080]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a (non-flash)
Dec 05 15:20:56 user nova-compute[75080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:56 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] HCTL ('35', '-', '-', 0) found on session 13 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[111106b0-e2c8-4735-8e32-c294d324e020]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: None {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:20:56 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Instance destroyed successfully.
Dec 05 15:20:56 user nova-compute[75080]: DEBUG nova.objects.instance [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lazy-loading 'resources' on Instance uuid e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:19:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1823276450',display_name='tempest-TestVolumeBootPattern-server-1823276450',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1823276450',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:19:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11227acd507347ae9c5a3bc710707f84',ramdisk_id='',reservation_id='r-yootenq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-23416231',owner_user_name='tempest-TestVolumeBootPattern-23416231-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:19:28Z,user_data=None,user_id='15be5b54cc8346bb86683e4ed2fbba9e',uuid=e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a78e717e-684a-4255-b220-15faa1145a1e", "address": "fa:16:3e:0d:b5:d5", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa78e717e-68", "ovs_interfaceid": "a78e717e-684a-4255-b220-15faa1145a1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Converting VIF {"id": "a78e717e-684a-4255-b220-15faa1145a1e", "address": "fa:16:3e:0d:b5:d5", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa78e717e-68", "ovs_interfaceid": "a78e717e-684a-4255-b220-15faa1145a1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:b5:d5,bridge_name='br-int',has_traffic_filtering=True,id=a78e717e-684a-4255-b220-15faa1145a1e,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa78e717e-68') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG os_vif [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:b5:d5,bridge_name='br-int',has_traffic_filtering=True,id=a78e717e-684a-4255-b220-15faa1145a1e,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa78e717e-68') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa78e717e-68, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9e6a6b3a-36e3-47a3-8ba1-17e101d00783) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:56 user nova-compute[75080]: INFO os_vif [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:b5:d5,bridge_name='br-int',has_traffic_filtering=True,id=a78e717e-684a-4255-b220-15faa1145a1e,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa78e717e-68')
Dec 05 15:20:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] COPY block job progress, current cursor: 4194304 final cursor: 1073741824 {{(pid=75080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbzCFnNm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:20:56 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:20:56 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:20:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] COPY block job progress, current cursor: 110100480 final cursor: 1073741824 {{(pid=75080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WwcFtnfv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] <== connect_volume: return (2756ms) {'type': 'block', 'scsi_wwn': '23435653236646131', 'path': '/dev/sdd'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435653236646131', 'path': '/dev/sdd'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.922s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG nova.objects.instance [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lazy-loading 'flavor' on Instance uuid d69bc0bc-b6e8-447b-b529-54031fc78ce1 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[888ef013-c854-4c5f-96f2-c664b248d737]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:20:57 user nova-compute[75080]: No targets found.
Dec 05 15:20:57 user nova-compute[75080]: iSNS:
Dec 05 15:20:57 user nova-compute[75080]: No targets found.
Dec 05 15:20:57 user nova-compute[75080]: STATIC:
Dec 05 15:20:57 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9
Dec 05 15:20:57 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:57 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:57 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a
Dec 05 15:20:57 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:57 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:57 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a
Dec 05 15:20:57 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:57 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:57 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867
Dec 05 15:20:57 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:20:57 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:20:57 user nova-compute[75080]: FIRMWARE:
Dec 05 15:20:57 user nova-compute[75080]: No targets found.
Dec 05 15:20:57 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:20:57 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:20:57 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[775e82b7-36ca-492e-884a-a9e1626eb396]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 15:20:57 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:20:57 user nova-compute[75080]:   <source dev="/dev/sdd"/>
Dec 05 15:20:57 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:20:57 user nova-compute[75080]:   <serial>953c464d-b8f7-42c1-a489-f1573851a20a</serial>
Dec 05 15:20:57 user nova-compute[75080]: </disk>
Dec 05 15:20:57 user nova-compute[75080]:  {{(pid=75080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] COPY block job progress, current cursor: 253755392 final cursor: 1073741824 {{(pid=75080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27d4966-04e6-4c26-8656-b1a1b3904c81]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)
Dec 05 15:20:57 user nova-compute[75080]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)
Dec 05 15:20:57 user nova-compute[75080]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a (non-flash)
Dec 05 15:20:57 user nova-compute[75080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:57 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)
Dec 05 15:20:57 user nova-compute[75080]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)
Dec 05 15:20:57 user nova-compute[75080]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a (non-flash)
Dec 05 15:20:57 user nova-compute[75080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a (non-flash)
Dec 05 15:20:57 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f66384b2cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a'): ({'sdb'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Removing single pathed devices sdb {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[631af501-8116-4431-a31f-dcbbd36ced79]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0d6fe8-da69-41ab-960f-b26e7dd7b613]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Flushing IO for device /dev/sdb {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d81691a-a622-4fad-af15-0b509ede6d2f]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7994a7f0-3c21-479b-9f59-df92bb38e93e]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d916e1f3-9cde-4c89-8374-310e7749a76e]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[12abe5a4-4d4d-404c-a202-3cbb34deaef0]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a, portal: 172.16.0.220,3260]
Dec 05 15:20:58 user nova-compute[75080]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a, portal: 172.16.0.220,3260] successful.
Dec 05 15:20:58 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:20:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e285c4b-6267-4c48-9b43-f344783b2d6a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:20:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[606a7715-ff7b-41dc-a837-0e903ecfdbe0]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:20:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:20:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.471s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:20:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] <== disconnect_volume: return (1392ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:20:58 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:20:58 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Deleting instance files /opt/stack/data/nova/instances/e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40_del
Dec 05 15:20:58 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Deletion of /opt/stack/data/nova/instances/e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40_del complete
Dec 05 15:20:58 user nova-compute[75080]: DEBUG nova.compute.manager [req-6f1b4654-27c5-4c5e-88c1-68759f53ba8d req-0b8cee96-9e59-45cd-810a-bcb3f46e9131 service nova] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Received event network-vif-plugged-a78e717e-684a-4255-b220-15faa1145a1e {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:20:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-6f1b4654-27c5-4c5e-88c1-68759f53ba8d req-0b8cee96-9e59-45cd-810a-bcb3f46e9131 service nova] Acquiring lock "e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:20:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-6f1b4654-27c5-4c5e-88c1-68759f53ba8d req-0b8cee96-9e59-45cd-810a-bcb3f46e9131 service nova] Lock "e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:20:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-6f1b4654-27c5-4c5e-88c1-68759f53ba8d req-0b8cee96-9e59-45cd-810a-bcb3f46e9131 service nova] Lock "e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:58 user nova-compute[75080]: DEBUG nova.compute.manager [req-6f1b4654-27c5-4c5e-88c1-68759f53ba8d req-0b8cee96-9e59-45cd-810a-bcb3f46e9131 service nova] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] No waiting events found dispatching network-vif-plugged-a78e717e-684a-4255-b220-15faa1145a1e {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:20:58 user nova-compute[75080]: WARNING nova.compute.manager [req-6f1b4654-27c5-4c5e-88c1-68759f53ba8d req-0b8cee96-9e59-45cd-810a-bcb3f46e9131 service nova] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Received unexpected event network-vif-plugged-a78e717e-684a-4255-b220-15faa1145a1e for instance with vm_state active and task_state deleting.
Dec 05 15:20:58 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] COPY block job progress, current cursor: 283115520 final cursor: 1073741824 {{(pid=75080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 15:20:58 user nova-compute[75080]: INFO nova.compute.manager [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Took 2.91 seconds to destroy the instance on the hypervisor.
Dec 05 15:20:58 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:20:58 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:20:58 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:20:58 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:20:58 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:20:58 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] No VIF found with MAC fa:16:3e:b4:f4:d6, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:20:58 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] COPY block job progress, current cursor: 383778816 final cursor: 1073741824 {{(pid=75080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 15:20:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-816a7682-e7e1-42c3-a3fb-2e06c1f3d037 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "d69bc0bc-b6e8-447b-b529-54031fc78ce1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 43.582s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:20:59 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:20:59 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] COPY block job progress, current cursor: 524288000 final cursor: 1073741824 {{(pid=75080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 15:20:59 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Took 0.81 seconds to deallocate network for instance.
Dec 05 15:20:59 user nova-compute[75080]: DEBUG nova.compute.manager [req-ab194216-6b5d-4c3b-8598-d22beba3493f req-3ef1ba1f-48de-4ceb-ac08-0dd1fcef7a7d service nova] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Received event network-vif-deleted-a78e717e-684a-4255-b220-15faa1145a1e {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:20:59 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] COPY block job progress, current cursor: 639631360 final cursor: 1073741824 {{(pid=75080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 15:21:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] COPY block job progress, current cursor: 782237696 final cursor: 1073741824 {{(pid=75080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 15:21:00 user nova-compute[75080]: INFO nova.compute.manager [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] [instance: 912b0528-be16-427f-84fc-8a6cf89d5000] Took 4.72 seconds to detach 3 volumes for instance.
Dec 05 15:21:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] COPY block job progress, current cursor: 905969664 final cursor: 1073741824 {{(pid=75080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 15:21:01 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:21:01 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:21:01 user nova-compute[75080]: INFO nova.compute.manager [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Took 1.82 seconds to detach 1 volumes for instance.
Dec 05 15:21:01 user nova-compute[75080]: DEBUG nova.compute.manager [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40] Deleting volume: 7e285c4b-6267-4c48-9b43-f344783b2d6a {{(pid=75080) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 05 15:21:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.502s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:01 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Deleted allocations for instance 912b0528-be16-427f-84fc-8a6cf89d5000
Dec 05 15:21:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] COPY block job progress, current cursor: 1066401792 final cursor: 1073741824 {{(pid=75080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 15:21:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-dff423ff-7fc3-48b6-86b3-5550a6219a8b tempest-TaggedBootDevicesTest-987206712 tempest-TaggedBootDevicesTest-987206712-project-member] Lock "912b0528-be16-427f-84fc-8a6cf89d5000" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.688s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:01 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:21:01 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:21:01 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:01 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Deleted allocations for instance e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40
Dec 05 15:21:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 15:21:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f56d4e5a-5703-41b6-9271-eb4b5171838a tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "e4b58d1f-51f3-4ff7-9f07-a5c7e5a99b40" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.305s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:21:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xiXwjGRP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': 'dd92e10f-dace-4099-ba5d-c7fcbe8a1867'}, None), 'kwargs': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:21:01 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:21:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:21:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:21:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:01 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76d7409-f471-4f5a-a39e-9541c5dcec22]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:21:01 user nova-compute[75080]: No targets found.
Dec 05 15:21:01 user nova-compute[75080]: iSNS:
Dec 05 15:21:01 user nova-compute[75080]: No targets found.
Dec 05 15:21:01 user nova-compute[75080]: STATIC:
Dec 05 15:21:01 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9
Dec 05 15:21:01 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:21:01 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:21:01 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a
Dec 05 15:21:01 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:21:01 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:21:01 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867
Dec 05 15:21:01 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:21:01 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:21:01 user nova-compute[75080]: FIRMWARE:
Dec 05 15:21:01 user nova-compute[75080]: No targets found.
Dec 05 15:21:01 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:21:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:21:01 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:21:01 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:21:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:21:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:01 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a370688-d590-4a38-b106-3a80477de9a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:01 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3281b49-bd61-4aa3-bf9d-93ec55b2df27]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)
Dec 05 15:21:01 user nova-compute[75080]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)
Dec 05 15:21:01 user nova-compute[75080]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a (non-flash)
Dec 05 15:21:01 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:21:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 (non-flash)
Dec 05 15:21:01 user nova-compute[75080]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)
Dec 05 15:21:01 user nova-compute[75080]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a (non-flash)
Dec 05 15:21:01 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:21:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f665c344160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867'): ({'sdj'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:21:01 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Removing single pathed devices sdj {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:21:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ddb23e-18a1-485e-8f97-e64b565c8890]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4517e245-74c6-4768-a037-35926e1e828c]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:02 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Flushing IO for device /dev/sdj {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:21:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f8a3ae-6d07-4e29-83c8-ca27a048762b]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:02 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:21:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.052s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f37856-0fa7-4450-9b0a-5f417fdc11c6]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:02 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:21:02 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] SCSI volumes sdj have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:21:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:21:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7716ec6f-9348-492f-9824-17ec206a6408]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:21:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa378af7-1f54-431c-b439-c3fb5b519aed]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867, portal: 172.16.0.220,3260]
Dec 05 15:21:02 user nova-compute[75080]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867, portal: 172.16.0.220,3260] successful.
Dec 05 15:21:02 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:21:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd92e10f-dace-4099-ba5d-c7fcbe8a1867 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b42b41-afe7-48db-99a5-b30dbfb552bc]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:21:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:21:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] <== disconnect_volume: return (349ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:21:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:21:02 user nova-compute[75080]: DEBUG nova.compute.manager [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jfDBzNcE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '1830878a-71e0-48f1-85b8-9ed83b1419cd', 'attached_at': '', 'detached_at': '', 'volume_id': '22aea242-c46e-4ce0-bc46-c34a56465dd9', 'serial'} {{(pid=75080) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Dec 05 15:21:02 user nova-compute[75080]: DEBUG nova.compute.manager [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] swap_volume: removing Cinder connection for volume dd92e10f-dace-4099-ba5d-c7fcbe8a1867 {{(pid=75080) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Dec 05 15:21:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Acquiring lock "d69bc0bc-b6e8-447b-b529-54031fc78ce1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "d69bc0bc-b6e8-447b-b529-54031fc78ce1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:03 user nova-compute[75080]: DEBUG nova.objects.instance [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lazy-loading 'flavor' on Instance uuid d69bc0bc-b6e8-447b-b529-54031fc78ce1 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:21:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "d69bc0bc-b6e8-447b-b529-54031fc78ce1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Acquiring lock "d69bc0bc-b6e8-447b-b529-54031fc78ce1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "d69bc0bc-b6e8-447b-b529-54031fc78ce1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:03 user nova-compute[75080]: INFO nova.compute.manager [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Attaching volume bb9f4e6b-a6c8-4bd2-9350-7e095d54fece to /dev/vdc
Dec 05 15:21:03 user nova-compute[75080]: DEBUG os_brick.utils [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:21:03 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:03 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:03 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9430b380-776b-4fe8-8c39-30fee1061c9c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:03 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:03 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:03 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb26f38-a9af-4180-9f2e-5ee3310bffa5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:03 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:03 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:03 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93fa0cf-cf6a-4bd7-b313-3a4d868a30b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:03 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1db050-88d7-4245-8a7d-71861c949bac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:03 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:03 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:21:03 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:21:03 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:03 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:21:03 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:21:03 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d5ab1f-ea0c-4c8a-b3b0-98df142ce133]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:03 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:21:03 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:21:03 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:21:03 user nova-compute[75080]: DEBUG os_brick.utils [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:21:03 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Updating existing volume attachment record: bd8b6e1b-b886-4185-9393-b26d2d32b5b2 {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:21:06 user nova-compute[75080]: DEBUG nova.compute.manager [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] swap_volume: Updating volume dd92e10f-dace-4099-ba5d-c7fcbe8a1867 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "jfDBzNcE", "auth_password": "2kwxP4QBsdX0ah", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "22aea242-c46e-4ce0-bc46-c34a56465dd9"}, "status": "reserved", "instance": "1830878a-71e0-48f1-85b8-9ed83b1419cd", "attached_at": "", "detached_at": "", "volume_id": "22aea242-c46e-4ce0-bc46-c34a56465dd9", "serial": "22aea242-c46e-4ce0-bc46-c34a56465dd9"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '22aea242-c46e-4ce0-bc46-c34a56465dd9', 'no_device': None, 'attachment_id': '2d31093f-c03d-4d8c-a248-f91e770981ee'} {{(pid=75080) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Dec 05 15:21:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3cad678b-82d7-488e-8ffa-7c03088dd820 tempest-TestVolumeSwap-1028498059 tempest-TestVolumeSwap-1028498059-project-admin] Lock "1830878a-71e0-48f1-85b8-9ed83b1419cd" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 36.131s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:06 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:21:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Acquiring lock "30a4dd31-76bf-497e-b0d0-82bd70940e6c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "30a4dd31-76bf-497e-b0d0-82bd70940e6c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:06 user nova-compute[75080]: DEBUG nova.compute.manager [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:21:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:07 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:21:07 user nova-compute[75080]: INFO nova.compute.claims [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Claim successful on node user
Dec 05 15:21:07 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:21:07 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:21:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0283510c-734d-4d64-9bb0-32df171f6e61 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Acquiring lock "1830878a-71e0-48f1-85b8-9ed83b1419cd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0283510c-734d-4d64-9bb0-32df171f6e61 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Lock "1830878a-71e0-48f1-85b8-9ed83b1419cd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.507s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:07 user nova-compute[75080]: DEBUG nova.compute.manager [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:21:07 user nova-compute[75080]: INFO nova.compute.manager [None req-0283510c-734d-4d64-9bb0-32df171f6e61 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Detaching volume 22aea242-c46e-4ce0-bc46-c34a56465dd9
Dec 05 15:21:07 user nova-compute[75080]: DEBUG nova.compute.manager [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:21:07 user nova-compute[75080]: DEBUG nova.network.neutron [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:21:07 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:21:07 user nova-compute[75080]: INFO nova.virt.block_device [None req-0283510c-734d-4d64-9bb0-32df171f6e61 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Attempting to driver detach volume 22aea242-c46e-4ce0-bc46-c34a56465dd9 from mountpoint /dev/vdb
Dec 05 15:21:07 user nova-compute[75080]: DEBUG nova.compute.manager [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:21:07 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-0283510c-734d-4d64-9bb0-32df171f6e61 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Attempting to detach device vdb from instance 1830878a-71e0-48f1-85b8-9ed83b1419cd from the persistent domain config. {{(pid=75080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 15:21:07 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-0283510c-734d-4d64-9bb0-32df171f6e61 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:21:07 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:21:07 user nova-compute[75080]:   <source dev="/dev/sdc"/>
Dec 05 15:21:07 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:21:07 user nova-compute[75080]:   <serial>22aea242-c46e-4ce0-bc46-c34a56465dd9</serial>
Dec 05 15:21:07 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 15:21:07 user nova-compute[75080]: </disk>
Dec 05 15:21:07 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:21:07 user nova-compute[75080]: DEBUG nova.policy [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5fa6ef27452432c8c1b6d57906b9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74a9586932440678d59170e174336a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:21:07 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-0283510c-734d-4d64-9bb0-32df171f6e61 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Successfully detached device vdb from instance 1830878a-71e0-48f1-85b8-9ed83b1419cd from the persistent domain config.
Dec 05 15:21:07 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-0283510c-734d-4d64-9bb0-32df171f6e61 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1830878a-71e0-48f1-85b8-9ed83b1419cd from the live domain config. {{(pid=75080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 15:21:07 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-0283510c-734d-4d64-9bb0-32df171f6e61 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:21:07 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:21:07 user nova-compute[75080]:   <source dev="/dev/sdc"/>
Dec 05 15:21:07 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:21:07 user nova-compute[75080]:   <serial>22aea242-c46e-4ce0-bc46-c34a56465dd9</serial>
Dec 05 15:21:07 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 15:21:07 user nova-compute[75080]: </disk>
Dec 05 15:21:07 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:21:07 user nova-compute[75080]: DEBUG nova.compute.manager [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:21:07 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:21:07 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Creating image(s)
Dec 05 15:21:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Acquiring lock "/opt/stack/data/nova/instances/30a4dd31-76bf-497e-b0d0-82bd70940e6c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "/opt/stack/data/nova/instances/30a4dd31-76bf-497e-b0d0-82bd70940e6c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "/opt/stack/data/nova/instances/30a4dd31-76bf-497e-b0d0-82bd70940e6c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:07 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.184s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.203s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/30a4dd31-76bf-497e-b0d0-82bd70940e6c/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:08 user nova-compute[75080]: DEBUG nova.network.neutron [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Successfully created port: 47cfa76f-2a3d-42e2-b7e9-824651b1dfe4 {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:21:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/30a4dd31-76bf-497e-b0d0-82bd70940e6c/disk 1073741824" returned: 0 in 0.045s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-0283510c-734d-4d64-9bb0-32df171f6e61 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1830878a-71e0-48f1-85b8-9ed83b1419cd {{(pid=75080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 15:21:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.182s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:08 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Checking if we can resize image /opt/stack/data/nova/instances/30a4dd31-76bf-497e-b0d0-82bd70940e6c/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 15:21:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30a4dd31-76bf-497e-b0d0-82bd70940e6c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30a4dd31-76bf-497e-b0d0-82bd70940e6c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:08 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Cannot resize image /opt/stack/data/nova/instances/30a4dd31-76bf-497e-b0d0-82bd70940e6c/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 15:21:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:21:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Ensure instance console log exists: /opt/stack/data/nova/instances/30a4dd31-76bf-497e-b0d0-82bd70940e6c/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:21:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG nova.network.neutron [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Successfully updated port: 47cfa76f-2a3d-42e2-b7e9-824651b1dfe4 {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Acquiring lock "refresh_cache-30a4dd31-76bf-497e-b0d0-82bd70940e6c" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Acquired lock "refresh_cache-30a4dd31-76bf-497e-b0d0-82bd70940e6c" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG nova.network.neutron [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG nova.compute.manager [req-f58d1ebe-c7cd-457f-bee7-d50a72a35495 req-51f255d3-1f7e-4f70-aacf-7d462bbbb8ab service nova] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Received event network-changed-47cfa76f-2a3d-42e2-b7e9-824651b1dfe4 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG nova.compute.manager [req-f58d1ebe-c7cd-457f-bee7-d50a72a35495 req-51f255d3-1f7e-4f70-aacf-7d462bbbb8ab service nova] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Refreshing instance network info cache due to event network-changed-47cfa76f-2a3d-42e2-b7e9-824651b1dfe4. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f58d1ebe-c7cd-457f-bee7-d50a72a35495 req-51f255d3-1f7e-4f70-aacf-7d462bbbb8ab service nova] Acquiring lock "refresh_cache-30a4dd31-76bf-497e-b0d0-82bd70940e6c" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG nova.network.neutron [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e619d977-9607-43ef-9d19-6870301300d6 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Acquiring lock "31688583-6336-4e34-8df5-6947402c39ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e619d977-9607-43ef-9d19-6870301300d6 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Lock "31688583-6336-4e34-8df5-6947402c39ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e619d977-9607-43ef-9d19-6870301300d6 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Acquiring lock "31688583-6336-4e34-8df5-6947402c39ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e619d977-9607-43ef-9d19-6870301300d6 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Lock "31688583-6336-4e34-8df5-6947402c39ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e619d977-9607-43ef-9d19-6870301300d6 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Lock "31688583-6336-4e34-8df5-6947402c39ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:09 user nova-compute[75080]: INFO nova.compute.manager [None req-e619d977-9607-43ef-9d19-6870301300d6 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Terminating instance
Dec 05 15:21:09 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e619d977-9607-43ef-9d19-6870301300d6 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG nova.network.neutron [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Updating instance_info_cache with network_info: [{"id": "47cfa76f-2a3d-42e2-b7e9-824651b1dfe4", "address": "fa:16:3e:7a:09:fb", "network": {"id": "ecbc1165-663e-47ca-87c7-ecda194bb3cc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-140281562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b74a9586932440678d59170e174336a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47cfa76f-2a", "ovs_interfaceid": "47cfa76f-2a3d-42e2-b7e9-824651b1dfe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Releasing lock "refresh_cache-30a4dd31-76bf-497e-b0d0-82bd70940e6c" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG nova.compute.manager [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Instance network_info: |[{"id": "47cfa76f-2a3d-42e2-b7e9-824651b1dfe4", "address": "fa:16:3e:7a:09:fb", "network": {"id": "ecbc1165-663e-47ca-87c7-ecda194bb3cc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-140281562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b74a9586932440678d59170e174336a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47cfa76f-2a", "ovs_interfaceid": "47cfa76f-2a3d-42e2-b7e9-824651b1dfe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f58d1ebe-c7cd-457f-bee7-d50a72a35495 req-51f255d3-1f7e-4f70-aacf-7d462bbbb8ab service nova] Acquired lock "refresh_cache-30a4dd31-76bf-497e-b0d0-82bd70940e6c" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG nova.network.neutron [req-f58d1ebe-c7cd-457f-bee7-d50a72a35495 req-51f255d3-1f7e-4f70-aacf-7d462bbbb8ab service nova] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Refreshing network info cache for port 47cfa76f-2a3d-42e2-b7e9-824651b1dfe4 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Start _get_guest_xml network_info=[{"id": "47cfa76f-2a3d-42e2-b7e9-824651b1dfe4", "address": "fa:16:3e:7a:09:fb", "network": {"id": "ecbc1165-663e-47ca-87c7-ecda194bb3cc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-140281562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b74a9586932440678d59170e174336a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47cfa76f-2a", "ovs_interfaceid": "47cfa76f-2a3d-42e2-b7e9-824651b1dfe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:21:09 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:21:09 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:21:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:21:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1171516528',display_name='tempest-VolumesAdminNegativeTest-server-1171516528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1171516528',id=13,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b74a9586932440678d59170e174336a1',ramdisk_id='',reservation_id='r-7i0srliq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-98453510',owner_user_name='tempest-VolumesAdminNegativeTest-98453510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:21:08Z,user_data=None,user_id='d5fa6ef27452432c8c1b6d57906b9de2',uuid=30a4dd31-76bf-497e-b0d0-82bd70940e6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47cfa76f-2a3d-42e2-b7e9-824651b1dfe4", "address": "fa:16:3e:7a:09:fb", "network": {"id": "ecbc1165-663e-47ca-87c7-ecda194bb3cc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-140281562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b74a9586932440678d59170e174336a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47cfa76f-2a", "ovs_interfaceid": "47cfa76f-2a3d-42e2-b7e9-824651b1dfe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Converting VIF {"id": "47cfa76f-2a3d-42e2-b7e9-824651b1dfe4", "address": "fa:16:3e:7a:09:fb", "network": {"id": "ecbc1165-663e-47ca-87c7-ecda194bb3cc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-140281562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b74a9586932440678d59170e174336a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47cfa76f-2a", "ovs_interfaceid": "47cfa76f-2a3d-42e2-b7e9-824651b1dfe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:09:fb,bridge_name='br-int',has_traffic_filtering=True,id=47cfa76f-2a3d-42e2-b7e9-824651b1dfe4,network=Network(ecbc1165-663e-47ca-87c7-ecda194bb3cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47cfa76f-2a') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG nova.objects.instance [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lazy-loading 'pci_devices' on Instance uuid 30a4dd31-76bf-497e-b0d0-82bd70940e6c {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:21:09 user nova-compute[75080]:   <uuid>30a4dd31-76bf-497e-b0d0-82bd70940e6c</uuid>
Dec 05 15:21:09 user nova-compute[75080]:   <name>instance-0000000d</name>
Dec 05 15:21:09 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:21:09 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:21:09 user nova-compute[75080]:   <metadata>
Dec 05 15:21:09 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:21:09 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:21:09 user nova-compute[75080]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1171516528</nova:name>
Dec 05 15:21:09 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:21:09</nova:creationTime>
Dec 05 15:21:09 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:21:09 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:21:09 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:21:09 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:21:09 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:21:09 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:21:09 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:21:09 user nova-compute[75080]:       <nova:owner>
Dec 05 15:21:09 user nova-compute[75080]:         <nova:user uuid="d5fa6ef27452432c8c1b6d57906b9de2">tempest-VolumesAdminNegativeTest-98453510-project-member</nova:user>
Dec 05 15:21:09 user nova-compute[75080]:         <nova:project uuid="b74a9586932440678d59170e174336a1">tempest-VolumesAdminNegativeTest-98453510</nova:project>
Dec 05 15:21:09 user nova-compute[75080]:       </nova:owner>
Dec 05 15:21:09 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:21:09 user nova-compute[75080]:       <nova:ports>
Dec 05 15:21:09 user nova-compute[75080]:         <nova:port uuid="47cfa76f-2a3d-42e2-b7e9-824651b1dfe4">
Dec 05 15:21:09 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 05 15:21:09 user nova-compute[75080]:         </nova:port>
Dec 05 15:21:09 user nova-compute[75080]:       </nova:ports>
Dec 05 15:21:09 user nova-compute[75080]:     </nova:instance>
Dec 05 15:21:09 user nova-compute[75080]:   </metadata>
Dec 05 15:21:09 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:21:09 user nova-compute[75080]:     <system>
Dec 05 15:21:09 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:21:09 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:21:09 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:21:09 user nova-compute[75080]:       <entry name="serial">30a4dd31-76bf-497e-b0d0-82bd70940e6c</entry>
Dec 05 15:21:09 user nova-compute[75080]:       <entry name="uuid">30a4dd31-76bf-497e-b0d0-82bd70940e6c</entry>
Dec 05 15:21:09 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:21:09 user nova-compute[75080]:     </system>
Dec 05 15:21:09 user nova-compute[75080]:   </sysinfo>
Dec 05 15:21:09 user nova-compute[75080]:   <os>
Dec 05 15:21:09 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:21:09 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:21:09 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:21:09 user nova-compute[75080]:   </os>
Dec 05 15:21:09 user nova-compute[75080]:   <features>
Dec 05 15:21:09 user nova-compute[75080]:     <acpi/>
Dec 05 15:21:09 user nova-compute[75080]:     <apic/>
Dec 05 15:21:09 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:21:09 user nova-compute[75080]:   </features>
Dec 05 15:21:09 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:21:09 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:21:09 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:21:09 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:21:09 user nova-compute[75080]:   </clock>
Dec 05 15:21:09 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:21:09 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:21:09 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:21:09 user nova-compute[75080]:   </cpu>
Dec 05 15:21:09 user nova-compute[75080]:   <devices>
Dec 05 15:21:09 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:21:09 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:21:09 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/30a4dd31-76bf-497e-b0d0-82bd70940e6c/disk"/>
Dec 05 15:21:09 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:21:09 user nova-compute[75080]:     </disk>
Dec 05 15:21:09 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:21:09 user nova-compute[75080]:       <mac address="fa:16:3e:7a:09:fb"/>
Dec 05 15:21:09 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:21:09 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:21:09 user nova-compute[75080]:       <target dev="tap47cfa76f-2a"/>
Dec 05 15:21:09 user nova-compute[75080]:     </interface>
Dec 05 15:21:09 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:21:09 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/30a4dd31-76bf-497e-b0d0-82bd70940e6c/console.log" append="off"/>
Dec 05 15:21:09 user nova-compute[75080]:     </serial>
Dec 05 15:21:09 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:21:09 user nova-compute[75080]:     <video>
Dec 05 15:21:09 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:21:09 user nova-compute[75080]:     </video>
Dec 05 15:21:09 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:21:09 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:21:09 user nova-compute[75080]:     </rng>
Dec 05 15:21:09 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:21:09 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:21:09 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:21:09 user nova-compute[75080]:     </memballoon>
Dec 05 15:21:09 user nova-compute[75080]:   </devices>
Dec 05 15:21:09 user nova-compute[75080]: </domain>
Dec 05 15:21:09 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:21:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1171516528',display_name='tempest-VolumesAdminNegativeTest-server-1171516528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1171516528',id=13,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b74a9586932440678d59170e174336a1',ramdisk_id='',reservation_id='r-7i0srliq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-98453510',owner_user_name='tempest-VolumesAdminNegativeTest-98453510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:21:08Z,user_data=None,user_id='d5fa6ef27452432c8c1b6d57906b9de2',uuid=30a4dd31-76bf-497e-b0d0-82bd70940e6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47cfa76f-2a3d-42e2-b7e9-824651b1dfe4", "address": "fa:16:3e:7a:09:fb", "network": {"id": "ecbc1165-663e-47ca-87c7-ecda194bb3cc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-140281562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b74a9586932440678d59170e174336a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47cfa76f-2a", "ovs_interfaceid": "47cfa76f-2a3d-42e2-b7e9-824651b1dfe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Converting VIF {"id": "47cfa76f-2a3d-42e2-b7e9-824651b1dfe4", "address": "fa:16:3e:7a:09:fb", "network": {"id": "ecbc1165-663e-47ca-87c7-ecda194bb3cc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-140281562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b74a9586932440678d59170e174336a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47cfa76f-2a", "ovs_interfaceid": "47cfa76f-2a3d-42e2-b7e9-824651b1dfe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:09:fb,bridge_name='br-int',has_traffic_filtering=True,id=47cfa76f-2a3d-42e2-b7e9-824651b1dfe4,network=Network(ecbc1165-663e-47ca-87c7-ecda194bb3cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47cfa76f-2a') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG os_vif [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:09:fb,bridge_name='br-int',has_traffic_filtering=True,id=47cfa76f-2a3d-42e2-b7e9-824651b1dfe4,network=Network(ecbc1165-663e-47ca-87c7-ecda194bb3cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47cfa76f-2a') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4e8eeb81-cf48-58c5-9be0-be142aae7e1f', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47cfa76f-2a, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap47cfa76f-2a, col_values=(('qos', UUID('37f0ae83-f442-44cd-bb19-91a98a177619')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap47cfa76f-2a, col_values=(('external_ids', {'iface-id': '47cfa76f-2a3d-42e2-b7e9-824651b1dfe4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:09:fb', 'vm-uuid': '30a4dd31-76bf-497e-b0d0-82bd70940e6c'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG nova.compute.manager [req-40ba8b76-22be-4f2b-ac6f-76c04497b805 req-e6e854bc-c40b-4f24-a66e-3c7ea5b0099c service nova] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Received event network-vif-unplugged-6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-40ba8b76-22be-4f2b-ac6f-76c04497b805 req-e6e854bc-c40b-4f24-a66e-3c7ea5b0099c service nova] Acquiring lock "31688583-6336-4e34-8df5-6947402c39ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-40ba8b76-22be-4f2b-ac6f-76c04497b805 req-e6e854bc-c40b-4f24-a66e-3c7ea5b0099c service nova] Lock "31688583-6336-4e34-8df5-6947402c39ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-40ba8b76-22be-4f2b-ac6f-76c04497b805 req-e6e854bc-c40b-4f24-a66e-3c7ea5b0099c service nova] Lock "31688583-6336-4e34-8df5-6947402c39ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG nova.compute.manager [req-40ba8b76-22be-4f2b-ac6f-76c04497b805 req-e6e854bc-c40b-4f24-a66e-3c7ea5b0099c service nova] [instance: 31688583-6336-4e34-8df5-6947402c39ef] No waiting events found dispatching network-vif-unplugged-6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG nova.compute.manager [req-40ba8b76-22be-4f2b-ac6f-76c04497b805 req-e6e854bc-c40b-4f24-a66e-3c7ea5b0099c service nova] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Received event network-vif-unplugged-6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:21:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:09 user nova-compute[75080]: INFO os_vif [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:09:fb,bridge_name='br-int',has_traffic_filtering=True,id=47cfa76f-2a3d-42e2-b7e9-824651b1dfe4,network=Network(ecbc1165-663e-47ca-87c7-ecda194bb3cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47cfa76f-2a')
Dec 05 15:21:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:10 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:21:10 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] No VIF found with MAC fa:16:3e:7a:09:fb, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:21:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:10 user nova-compute[75080]: DEBUG nova.network.neutron [req-f58d1ebe-c7cd-457f-bee7-d50a72a35495 req-51f255d3-1f7e-4f70-aacf-7d462bbbb8ab service nova] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Updated VIF entry in instance network info cache for port 47cfa76f-2a3d-42e2-b7e9-824651b1dfe4. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:21:10 user nova-compute[75080]: DEBUG nova.network.neutron [req-f58d1ebe-c7cd-457f-bee7-d50a72a35495 req-51f255d3-1f7e-4f70-aacf-7d462bbbb8ab service nova] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Updating instance_info_cache with network_info: [{"id": "47cfa76f-2a3d-42e2-b7e9-824651b1dfe4", "address": "fa:16:3e:7a:09:fb", "network": {"id": "ecbc1165-663e-47ca-87c7-ecda194bb3cc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-140281562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b74a9586932440678d59170e174336a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47cfa76f-2a", "ovs_interfaceid": "47cfa76f-2a3d-42e2-b7e9-824651b1dfe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:21:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f58d1ebe-c7cd-457f-bee7-d50a72a35495 req-51f255d3-1f7e-4f70-aacf-7d462bbbb8ab service nova] Releasing lock "refresh_cache-30a4dd31-76bf-497e-b0d0-82bd70940e6c" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:21:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:10 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Instance destroyed successfully.
Dec 05 15:21:10 user nova-compute[75080]: DEBUG nova.objects.instance [None req-e619d977-9607-43ef-9d19-6870301300d6 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Lazy-loading 'resources' on Instance uuid 31688583-6336-4e34-8df5-6947402c39ef {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:21:10 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-e619d977-9607-43ef-9d19-6870301300d6 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:19:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1021807627',display_name='tempest-ServersNegativeTestJSON-server-1021807627',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1021807627',id=12,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:19:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48e73fbf2c414f32bcdeef4bae598b2f',ramdisk_id='',reservation_id='r-px5xgc0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-32084328',owner_user_name='tempest-ServersNegativeTestJSON-32084328-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:19:27Z,user_data=None,user_id='e06d18d33aaa442dba24fbd214a49f9d',uuid=31688583-6336-4e34-8df5-6947402c39ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b", "address": "fa:16:3e:bb:85:d6", "network": {"id": "05b09885-a021-44b4-b8d6-1504a4c2dfeb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1903039338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e73fbf2c414f32bcdeef4bae598b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d3a7f08-5f", "ovs_interfaceid": "6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:21:10 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-e619d977-9607-43ef-9d19-6870301300d6 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Converting VIF {"id": "6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b", "address": "fa:16:3e:bb:85:d6", "network": {"id": "05b09885-a021-44b4-b8d6-1504a4c2dfeb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1903039338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e73fbf2c414f32bcdeef4bae598b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d3a7f08-5f", "ovs_interfaceid": "6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:21:10 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-e619d977-9607-43ef-9d19-6870301300d6 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:85:d6,bridge_name='br-int',has_traffic_filtering=True,id=6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b,network=Network(05b09885-a021-44b4-b8d6-1504a4c2dfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d3a7f08-5f') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:21:10 user nova-compute[75080]: DEBUG os_vif [None req-e619d977-9607-43ef-9d19-6870301300d6 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:85:d6,bridge_name='br-int',has_traffic_filtering=True,id=6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b,network=Network(05b09885-a021-44b4-b8d6-1504a4c2dfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d3a7f08-5f') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:21:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d3a7f08-5f, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:21:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:21:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6188aeb6-606d-4c1a-ae13-cc4d6392d235) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:21:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:21:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:10 user nova-compute[75080]: INFO os_vif [None req-e619d977-9607-43ef-9d19-6870301300d6 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:85:d6,bridge_name='br-int',has_traffic_filtering=True,id=6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b,network=Network(05b09885-a021-44b4-b8d6-1504a4c2dfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d3a7f08-5f')
Dec 05 15:21:10 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-e619d977-9607-43ef-9d19-6870301300d6 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Deleting instance files /opt/stack/data/nova/instances/31688583-6336-4e34-8df5-6947402c39ef_del
Dec 05 15:21:10 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-e619d977-9607-43ef-9d19-6870301300d6 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Deletion of /opt/stack/data/nova/instances/31688583-6336-4e34-8df5-6947402c39ef_del complete
Dec 05 15:21:10 user nova-compute[75080]: INFO nova.compute.manager [None req-e619d977-9607-43ef-9d19-6870301300d6 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Took 1.09 seconds to destroy the instance on the hypervisor.
Dec 05 15:21:10 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-e619d977-9607-43ef-9d19-6870301300d6 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:21:10 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:21:10 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 31688583-6336-4e34-8df5-6947402c39ef] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:21:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:11 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:21:11 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Took 0.55 seconds to deallocate network for instance.
Dec 05 15:21:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e619d977-9607-43ef-9d19-6870301300d6 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e619d977-9607-43ef-9d19-6870301300d6 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:11 user nova-compute[75080]: DEBUG nova.compute.manager [req-a03556b6-117f-458d-9472-efac9d6c6483 req-7473ce74-2e13-4c2b-a36b-2445af62e41a service nova] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Received event network-vif-deleted-6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:21:11 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:11 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:11 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:11 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:11 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-e619d977-9607-43ef-9d19-6870301300d6 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:21:11 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-e619d977-9607-43ef-9d19-6870301300d6 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:21:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e619d977-9607-43ef-9d19-6870301300d6 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:11 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-e619d977-9607-43ef-9d19-6870301300d6 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Deleted allocations for instance 31688583-6336-4e34-8df5-6947402c39ef
Dec 05 15:21:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e619d977-9607-43ef-9d19-6870301300d6 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Lock "31688583-6336-4e34-8df5-6947402c39ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.237s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:11 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:12 user nova-compute[75080]: DEBUG nova.compute.manager [req-de72e3e5-1758-47f5-8965-11b730e068af req-51cbaa67-46e7-41e1-99eb-b219a3202124 service nova] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Received event network-vif-plugged-6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-de72e3e5-1758-47f5-8965-11b730e068af req-51cbaa67-46e7-41e1-99eb-b219a3202124 service nova] Acquiring lock "31688583-6336-4e34-8df5-6947402c39ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-de72e3e5-1758-47f5-8965-11b730e068af req-51cbaa67-46e7-41e1-99eb-b219a3202124 service nova] Lock "31688583-6336-4e34-8df5-6947402c39ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-de72e3e5-1758-47f5-8965-11b730e068af req-51cbaa67-46e7-41e1-99eb-b219a3202124 service nova] Lock "31688583-6336-4e34-8df5-6947402c39ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:12 user nova-compute[75080]: DEBUG nova.compute.manager [req-de72e3e5-1758-47f5-8965-11b730e068af req-51cbaa67-46e7-41e1-99eb-b219a3202124 service nova] [instance: 31688583-6336-4e34-8df5-6947402c39ef] No waiting events found dispatching network-vif-plugged-6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:21:12 user nova-compute[75080]: WARNING nova.compute.manager [req-de72e3e5-1758-47f5-8965-11b730e068af req-51cbaa67-46e7-41e1-99eb-b219a3202124 service nova] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Received unexpected event network-vif-plugged-6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b for instance with vm_state deleted and task_state None.
Dec 05 15:21:12 user nova-compute[75080]: DEBUG nova.compute.manager [req-de72e3e5-1758-47f5-8965-11b730e068af req-51cbaa67-46e7-41e1-99eb-b219a3202124 service nova] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Received event network-vif-plugged-6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-de72e3e5-1758-47f5-8965-11b730e068af req-51cbaa67-46e7-41e1-99eb-b219a3202124 service nova] Acquiring lock "31688583-6336-4e34-8df5-6947402c39ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-de72e3e5-1758-47f5-8965-11b730e068af req-51cbaa67-46e7-41e1-99eb-b219a3202124 service nova] Lock "31688583-6336-4e34-8df5-6947402c39ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-de72e3e5-1758-47f5-8965-11b730e068af req-51cbaa67-46e7-41e1-99eb-b219a3202124 service nova] Lock "31688583-6336-4e34-8df5-6947402c39ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:12 user nova-compute[75080]: DEBUG nova.compute.manager [req-de72e3e5-1758-47f5-8965-11b730e068af req-51cbaa67-46e7-41e1-99eb-b219a3202124 service nova] [instance: 31688583-6336-4e34-8df5-6947402c39ef] No waiting events found dispatching network-vif-plugged-6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:21:12 user nova-compute[75080]: WARNING nova.compute.manager [req-de72e3e5-1758-47f5-8965-11b730e068af req-51cbaa67-46e7-41e1-99eb-b219a3202124 service nova] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Received unexpected event network-vif-plugged-6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b for instance with vm_state deleted and task_state None.
Dec 05 15:21:12 user nova-compute[75080]: DEBUG nova.compute.manager [req-de72e3e5-1758-47f5-8965-11b730e068af req-51cbaa67-46e7-41e1-99eb-b219a3202124 service nova] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Received event network-vif-plugged-6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-de72e3e5-1758-47f5-8965-11b730e068af req-51cbaa67-46e7-41e1-99eb-b219a3202124 service nova] Acquiring lock "31688583-6336-4e34-8df5-6947402c39ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-de72e3e5-1758-47f5-8965-11b730e068af req-51cbaa67-46e7-41e1-99eb-b219a3202124 service nova] Lock "31688583-6336-4e34-8df5-6947402c39ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-de72e3e5-1758-47f5-8965-11b730e068af req-51cbaa67-46e7-41e1-99eb-b219a3202124 service nova] Lock "31688583-6336-4e34-8df5-6947402c39ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:12 user nova-compute[75080]: DEBUG nova.compute.manager [req-de72e3e5-1758-47f5-8965-11b730e068af req-51cbaa67-46e7-41e1-99eb-b219a3202124 service nova] [instance: 31688583-6336-4e34-8df5-6947402c39ef] No waiting events found dispatching network-vif-plugged-6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:21:12 user nova-compute[75080]: WARNING nova.compute.manager [req-de72e3e5-1758-47f5-8965-11b730e068af req-51cbaa67-46e7-41e1-99eb-b219a3202124 service nova] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Received unexpected event network-vif-plugged-6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b for instance with vm_state deleted and task_state None.
Dec 05 15:21:12 user nova-compute[75080]: DEBUG nova.compute.manager [req-de72e3e5-1758-47f5-8965-11b730e068af req-51cbaa67-46e7-41e1-99eb-b219a3202124 service nova] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Received event network-vif-unplugged-6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-de72e3e5-1758-47f5-8965-11b730e068af req-51cbaa67-46e7-41e1-99eb-b219a3202124 service nova] Acquiring lock "31688583-6336-4e34-8df5-6947402c39ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-de72e3e5-1758-47f5-8965-11b730e068af req-51cbaa67-46e7-41e1-99eb-b219a3202124 service nova] Lock "31688583-6336-4e34-8df5-6947402c39ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-de72e3e5-1758-47f5-8965-11b730e068af req-51cbaa67-46e7-41e1-99eb-b219a3202124 service nova] Lock "31688583-6336-4e34-8df5-6947402c39ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:12 user nova-compute[75080]: DEBUG nova.compute.manager [req-de72e3e5-1758-47f5-8965-11b730e068af req-51cbaa67-46e7-41e1-99eb-b219a3202124 service nova] [instance: 31688583-6336-4e34-8df5-6947402c39ef] No waiting events found dispatching network-vif-unplugged-6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:21:12 user nova-compute[75080]: WARNING nova.compute.manager [req-de72e3e5-1758-47f5-8965-11b730e068af req-51cbaa67-46e7-41e1-99eb-b219a3202124 service nova] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Received unexpected event network-vif-unplugged-6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b for instance with vm_state deleted and task_state None.
Dec 05 15:21:12 user nova-compute[75080]: DEBUG nova.compute.manager [req-de72e3e5-1758-47f5-8965-11b730e068af req-51cbaa67-46e7-41e1-99eb-b219a3202124 service nova] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Received event network-vif-plugged-6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-de72e3e5-1758-47f5-8965-11b730e068af req-51cbaa67-46e7-41e1-99eb-b219a3202124 service nova] Acquiring lock "31688583-6336-4e34-8df5-6947402c39ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-de72e3e5-1758-47f5-8965-11b730e068af req-51cbaa67-46e7-41e1-99eb-b219a3202124 service nova] Lock "31688583-6336-4e34-8df5-6947402c39ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-de72e3e5-1758-47f5-8965-11b730e068af req-51cbaa67-46e7-41e1-99eb-b219a3202124 service nova] Lock "31688583-6336-4e34-8df5-6947402c39ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:12 user nova-compute[75080]: DEBUG nova.compute.manager [req-de72e3e5-1758-47f5-8965-11b730e068af req-51cbaa67-46e7-41e1-99eb-b219a3202124 service nova] [instance: 31688583-6336-4e34-8df5-6947402c39ef] No waiting events found dispatching network-vif-plugged-6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:21:12 user nova-compute[75080]: WARNING nova.compute.manager [req-de72e3e5-1758-47f5-8965-11b730e068af req-51cbaa67-46e7-41e1-99eb-b219a3202124 service nova] [instance: 31688583-6336-4e34-8df5-6947402c39ef] Received unexpected event network-vif-plugged-6d3a7f08-5ff0-4fa2-bd67-48c546c2ad2b for instance with vm_state deleted and task_state None.
Dec 05 15:21:12 user nova-compute[75080]: DEBUG nova.compute.manager [req-de72e3e5-1758-47f5-8965-11b730e068af req-51cbaa67-46e7-41e1-99eb-b219a3202124 service nova] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Received event network-vif-plugged-47cfa76f-2a3d-42e2-b7e9-824651b1dfe4 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-de72e3e5-1758-47f5-8965-11b730e068af req-51cbaa67-46e7-41e1-99eb-b219a3202124 service nova] Acquiring lock "30a4dd31-76bf-497e-b0d0-82bd70940e6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-de72e3e5-1758-47f5-8965-11b730e068af req-51cbaa67-46e7-41e1-99eb-b219a3202124 service nova] Lock "30a4dd31-76bf-497e-b0d0-82bd70940e6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-de72e3e5-1758-47f5-8965-11b730e068af req-51cbaa67-46e7-41e1-99eb-b219a3202124 service nova] Lock "30a4dd31-76bf-497e-b0d0-82bd70940e6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:12 user nova-compute[75080]: DEBUG nova.compute.manager [req-de72e3e5-1758-47f5-8965-11b730e068af req-51cbaa67-46e7-41e1-99eb-b219a3202124 service nova] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] No waiting events found dispatching network-vif-plugged-47cfa76f-2a3d-42e2-b7e9-824651b1dfe4 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:21:12 user nova-compute[75080]: WARNING nova.compute.manager [req-de72e3e5-1758-47f5-8965-11b730e068af req-51cbaa67-46e7-41e1-99eb-b219a3202124 service nova] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Received unexpected event network-vif-plugged-47cfa76f-2a3d-42e2-b7e9-824651b1dfe4 for instance with vm_state building and task_state spawning.
Dec 05 15:21:13 user nova-compute[75080]: DEBUG nova.compute.manager [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:21:13 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:21:13 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Instance spawned successfully.
Dec 05 15:21:13 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:21:13 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:21:13 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:21:13 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:21:13 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:21:13 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:21:13 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG nova.compute.manager [req-78478b17-83a2-43b4-8175-601e96bff520 req-61666e5e-f690-40c2-8e02-ad8412f1878d service nova] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Received event network-vif-plugged-47cfa76f-2a3d-42e2-b7e9-824651b1dfe4 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-78478b17-83a2-43b4-8175-601e96bff520 req-61666e5e-f690-40c2-8e02-ad8412f1878d service nova] Acquiring lock "30a4dd31-76bf-497e-b0d0-82bd70940e6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-78478b17-83a2-43b4-8175-601e96bff520 req-61666e5e-f690-40c2-8e02-ad8412f1878d service nova] Lock "30a4dd31-76bf-497e-b0d0-82bd70940e6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-78478b17-83a2-43b4-8175-601e96bff520 req-61666e5e-f690-40c2-8e02-ad8412f1878d service nova] Lock "30a4dd31-76bf-497e-b0d0-82bd70940e6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG nova.compute.manager [req-78478b17-83a2-43b4-8175-601e96bff520 req-61666e5e-f690-40c2-8e02-ad8412f1878d service nova] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] No waiting events found dispatching network-vif-plugged-47cfa76f-2a3d-42e2-b7e9-824651b1dfe4 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:21:14 user nova-compute[75080]: WARNING nova.compute.manager [req-78478b17-83a2-43b4-8175-601e96bff520 req-61666e5e-f690-40c2-8e02-ad8412f1878d service nova] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Received unexpected event network-vif-plugged-47cfa76f-2a3d-42e2-b7e9-824651b1dfe4 for instance with vm_state building and task_state spawning.
Dec 05 15:21:14 user nova-compute[75080]: INFO nova.compute.manager [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Took 6.41 seconds to spawn the instance on the hypervisor.
Dec 05 15:21:14 user nova-compute[75080]: DEBUG nova.compute.manager [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:21:14 user nova-compute[75080]: INFO nova.compute.manager [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Took 7.40 seconds to build instance.
Dec 05 15:21:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b15dde3b-b2b0-4a22-90c7-d0a1222f82e9 tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "30a4dd31-76bf-497e-b0d0-82bd70940e6c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.506s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JgfABlYZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:21:14 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:21:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:21:14 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:21:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:21:14 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:21:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6044ae13-a070-40ee-99ee-e2ab97b3bad9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:21:14 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[43008a00-4d53-4442-854f-424195da730d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece] added
Dec 05 15:21:14 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7c713d-228e-4b7b-80dd-7f018a96306b]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[808473a8-1702-480a-af4e-dd52664255b2]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JgfABlYZ {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JgfABlYZ" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ef8e90-4dee-4ed7-964e-44cc5d359a7b]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JgfABlYZ'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d671bc-a3b6-4d28-886c-8dc6f12ba514]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[664cb150-617f-4148-b161-43ab7f9c6b68]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)
Dec 05 15:21:14 user nova-compute[75080]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a (non-flash)
Dec 05 15:21:14 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)
Dec 05 15:21:14 user nova-compute[75080]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a (non-flash)
Dec 05 15:21:14 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0dabfe-78b8-4b3e-8d64-b9db2c66c9ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece, portal: 172.16.0.220,3260]
Dec 05 15:21:14 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece, portal: 172.16.0.220,3260] successful.
Dec 05 15:21:14 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfbd3d2-ad2a-4127-b315-585572a9a55f]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc13138-2ec3-43ad-ae45-b531283ed8ba]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)
Dec 05 15:21:14 user nova-compute[75080]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a (non-flash)
Dec 05 15:21:14 user nova-compute[75080]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece (non-flash)
Dec 05 15:21:14 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)
Dec 05 15:21:14 user nova-compute[75080]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a (non-flash)
Dec 05 15:21:14 user nova-compute[75080]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece (non-flash)
Dec 05 15:21:14 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:21:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:15 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41db0d9-8551-454b-bc04-bca21404f07f]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:15 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:21:15 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JgfABlYZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:21:15 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:21:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '26662393930616463', 'path': '/dev/sdb'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:21:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662393930616463', 'path': '/dev/sdb'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:21:16 user nova-compute[75080]: DEBUG nova.objects.instance [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lazy-loading 'flavor' on Instance uuid d69bc0bc-b6e8-447b-b529-54031fc78ce1 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:21:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 15:21:16 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:21:16 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 15:21:16 user nova-compute[75080]:   <target dev="vdc" bus="virtio"/>
Dec 05 15:21:16 user nova-compute[75080]:   <serial>bb9f4e6b-a6c8-4bd2-9350-7e095d54fece</serial>
Dec 05 15:21:16 user nova-compute[75080]: </disk>
Dec 05 15:21:16 user nova-compute[75080]:  {{(pid=75080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 15:21:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:21:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:21:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:21:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] No VIF found with MAC fa:16:3e:b4:f4:d6, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:21:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1d9efc50-4d8d-47db-9215-5e8e81ebee9a tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "d69bc0bc-b6e8-447b-b529-54031fc78ce1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.316s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ace46e9b-d9f1-4e95-ad0a-48f826e72c9b tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Acquiring lock "d69bc0bc-b6e8-447b-b529-54031fc78ce1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ace46e9b-d9f1-4e95-ad0a-48f826e72c9b tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "d69bc0bc-b6e8-447b-b529-54031fc78ce1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:17 user nova-compute[75080]: INFO nova.compute.manager [None req-ace46e9b-d9f1-4e95-ad0a-48f826e72c9b tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Detaching volume bb9f4e6b-a6c8-4bd2-9350-7e095d54fece
Dec 05 15:21:17 user nova-compute[75080]: INFO nova.virt.block_device [None req-ace46e9b-d9f1-4e95-ad0a-48f826e72c9b tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Attempting to driver detach volume bb9f4e6b-a6c8-4bd2-9350-7e095d54fece from mountpoint /dev/vdc
Dec 05 15:21:17 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ace46e9b-d9f1-4e95-ad0a-48f826e72c9b tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Attempting to detach device vdc from instance d69bc0bc-b6e8-447b-b529-54031fc78ce1 from the persistent domain config. {{(pid=75080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 15:21:17 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-ace46e9b-d9f1-4e95-ad0a-48f826e72c9b tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:21:17 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:21:17 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 15:21:17 user nova-compute[75080]:   <target dev="vdc" bus="virtio"/>
Dec 05 15:21:17 user nova-compute[75080]:   <serial>bb9f4e6b-a6c8-4bd2-9350-7e095d54fece</serial>
Dec 05 15:21:17 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 05 15:21:17 user nova-compute[75080]: </disk>
Dec 05 15:21:17 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:21:17 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-ace46e9b-d9f1-4e95-ad0a-48f826e72c9b tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Successfully detached device vdc from instance d69bc0bc-b6e8-447b-b529-54031fc78ce1 from the persistent domain config.
Dec 05 15:21:17 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ace46e9b-d9f1-4e95-ad0a-48f826e72c9b tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance d69bc0bc-b6e8-447b-b529-54031fc78ce1 from the live domain config. {{(pid=75080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 15:21:17 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-ace46e9b-d9f1-4e95-ad0a-48f826e72c9b tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:21:17 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:21:17 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 15:21:17 user nova-compute[75080]:   <target dev="vdc" bus="virtio"/>
Dec 05 15:21:17 user nova-compute[75080]:   <serial>bb9f4e6b-a6c8-4bd2-9350-7e095d54fece</serial>
Dec 05 15:21:17 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 05 15:21:17 user nova-compute[75080]: </disk>
Dec 05 15:21:17 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:21:18 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ace46e9b-d9f1-4e95-ad0a-48f826e72c9b tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance d69bc0bc-b6e8-447b-b529-54031fc78ce1 {{(pid=75080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 15:21:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:21:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "5e29bda9-f1d6-4951-9343-f189934a8a23" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "5e29bda9-f1d6-4951-9343-f189934a8a23" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:22 user nova-compute[75080]: DEBUG nova.compute.manager [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:21:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:22 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:21:22 user nova-compute[75080]: INFO nova.compute.claims [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Claim successful on node user
Dec 05 15:21:23 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:21:23 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:21:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.383s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:23 user nova-compute[75080]: DEBUG nova.compute.manager [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:21:23 user nova-compute[75080]: DEBUG nova.compute.manager [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:21:23 user nova-compute[75080]: DEBUG nova.network.neutron [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:21:23 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:21:23 user nova-compute[75080]: DEBUG nova.compute.manager [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:21:23 user nova-compute[75080]: DEBUG nova.policy [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8e99cb2f1c4541fd9a656e038f4afac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f49255d5b74f448dc941027afbf84a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:21:23 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:21:23 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:21:23 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:21:23 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:21:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:23 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:21:23 user nova-compute[75080]: DEBUG nova.compute.manager [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:21:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:21:23 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Creating image(s)
Dec 05 15:21:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "/opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "/opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.176s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.184s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk 1073741824" returned: 0 in 0.048s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.184s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:24 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 15:21:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:24 user nova-compute[75080]: DEBUG nova.network.neutron [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Successfully created port: fb2619ea-ffe7-4d82-9b44-984ee393620c {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:21:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33078a88-4858-4c6b-bfa9-c3d9b83cf78b/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:24 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Cannot resize image /opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 15:21:24 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:21:24 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Ensure instance console log exists: /opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:21:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33078a88-4858-4c6b-bfa9-c3d9b83cf78b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33078a88-4858-4c6b-bfa9-c3d9b83cf78b/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33078a88-4858-4c6b-bfa9-c3d9b83cf78b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:24 user nova-compute[75080]: DEBUG nova.network.neutron [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Successfully updated port: fb2619ea-ffe7-4d82-9b44-984ee393620c {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:21:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "refresh_cache-5e29bda9-f1d6-4951-9343-f189934a8a23" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:21:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquired lock "refresh_cache-5e29bda9-f1d6-4951-9343-f189934a8a23" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:21:24 user nova-compute[75080]: DEBUG nova.network.neutron [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG nova.compute.manager [req-e6903f5c-152e-4ef2-877b-8ee7173ea4c7 req-fed50a4d-e1a0-41d3-a881-06f7b85584be service nova] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Received event network-changed-fb2619ea-ffe7-4d82-9b44-984ee393620c {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG nova.compute.manager [req-e6903f5c-152e-4ef2-877b-8ee7173ea4c7 req-fed50a4d-e1a0-41d3-a881-06f7b85584be service nova] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Refreshing instance network info cache due to event network-changed-fb2619ea-ffe7-4d82-9b44-984ee393620c. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-e6903f5c-152e-4ef2-877b-8ee7173ea4c7 req-fed50a4d-e1a0-41d3-a881-06f7b85584be service nova] Acquiring lock "refresh_cache-5e29bda9-f1d6-4951-9343-f189934a8a23" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG nova.network.neutron [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ad9e24c2-f432-4acc-a5a5-4606dde0e93c tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Acquiring lock "0259351f-617f-47be-bfb6-2fef1c35bf15" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ad9e24c2-f432-4acc-a5a5-4606dde0e93c tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lock "0259351f-617f-47be-bfb6-2fef1c35bf15" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ad9e24c2-f432-4acc-a5a5-4606dde0e93c tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Acquiring lock "0259351f-617f-47be-bfb6-2fef1c35bf15-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ad9e24c2-f432-4acc-a5a5-4606dde0e93c tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lock "0259351f-617f-47be-bfb6-2fef1c35bf15-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ad9e24c2-f432-4acc-a5a5-4606dde0e93c tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lock "0259351f-617f-47be-bfb6-2fef1c35bf15-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:25 user nova-compute[75080]: INFO nova.compute.manager [None req-ad9e24c2-f432-4acc-a5a5-4606dde0e93c tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Terminating instance
Dec 05 15:21:25 user nova-compute[75080]: DEBUG nova.compute.manager [None req-ad9e24c2-f432-4acc-a5a5-4606dde0e93c tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG nova.network.neutron [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Updating instance_info_cache with network_info: [{"id": "fb2619ea-ffe7-4d82-9b44-984ee393620c", "address": "fa:16:3e:4b:c9:8b", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb2619ea-ff", "ovs_interfaceid": "fb2619ea-ffe7-4d82-9b44-984ee393620c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Releasing lock "refresh_cache-5e29bda9-f1d6-4951-9343-f189934a8a23" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG nova.compute.manager [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Instance network_info: |[{"id": "fb2619ea-ffe7-4d82-9b44-984ee393620c", "address": "fa:16:3e:4b:c9:8b", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb2619ea-ff", "ovs_interfaceid": "fb2619ea-ffe7-4d82-9b44-984ee393620c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-e6903f5c-152e-4ef2-877b-8ee7173ea4c7 req-fed50a4d-e1a0-41d3-a881-06f7b85584be service nova] Acquired lock "refresh_cache-5e29bda9-f1d6-4951-9343-f189934a8a23" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG nova.network.neutron [req-e6903f5c-152e-4ef2-877b-8ee7173ea4c7 req-fed50a4d-e1a0-41d3-a881-06f7b85584be service nova] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Refreshing network info cache for port fb2619ea-ffe7-4d82-9b44-984ee393620c {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Start _get_guest_xml network_info=[{"id": "fb2619ea-ffe7-4d82-9b44-984ee393620c", "address": "fa:16:3e:4b:c9:8b", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb2619ea-ff", "ovs_interfaceid": "fb2619ea-ffe7-4d82-9b44-984ee393620c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:21:25 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:21:25 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:21:25 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:21:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1999463025',display_name='tempest-tempest.common.compute-instance-1999463025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1999463025',id=14,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvWGadIJzQhPYzEMGopP5ED52Y6Gi9xcl1Gk9R/9FWs4vsKHHKulX+a7vugCHkAURz4pQ6pvg505Y+Ts3LLi3NJ3+G0dMmP1DiJTl+hCPVyGkJWdfTJyUNAnDxFiveANg==',key_name='tempest-keypair-1591259108',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50f49255d5b74f448dc941027afbf84a',ramdisk_id='',reservation_id='r-qiq2etb6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-393209338',owner_user_name='tempest-ServerActionsTestOtherA-393209338-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:21:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e99cb2f1c4541fd9a656e038f4afac3',uuid=5e29bda9-f1d6-4951-9343-f189934a8a23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb2619ea-ffe7-4d82-9b44-984ee393620c", "address": "fa:16:3e:4b:c9:8b", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb2619ea-ff", "ovs_interfaceid": "fb2619ea-ffe7-4d82-9b44-984ee393620c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Converting VIF {"id": "fb2619ea-ffe7-4d82-9b44-984ee393620c", "address": "fa:16:3e:4b:c9:8b", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb2619ea-ff", "ovs_interfaceid": "fb2619ea-ffe7-4d82-9b44-984ee393620c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:c9:8b,bridge_name='br-int',has_traffic_filtering=True,id=fb2619ea-ffe7-4d82-9b44-984ee393620c,network=Network(efba4a7e-3a56-41d2-8af7-4c064ba641fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb2619ea-ff') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG nova.objects.instance [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e29bda9-f1d6-4951-9343-f189934a8a23 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:21:25 user nova-compute[75080]:   <uuid>5e29bda9-f1d6-4951-9343-f189934a8a23</uuid>
Dec 05 15:21:25 user nova-compute[75080]:   <name>instance-0000000e</name>
Dec 05 15:21:25 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:21:25 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:21:25 user nova-compute[75080]:   <metadata>
Dec 05 15:21:25 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:21:25 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:21:25 user nova-compute[75080]:       <nova:name>tempest-tempest.common.compute-instance-1999463025</nova:name>
Dec 05 15:21:25 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:21:25</nova:creationTime>
Dec 05 15:21:25 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:21:25 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:21:25 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:21:25 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:21:25 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:21:25 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:21:25 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:21:25 user nova-compute[75080]:       <nova:owner>
Dec 05 15:21:25 user nova-compute[75080]:         <nova:user uuid="8e99cb2f1c4541fd9a656e038f4afac3">tempest-ServerActionsTestOtherA-393209338-project-member</nova:user>
Dec 05 15:21:25 user nova-compute[75080]:         <nova:project uuid="50f49255d5b74f448dc941027afbf84a">tempest-ServerActionsTestOtherA-393209338</nova:project>
Dec 05 15:21:25 user nova-compute[75080]:       </nova:owner>
Dec 05 15:21:25 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:21:25 user nova-compute[75080]:       <nova:ports>
Dec 05 15:21:25 user nova-compute[75080]:         <nova:port uuid="fb2619ea-ffe7-4d82-9b44-984ee393620c">
Dec 05 15:21:25 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 05 15:21:25 user nova-compute[75080]:         </nova:port>
Dec 05 15:21:25 user nova-compute[75080]:       </nova:ports>
Dec 05 15:21:25 user nova-compute[75080]:     </nova:instance>
Dec 05 15:21:25 user nova-compute[75080]:   </metadata>
Dec 05 15:21:25 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:21:25 user nova-compute[75080]:     <system>
Dec 05 15:21:25 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:21:25 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:21:25 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:21:25 user nova-compute[75080]:       <entry name="serial">5e29bda9-f1d6-4951-9343-f189934a8a23</entry>
Dec 05 15:21:25 user nova-compute[75080]:       <entry name="uuid">5e29bda9-f1d6-4951-9343-f189934a8a23</entry>
Dec 05 15:21:25 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:21:25 user nova-compute[75080]:     </system>
Dec 05 15:21:25 user nova-compute[75080]:   </sysinfo>
Dec 05 15:21:25 user nova-compute[75080]:   <os>
Dec 05 15:21:25 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:21:25 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:21:25 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:21:25 user nova-compute[75080]:   </os>
Dec 05 15:21:25 user nova-compute[75080]:   <features>
Dec 05 15:21:25 user nova-compute[75080]:     <acpi/>
Dec 05 15:21:25 user nova-compute[75080]:     <apic/>
Dec 05 15:21:25 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:21:25 user nova-compute[75080]:   </features>
Dec 05 15:21:25 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:21:25 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:21:25 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:21:25 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:21:25 user nova-compute[75080]:   </clock>
Dec 05 15:21:25 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:21:25 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:21:25 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:21:25 user nova-compute[75080]:   </cpu>
Dec 05 15:21:25 user nova-compute[75080]:   <devices>
Dec 05 15:21:25 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:21:25 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:21:25 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk"/>
Dec 05 15:21:25 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:21:25 user nova-compute[75080]:     </disk>
Dec 05 15:21:25 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:21:25 user nova-compute[75080]:       <mac address="fa:16:3e:4b:c9:8b"/>
Dec 05 15:21:25 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:21:25 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:21:25 user nova-compute[75080]:       <target dev="tapfb2619ea-ff"/>
Dec 05 15:21:25 user nova-compute[75080]:     </interface>
Dec 05 15:21:25 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:21:25 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/console.log" append="off"/>
Dec 05 15:21:25 user nova-compute[75080]:     </serial>
Dec 05 15:21:25 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:21:25 user nova-compute[75080]:     <video>
Dec 05 15:21:25 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:21:25 user nova-compute[75080]:     </video>
Dec 05 15:21:25 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:21:25 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:21:25 user nova-compute[75080]:     </rng>
Dec 05 15:21:25 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:21:25 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:21:25 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:21:25 user nova-compute[75080]:     </memballoon>
Dec 05 15:21:25 user nova-compute[75080]:   </devices>
Dec 05 15:21:25 user nova-compute[75080]: </domain>
Dec 05 15:21:25 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:21:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1999463025',display_name='tempest-tempest.common.compute-instance-1999463025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1999463025',id=14,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvWGadIJzQhPYzEMGopP5ED52Y6Gi9xcl1Gk9R/9FWs4vsKHHKulX+a7vugCHkAURz4pQ6pvg505Y+Ts3LLi3NJ3+G0dMmP1DiJTl+hCPVyGkJWdfTJyUNAnDxFiveANg==',key_name='tempest-keypair-1591259108',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50f49255d5b74f448dc941027afbf84a',ramdisk_id='',reservation_id='r-qiq2etb6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-393209338',owner_user_name='tempest-ServerActionsTestOtherA-393209338-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:21:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e99cb2f1c4541fd9a656e038f4afac3',uuid=5e29bda9-f1d6-4951-9343-f189934a8a23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb2619ea-ffe7-4d82-9b44-984ee393620c", "address": "fa:16:3e:4b:c9:8b", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb2619ea-ff", "ovs_interfaceid": "fb2619ea-ffe7-4d82-9b44-984ee393620c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Converting VIF {"id": "fb2619ea-ffe7-4d82-9b44-984ee393620c", "address": "fa:16:3e:4b:c9:8b", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb2619ea-ff", "ovs_interfaceid": "fb2619ea-ffe7-4d82-9b44-984ee393620c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:c9:8b,bridge_name='br-int',has_traffic_filtering=True,id=fb2619ea-ffe7-4d82-9b44-984ee393620c,network=Network(efba4a7e-3a56-41d2-8af7-4c064ba641fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb2619ea-ff') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG os_vif [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:c9:8b,bridge_name='br-int',has_traffic_filtering=True,id=fb2619ea-ffe7-4d82-9b44-984ee393620c,network=Network(efba4a7e-3a56-41d2-8af7-4c064ba641fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb2619ea-ff') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c9c1860c-6003-528f-98b6-1cbeb08fc0cf', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb2619ea-ff, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb2619ea-ff, col_values=(('qos', UUID('063bb14f-c0c0-4038-9e4e-d07b94a6809d')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb2619ea-ff, col_values=(('external_ids', {'iface-id': 'fb2619ea-ffe7-4d82-9b44-984ee393620c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:c9:8b', 'vm-uuid': '5e29bda9-f1d6-4951-9343-f189934a8a23'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG nova.compute.manager [req-1a8a6331-1c89-4b4f-bf0b-b9eac5c3a0f6 req-25806c00-8f2e-480b-ab56-d13ae8ea9c8b service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Received event network-vif-unplugged-3e2379bd-6e97-45dc-917b-e8e4478a3be0 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-1a8a6331-1c89-4b4f-bf0b-b9eac5c3a0f6 req-25806c00-8f2e-480b-ab56-d13ae8ea9c8b service nova] Acquiring lock "0259351f-617f-47be-bfb6-2fef1c35bf15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-1a8a6331-1c89-4b4f-bf0b-b9eac5c3a0f6 req-25806c00-8f2e-480b-ab56-d13ae8ea9c8b service nova] Lock "0259351f-617f-47be-bfb6-2fef1c35bf15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-1a8a6331-1c89-4b4f-bf0b-b9eac5c3a0f6 req-25806c00-8f2e-480b-ab56-d13ae8ea9c8b service nova] Lock "0259351f-617f-47be-bfb6-2fef1c35bf15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG nova.compute.manager [req-1a8a6331-1c89-4b4f-bf0b-b9eac5c3a0f6 req-25806c00-8f2e-480b-ab56-d13ae8ea9c8b service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] No waiting events found dispatching network-vif-unplugged-3e2379bd-6e97-45dc-917b-e8e4478a3be0 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG nova.compute.manager [req-1a8a6331-1c89-4b4f-bf0b-b9eac5c3a0f6 req-25806c00-8f2e-480b-ab56-d13ae8ea9c8b service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Received event network-vif-unplugged-3e2379bd-6e97-45dc-917b-e8e4478a3be0 for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:25 user nova-compute[75080]: INFO os_vif [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:c9:8b,bridge_name='br-int',has_traffic_filtering=True,id=fb2619ea-ffe7-4d82-9b44-984ee393620c,network=Network(efba4a7e-3a56-41d2-8af7-4c064ba641fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb2619ea-ff')
Dec 05 15:21:25 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] No VIF found with MAC fa:16:3e:4b:c9:8b, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1830878a-71e0-48f1-85b8-9ed83b1419cd/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:26 user nova-compute[75080]: DEBUG nova.network.neutron [req-e6903f5c-152e-4ef2-877b-8ee7173ea4c7 req-fed50a4d-e1a0-41d3-a881-06f7b85584be service nova] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Updated VIF entry in instance network info cache for port fb2619ea-ffe7-4d82-9b44-984ee393620c. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:21:26 user nova-compute[75080]: DEBUG nova.network.neutron [req-e6903f5c-152e-4ef2-877b-8ee7173ea4c7 req-fed50a4d-e1a0-41d3-a881-06f7b85584be service nova] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Updating instance_info_cache with network_info: [{"id": "fb2619ea-ffe7-4d82-9b44-984ee393620c", "address": "fa:16:3e:4b:c9:8b", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb2619ea-ff", "ovs_interfaceid": "fb2619ea-ffe7-4d82-9b44-984ee393620c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:21:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1830878a-71e0-48f1-85b8-9ed83b1419cd/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1830878a-71e0-48f1-85b8-9ed83b1419cd/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-e6903f5c-152e-4ef2-877b-8ee7173ea4c7 req-fed50a4d-e1a0-41d3-a881-06f7b85584be service nova] Releasing lock "refresh_cache-5e29bda9-f1d6-4951-9343-f189934a8a23" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:21:26 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Instance destroyed successfully.
Dec 05 15:21:26 user nova-compute[75080]: DEBUG nova.objects.instance [None req-ad9e24c2-f432-4acc-a5a5-4606dde0e93c tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lazy-loading 'resources' on Instance uuid 0259351f-617f-47be-bfb6-2fef1c35bf15 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:21:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-ad9e24c2-f432-4acc-a5a5-4606dde0e93c tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-640774861',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-640774861',id=4,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOcchwMQ/y1AsP3A0b3QpAgR94U3k1ch+DL7mOp5G4Jk3dTtQRet9PTuUq+tE9S2nFGwMJzhzoriFDCKnxJ67e/D1DfTAZHVMm0T9FYpXt1Eg6HZqWa1ZIEyx+Gye4eIQ==',key_name='tempest-keypair-1279310443',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:18:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='24e3fe3c0db24db598f947ebfe7a8b3d',ramdisk_id='',reservation_id='r-yuqxc4c9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1860660485',owner_user_name='tempest-TaggedAttachmentsTest-1860660485-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:18:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bd4a8e35eed47d1b156037a6dda5668',uuid=0259351f-617f-47be-bfb6-2fef1c35bf15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e2379bd-6e97-45dc-917b-e8e4478a3be0", "address": "fa:16:3e:68:6e:ba", "network": {"id": "1adc7b37-8fcb-4b25-92e7-e746874f778b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-490224437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24e3fe3c0db24db598f947ebfe7a8b3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2379bd-6e", "ovs_interfaceid": "3e2379bd-6e97-45dc-917b-e8e4478a3be0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:21:26 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-ad9e24c2-f432-4acc-a5a5-4606dde0e93c tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Converting VIF {"id": "3e2379bd-6e97-45dc-917b-e8e4478a3be0", "address": "fa:16:3e:68:6e:ba", "network": {"id": "1adc7b37-8fcb-4b25-92e7-e746874f778b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-490224437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24e3fe3c0db24db598f947ebfe7a8b3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2379bd-6e", "ovs_interfaceid": "3e2379bd-6e97-45dc-917b-e8e4478a3be0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:21:26 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-ad9e24c2-f432-4acc-a5a5-4606dde0e93c tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:6e:ba,bridge_name='br-int',has_traffic_filtering=True,id=3e2379bd-6e97-45dc-917b-e8e4478a3be0,network=Network(1adc7b37-8fcb-4b25-92e7-e746874f778b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e2379bd-6e') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:21:26 user nova-compute[75080]: DEBUG os_vif [None req-ad9e24c2-f432-4acc-a5a5-4606dde0e93c tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:6e:ba,bridge_name='br-int',has_traffic_filtering=True,id=3e2379bd-6e97-45dc-917b-e8e4478a3be0,network=Network(1adc7b37-8fcb-4b25-92e7-e746874f778b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e2379bd-6e') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:21:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1830878a-71e0-48f1-85b8-9ed83b1419cd/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e2379bd-6e, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:21:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:21:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69bc0bc-b6e8-447b-b529-54031fc78ce1/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=12581444-a5c8-47d6-88a1-13a3bf673f2c) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:21:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:21:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:26 user nova-compute[75080]: INFO os_vif [None req-ad9e24c2-f432-4acc-a5a5-4606dde0e93c tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:6e:ba,bridge_name='br-int',has_traffic_filtering=True,id=3e2379bd-6e97-45dc-917b-e8e4478a3be0,network=Network(1adc7b37-8fcb-4b25-92e7-e746874f778b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e2379bd-6e')
Dec 05 15:21:26 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-ad9e24c2-f432-4acc-a5a5-4606dde0e93c tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Deleting instance files /opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15_del
Dec 05 15:21:26 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-ad9e24c2-f432-4acc-a5a5-4606dde0e93c tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Deletion of /opt/stack/data/nova/instances/0259351f-617f-47be-bfb6-2fef1c35bf15_del complete
Dec 05 15:21:26 user nova-compute[75080]: INFO nova.compute.manager [None req-ad9e24c2-f432-4acc-a5a5-4606dde0e93c tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Took 1.54 seconds to destroy the instance on the hypervisor.
Dec 05 15:21:26 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-ad9e24c2-f432-4acc-a5a5-4606dde0e93c tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:21:26 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:21:26 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:21:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69bc0bc-b6e8-447b-b529-54031fc78ce1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69bc0bc-b6e8-447b-b529-54031fc78ce1/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69bc0bc-b6e8-447b-b529-54031fc78ce1/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:21:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30a4dd31-76bf-497e-b0d0-82bd70940e6c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30a4dd31-76bf-497e-b0d0-82bd70940e6c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30a4dd31-76bf-497e-b0d0-82bd70940e6c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30a4dd31-76bf-497e-b0d0-82bd70940e6c/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:30 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-0283510c-734d-4d64-9bb0-32df171f6e61 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1830878a-71e0-48f1-85b8-9ed83b1419cd is timed out.
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.compute.manager [req-85b269a1-1e5f-4a09-ba7e-c26804244f0b req-252fa783-2aba-4286-98bf-8e2ba3316490 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Received event network-vif-plugged-3e2379bd-6e97-45dc-917b-e8e4478a3be0 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-85b269a1-1e5f-4a09-ba7e-c26804244f0b req-252fa783-2aba-4286-98bf-8e2ba3316490 service nova] Acquiring lock "0259351f-617f-47be-bfb6-2fef1c35bf15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-85b269a1-1e5f-4a09-ba7e-c26804244f0b req-252fa783-2aba-4286-98bf-8e2ba3316490 service nova] Lock "0259351f-617f-47be-bfb6-2fef1c35bf15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-85b269a1-1e5f-4a09-ba7e-c26804244f0b req-252fa783-2aba-4286-98bf-8e2ba3316490 service nova] Lock "0259351f-617f-47be-bfb6-2fef1c35bf15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.compute.manager [req-85b269a1-1e5f-4a09-ba7e-c26804244f0b req-252fa783-2aba-4286-98bf-8e2ba3316490 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] No waiting events found dispatching network-vif-plugged-3e2379bd-6e97-45dc-917b-e8e4478a3be0 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:21:30 user nova-compute[75080]: WARNING nova.compute.manager [req-85b269a1-1e5f-4a09-ba7e-c26804244f0b req-252fa783-2aba-4286-98bf-8e2ba3316490 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Received unexpected event network-vif-plugged-3e2379bd-6e97-45dc-917b-e8e4478a3be0 for instance with vm_state active and task_state deleting.
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.compute.manager [req-85b269a1-1e5f-4a09-ba7e-c26804244f0b req-252fa783-2aba-4286-98bf-8e2ba3316490 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Received event network-vif-plugged-3e2379bd-6e97-45dc-917b-e8e4478a3be0 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-85b269a1-1e5f-4a09-ba7e-c26804244f0b req-252fa783-2aba-4286-98bf-8e2ba3316490 service nova] Acquiring lock "0259351f-617f-47be-bfb6-2fef1c35bf15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-85b269a1-1e5f-4a09-ba7e-c26804244f0b req-252fa783-2aba-4286-98bf-8e2ba3316490 service nova] Lock "0259351f-617f-47be-bfb6-2fef1c35bf15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-85b269a1-1e5f-4a09-ba7e-c26804244f0b req-252fa783-2aba-4286-98bf-8e2ba3316490 service nova] Lock "0259351f-617f-47be-bfb6-2fef1c35bf15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.compute.manager [req-85b269a1-1e5f-4a09-ba7e-c26804244f0b req-252fa783-2aba-4286-98bf-8e2ba3316490 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] No waiting events found dispatching network-vif-plugged-3e2379bd-6e97-45dc-917b-e8e4478a3be0 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:21:30 user nova-compute[75080]: WARNING nova.compute.manager [req-85b269a1-1e5f-4a09-ba7e-c26804244f0b req-252fa783-2aba-4286-98bf-8e2ba3316490 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Received unexpected event network-vif-plugged-3e2379bd-6e97-45dc-917b-e8e4478a3be0 for instance with vm_state active and task_state deleting.
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.compute.manager [req-85b269a1-1e5f-4a09-ba7e-c26804244f0b req-252fa783-2aba-4286-98bf-8e2ba3316490 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Received event network-vif-plugged-3e2379bd-6e97-45dc-917b-e8e4478a3be0 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-85b269a1-1e5f-4a09-ba7e-c26804244f0b req-252fa783-2aba-4286-98bf-8e2ba3316490 service nova] Acquiring lock "0259351f-617f-47be-bfb6-2fef1c35bf15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-85b269a1-1e5f-4a09-ba7e-c26804244f0b req-252fa783-2aba-4286-98bf-8e2ba3316490 service nova] Lock "0259351f-617f-47be-bfb6-2fef1c35bf15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-85b269a1-1e5f-4a09-ba7e-c26804244f0b req-252fa783-2aba-4286-98bf-8e2ba3316490 service nova] Lock "0259351f-617f-47be-bfb6-2fef1c35bf15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.compute.manager [req-85b269a1-1e5f-4a09-ba7e-c26804244f0b req-252fa783-2aba-4286-98bf-8e2ba3316490 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] No waiting events found dispatching network-vif-plugged-3e2379bd-6e97-45dc-917b-e8e4478a3be0 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:21:30 user nova-compute[75080]: WARNING nova.compute.manager [req-85b269a1-1e5f-4a09-ba7e-c26804244f0b req-252fa783-2aba-4286-98bf-8e2ba3316490 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Received unexpected event network-vif-plugged-3e2379bd-6e97-45dc-917b-e8e4478a3be0 for instance with vm_state active and task_state deleting.
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.compute.manager [req-85b269a1-1e5f-4a09-ba7e-c26804244f0b req-252fa783-2aba-4286-98bf-8e2ba3316490 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Received event network-vif-unplugged-3e2379bd-6e97-45dc-917b-e8e4478a3be0 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-85b269a1-1e5f-4a09-ba7e-c26804244f0b req-252fa783-2aba-4286-98bf-8e2ba3316490 service nova] Acquiring lock "0259351f-617f-47be-bfb6-2fef1c35bf15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-85b269a1-1e5f-4a09-ba7e-c26804244f0b req-252fa783-2aba-4286-98bf-8e2ba3316490 service nova] Lock "0259351f-617f-47be-bfb6-2fef1c35bf15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-85b269a1-1e5f-4a09-ba7e-c26804244f0b req-252fa783-2aba-4286-98bf-8e2ba3316490 service nova] Lock "0259351f-617f-47be-bfb6-2fef1c35bf15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.compute.manager [req-85b269a1-1e5f-4a09-ba7e-c26804244f0b req-252fa783-2aba-4286-98bf-8e2ba3316490 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] No waiting events found dispatching network-vif-unplugged-3e2379bd-6e97-45dc-917b-e8e4478a3be0 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.compute.manager [req-85b269a1-1e5f-4a09-ba7e-c26804244f0b req-252fa783-2aba-4286-98bf-8e2ba3316490 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Received event network-vif-unplugged-3e2379bd-6e97-45dc-917b-e8e4478a3be0 for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.compute.manager [req-85b269a1-1e5f-4a09-ba7e-c26804244f0b req-252fa783-2aba-4286-98bf-8e2ba3316490 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Received event network-vif-plugged-3e2379bd-6e97-45dc-917b-e8e4478a3be0 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-85b269a1-1e5f-4a09-ba7e-c26804244f0b req-252fa783-2aba-4286-98bf-8e2ba3316490 service nova] Acquiring lock "0259351f-617f-47be-bfb6-2fef1c35bf15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-85b269a1-1e5f-4a09-ba7e-c26804244f0b req-252fa783-2aba-4286-98bf-8e2ba3316490 service nova] Lock "0259351f-617f-47be-bfb6-2fef1c35bf15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-85b269a1-1e5f-4a09-ba7e-c26804244f0b req-252fa783-2aba-4286-98bf-8e2ba3316490 service nova] Lock "0259351f-617f-47be-bfb6-2fef1c35bf15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.compute.manager [req-85b269a1-1e5f-4a09-ba7e-c26804244f0b req-252fa783-2aba-4286-98bf-8e2ba3316490 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] No waiting events found dispatching network-vif-plugged-3e2379bd-6e97-45dc-917b-e8e4478a3be0 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:21:30 user nova-compute[75080]: WARNING nova.compute.manager [req-85b269a1-1e5f-4a09-ba7e-c26804244f0b req-252fa783-2aba-4286-98bf-8e2ba3316490 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Received unexpected event network-vif-plugged-3e2379bd-6e97-45dc-917b-e8e4478a3be0 for instance with vm_state active and task_state deleting.
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.compute.manager [req-85b269a1-1e5f-4a09-ba7e-c26804244f0b req-252fa783-2aba-4286-98bf-8e2ba3316490 service nova] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Received event network-vif-plugged-fb2619ea-ffe7-4d82-9b44-984ee393620c {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-85b269a1-1e5f-4a09-ba7e-c26804244f0b req-252fa783-2aba-4286-98bf-8e2ba3316490 service nova] Acquiring lock "5e29bda9-f1d6-4951-9343-f189934a8a23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-85b269a1-1e5f-4a09-ba7e-c26804244f0b req-252fa783-2aba-4286-98bf-8e2ba3316490 service nova] Lock "5e29bda9-f1d6-4951-9343-f189934a8a23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-85b269a1-1e5f-4a09-ba7e-c26804244f0b req-252fa783-2aba-4286-98bf-8e2ba3316490 service nova] Lock "5e29bda9-f1d6-4951-9343-f189934a8a23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.compute.manager [req-85b269a1-1e5f-4a09-ba7e-c26804244f0b req-252fa783-2aba-4286-98bf-8e2ba3316490 service nova] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] No waiting events found dispatching network-vif-plugged-fb2619ea-ffe7-4d82-9b44-984ee393620c {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:21:30 user nova-compute[75080]: WARNING nova.compute.manager [req-85b269a1-1e5f-4a09-ba7e-c26804244f0b req-252fa783-2aba-4286-98bf-8e2ba3316490 service nova] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Received unexpected event network-vif-plugged-fb2619ea-ffe7-4d82-9b44-984ee393620c for instance with vm_state building and task_state spawning.
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.compute.manager [req-24b81d53-e890-4730-bfe8-9d99cdea01e0 req-43694fdf-890a-4cbf-8782-a175857afe85 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Received event network-vif-deleted-3e2379bd-6e97-45dc-917b-e8e4478a3be0 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:21:30 user nova-compute[75080]: INFO nova.compute.manager [req-24b81d53-e890-4730-bfe8-9d99cdea01e0 req-43694fdf-890a-4cbf-8782-a175857afe85 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Neutron deleted interface 3e2379bd-6e97-45dc-917b-e8e4478a3be0; detaching it from the instance and deleting it from the info cache
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.network.neutron [req-24b81d53-e890-4730-bfe8-9d99cdea01e0 req-43694fdf-890a-4cbf-8782-a175857afe85 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.compute.manager [req-062f3827-232c-4cfc-aefb-ab0c8cf5b16f req-7f3b93cd-f180-451a-b806-0f07c4f5956d service nova] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Received event network-vif-plugged-fb2619ea-ffe7-4d82-9b44-984ee393620c {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-062f3827-232c-4cfc-aefb-ab0c8cf5b16f req-7f3b93cd-f180-451a-b806-0f07c4f5956d service nova] Acquiring lock "5e29bda9-f1d6-4951-9343-f189934a8a23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-062f3827-232c-4cfc-aefb-ab0c8cf5b16f req-7f3b93cd-f180-451a-b806-0f07c4f5956d service nova] Lock "5e29bda9-f1d6-4951-9343-f189934a8a23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-062f3827-232c-4cfc-aefb-ab0c8cf5b16f req-7f3b93cd-f180-451a-b806-0f07c4f5956d service nova] Lock "5e29bda9-f1d6-4951-9343-f189934a8a23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.compute.manager [req-062f3827-232c-4cfc-aefb-ab0c8cf5b16f req-7f3b93cd-f180-451a-b806-0f07c4f5956d service nova] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] No waiting events found dispatching network-vif-plugged-fb2619ea-ffe7-4d82-9b44-984ee393620c {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:21:30 user nova-compute[75080]: WARNING nova.compute.manager [req-062f3827-232c-4cfc-aefb-ab0c8cf5b16f req-7f3b93cd-f180-451a-b806-0f07c4f5956d service nova] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Received unexpected event network-vif-plugged-fb2619ea-ffe7-4d82-9b44-984ee393620c for instance with vm_state building and task_state spawning.
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.compute.manager [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Acquiring lock "aeb779d7-8841-4f61-bd48-2781609ae66d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Lock "aeb779d7-8841-4f61-bd48-2781609ae66d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:30 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-0283510c-734d-4d64-9bb0-32df171f6e61 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Successfully detached device vdb from instance 1830878a-71e0-48f1-85b8-9ed83b1419cd from the live domain config.
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0283510c-734d-4d64-9bb0-32df171f6e61 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0283510c-734d-4d64-9bb0-32df171f6e61 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jfDBzNcE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '22aea242-c46e-4ce0-bc46-c34a56465dd9'}, None), 'kwargs': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:21:30 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-0283510c-734d-4d64-9bb0-32df171f6e61 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:21:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-0283510c-734d-4d64-9bb0-32df171f6e61 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-0283510c-734d-4d64-9bb0-32df171f6e61 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:30 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Instance spawned successfully.
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:21:30 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:21:30 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=7905MB free_disk=25.442626953125GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.compute.manager [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9253ce09-83b0-4b1b-afab-67a08e0663d2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0283510c-734d-4d64-9bb0-32df171f6e61 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:21:30 user nova-compute[75080]: No targets found.
Dec 05 15:21:30 user nova-compute[75080]: iSNS:
Dec 05 15:21:30 user nova-compute[75080]: No targets found.
Dec 05 15:21:30 user nova-compute[75080]: STATIC:
Dec 05 15:21:30 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9
Dec 05 15:21:30 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:21:30 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:21:30 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a
Dec 05 15:21:30 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:21:30 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:21:30 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece
Dec 05 15:21:30 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:21:30 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:21:30 user nova-compute[75080]: FIRMWARE:
Dec 05 15:21:30 user nova-compute[75080]: No targets found.
Dec 05 15:21:30 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0283510c-734d-4d64-9bb0-32df171f6e61 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:21:30 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:21:30 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0283510c-734d-4d64-9bb0-32df171f6e61 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f56cda2a-5eb0-4a96-b85f-c9935918345f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Acquiring lock "33078a88-4858-4c6b-bfa9-c3d9b83cf78b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f56cda2a-5eb0-4a96-b85f-c9935918345f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Lock "33078a88-4858-4c6b-bfa9-c3d9b83cf78b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f56cda2a-5eb0-4a96-b85f-c9935918345f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Acquiring lock "33078a88-4858-4c6b-bfa9-c3d9b83cf78b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f56cda2a-5eb0-4a96-b85f-c9935918345f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Lock "33078a88-4858-4c6b-bfa9-c3d9b83cf78b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f56cda2a-5eb0-4a96-b85f-c9935918345f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Lock "33078a88-4858-4c6b-bfa9-c3d9b83cf78b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:30 user nova-compute[75080]: INFO nova.compute.manager [None req-f56cda2a-5eb0-4a96-b85f-c9935918345f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Terminating instance
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.compute.manager [None req-f56cda2a-5eb0-4a96-b85f-c9935918345f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:21:30 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Took 3.36 seconds to deallocate network for instance.
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39a2716-9529-457d-b053-2a90a5d0cf36]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.compute.manager [req-24b81d53-e890-4730-bfe8-9d99cdea01e0 req-43694fdf-890a-4cbf-8782-a175857afe85 service nova] [instance: 0259351f-617f-47be-bfb6-2fef1c35bf15] Detach interface failed, port_id=3e2379bd-6e97-45dc-917b-e8e4478a3be0, reason: Instance 0259351f-617f-47be-bfb6-2fef1c35bf15 could not be found. {{(pid=75080) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f943001-c1b0-4f70-bc47-7fe4c3b0124d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0283510c-734d-4d64-9bb0-32df171f6e61 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)
Dec 05 15:21:30 user nova-compute[75080]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a (non-flash)
Dec 05 15:21:30 user nova-compute[75080]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece (non-flash)
Dec 05 15:21:30 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0283510c-734d-4d64-9bb0-32df171f6e61 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 (non-flash)
Dec 05 15:21:30 user nova-compute[75080]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a (non-flash)
Dec 05 15:21:30 user nova-compute[75080]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece (non-flash)
Dec 05 15:21:30 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0283510c-734d-4d64-9bb0-32df171f6e61 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f66384bac20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9'): ({'sdc'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-0283510c-734d-4d64-9bb0-32df171f6e61 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Removing single pathed devices sdc {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f85771-d0a3-4f91-957c-e47836841f8f]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ad9e24c2-f432-4acc-a5a5-4606dde0e93c tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:30 user nova-compute[75080]: INFO nova.compute.manager [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Took 6.79 seconds to spawn the instance on the hypervisor.
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.compute.manager [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance bd75375a-8b70-4bc2-a72b-14213ebaa4e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance eedd1529-4feb-4f85-8625-0c20d8e0359d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 0259351f-617f-47be-bfb6-2fef1c35bf15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 1830878a-71e0-48f1-85b8-9ed83b1419cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 33078a88-4858-4c6b-bfa9-c3d9b83cf78b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance d69bc0bc-b6e8-447b-b529-54031fc78ce1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 30a4dd31-76bf-497e-b0d0-82bd70940e6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 5e29bda9-f1d6-4951-9343-f189934a8a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.038s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c559d13f-7600-463c-8904-0c8635ef4272]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-0283510c-734d-4d64-9bb0-32df171f6e61 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Flushing IO for device /dev/sdc {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5a8a38-0d41-4ad4-b32d-94e4b05a14de]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-0283510c-734d-4d64-9bb0-32df171f6e61 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance aeb779d7-8841-4f61-bd48-2781609ae66d has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1764}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a753f8-ecad-4538-8b03-6f2bdeef7b25]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-0283510c-734d-4d64-9bb0-32df171f6e61 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-0283510c-734d-4d64-9bb0-32df171f6e61 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] SCSI volumes sdc have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0283510c-734d-4d64-9bb0-32df171f6e61 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[47557322-708e-4233-bfe1-7bcd8cac6547]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0283510c-734d-4d64-9bb0-32df171f6e61 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:30 user nova-compute[75080]: INFO nova.compute.manager [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Took 7.64 seconds to build instance.
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8647054-f446-4f78-ae91-85bece971110]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-37544387-af1c-4ca0-ac2e-9fd805d176bd tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "5e29bda9-f1d6-4951-9343-f189934a8a23" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.776s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0283510c-734d-4d64-9bb0-32df171f6e61 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9, portal: 172.16.0.220,3260]
Dec 05 15:21:30 user nova-compute[75080]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9, portal: 172.16.0.220,3260] successful.
Dec 05 15:21:30 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.compute.manager [req-0daa0656-445c-406e-9662-da426ad1f4b9 req-23364644-497e-4c15-837c-3009bec2c367 service nova] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Received event network-vif-unplugged-1ba3c430-69cf-40e7-bfe4-f12fb016fcc6 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0daa0656-445c-406e-9662-da426ad1f4b9 req-23364644-497e-4c15-837c-3009bec2c367 service nova] Acquiring lock "33078a88-4858-4c6b-bfa9-c3d9b83cf78b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0daa0656-445c-406e-9662-da426ad1f4b9 req-23364644-497e-4c15-837c-3009bec2c367 service nova] Lock "33078a88-4858-4c6b-bfa9-c3d9b83cf78b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0daa0656-445c-406e-9662-da426ad1f4b9 req-23364644-497e-4c15-837c-3009bec2c367 service nova] Lock "33078a88-4858-4c6b-bfa9-c3d9b83cf78b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.compute.manager [req-0daa0656-445c-406e-9662-da426ad1f4b9 req-23364644-497e-4c15-837c-3009bec2c367 service nova] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] No waiting events found dispatching network-vif-unplugged-1ba3c430-69cf-40e7-bfe4-f12fb016fcc6 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.compute.manager [req-0daa0656-445c-406e-9662-da426ad1f4b9 req-23364644-497e-4c15-837c-3009bec2c367 service nova] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Received event network-vif-unplugged-1ba3c430-69cf-40e7-bfe4-f12fb016fcc6 for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22aea242-c46e-4ce0-bc46-c34a56465dd9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bfcd90-2c70-4335-b688-6f53e1e3f180]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0283510c-734d-4d64-9bb0-32df171f6e61 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-0283510c-734d-4d64-9bb0-32df171f6e61 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.470s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0283510c-734d-4d64-9bb0-32df171f6e61 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] <== disconnect_volume: return (471ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0283510c-734d-4d64-9bb0-32df171f6e61 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:21:30 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:21:31 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:21:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.762s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ad9e24c2-f432-4acc-a5a5-4606dde0e93c tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.623s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:31 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Instance destroyed successfully.
Dec 05 15:21:31 user nova-compute[75080]: DEBUG nova.objects.instance [None req-f56cda2a-5eb0-4a96-b85f-c9935918345f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Lazy-loading 'resources' on Instance uuid 33078a88-4858-4c6b-bfa9-c3d9b83cf78b {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:21:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-f56cda2a-5eb0-4a96-b85f-c9935918345f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:18:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-154587334',display_name='tempest-VolumesAssistedSnapshotsTest-server-154587334',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-154587334',id=7,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4C238xmF5WUomXV6hZsLKdqbPNAUYpY5jlCm/Wj8b73CCTd+HNGY3q49HF01W+P8wXjfutnpCL8CNEb1ZJ1WntrL1Tk1zNGH3iN80ktAoA+74E5cocWsqZUv3sI5sTQQ==',key_name='tempest-keypair-983423462',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:18:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cc2b129bb5af4ea9844c6eb1ac0e892b',ramdisk_id='',reservation_id='r-7ulqypb1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-339249874',owner_user_name='tempest-VolumesAssistedSnapshotsTest-339249874-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:18:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc8e44dad1cd499693a674a6f5c2f180',uuid=33078a88-4858-4c6b-bfa9-c3d9b83cf78b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ba3c430-69cf-40e7-bfe4-f12fb016fcc6", "address": "fa:16:3e:35:a9:ee", "network": {"id": "c3560d36-b0b7-4e66-a452-fd50e56003f9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1825133181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc2b129bb5af4ea9844c6eb1ac0e892b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ba3c430-69", "ovs_interfaceid": "1ba3c430-69cf-40e7-bfe4-f12fb016fcc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:21:31 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-f56cda2a-5eb0-4a96-b85f-c9935918345f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Converting VIF {"id": "1ba3c430-69cf-40e7-bfe4-f12fb016fcc6", "address": "fa:16:3e:35:a9:ee", "network": {"id": "c3560d36-b0b7-4e66-a452-fd50e56003f9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1825133181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc2b129bb5af4ea9844c6eb1ac0e892b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ba3c430-69", "ovs_interfaceid": "1ba3c430-69cf-40e7-bfe4-f12fb016fcc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:21:31 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-f56cda2a-5eb0-4a96-b85f-c9935918345f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:a9:ee,bridge_name='br-int',has_traffic_filtering=True,id=1ba3c430-69cf-40e7-bfe4-f12fb016fcc6,network=Network(c3560d36-b0b7-4e66-a452-fd50e56003f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ba3c430-69') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:21:31 user nova-compute[75080]: DEBUG os_vif [None req-f56cda2a-5eb0-4a96-b85f-c9935918345f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:a9:ee,bridge_name='br-int',has_traffic_filtering=True,id=1ba3c430-69cf-40e7-bfe4-f12fb016fcc6,network=Network(c3560d36-b0b7-4e66-a452-fd50e56003f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ba3c430-69') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:21:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ba3c430-69, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:21:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:21:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c1958a60-25b3-4531-be45-86b8daf3aada) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:21:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:21:31 user nova-compute[75080]: INFO os_vif [None req-f56cda2a-5eb0-4a96-b85f-c9935918345f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:a9:ee,bridge_name='br-int',has_traffic_filtering=True,id=1ba3c430-69cf-40e7-bfe4-f12fb016fcc6,network=Network(c3560d36-b0b7-4e66-a452-fd50e56003f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ba3c430-69')
Dec 05 15:21:31 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-f56cda2a-5eb0-4a96-b85f-c9935918345f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Deleting instance files /opt/stack/data/nova/instances/33078a88-4858-4c6b-bfa9-c3d9b83cf78b_del
Dec 05 15:21:31 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-f56cda2a-5eb0-4a96-b85f-c9935918345f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Deletion of /opt/stack/data/nova/instances/33078a88-4858-4c6b-bfa9-c3d9b83cf78b_del complete
Dec 05 15:21:31 user nova-compute[75080]: INFO nova.compute.manager [None req-f56cda2a-5eb0-4a96-b85f-c9935918345f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Took 1.26 seconds to destroy the instance on the hypervisor.
Dec 05 15:21:31 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-f56cda2a-5eb0-4a96-b85f-c9935918345f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:21:31 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:21:31 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:21:31 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-ad9e24c2-f432-4acc-a5a5-4606dde0e93c tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:21:31 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-ad9e24c2-f432-4acc-a5a5-4606dde0e93c tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:21:31 user nova-compute[75080]: DEBUG nova.objects.instance [None req-0283510c-734d-4d64-9bb0-32df171f6e61 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Lazy-loading 'flavor' on Instance uuid 1830878a-71e0-48f1-85b8-9ed83b1419cd {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:21:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ad9e24c2-f432-4acc-a5a5-4606dde0e93c tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.701s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.321s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:31 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:21:31 user nova-compute[75080]: INFO nova.compute.claims [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Claim successful on node user
Dec 05 15:21:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0283510c-734d-4d64-9bb0-32df171f6e61 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Lock "1830878a-71e0-48f1-85b8-9ed83b1419cd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.059s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:31 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-ad9e24c2-f432-4acc-a5a5-4606dde0e93c tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Deleted allocations for instance 0259351f-617f-47be-bfb6-2fef1c35bf15
Dec 05 15:21:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ad9e24c2-f432-4acc-a5a5-4606dde0e93c tempest-TaggedAttachmentsTest-1860660485 tempest-TaggedAttachmentsTest-1860660485-project-member] Lock "0259351f-617f-47be-bfb6-2fef1c35bf15" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.521s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:31 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:21:31 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:21:31 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:21:32 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:21:32 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:21:32 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:21:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.582s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:32 user nova-compute[75080]: DEBUG nova.compute.manager [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:21:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-1830878a-71e0-48f1-85b8-9ed83b1419cd" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:21:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-1830878a-71e0-48f1-85b8-9ed83b1419cd" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:21:32 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 15:21:32 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Took 0.77 seconds to deallocate network for instance.
Dec 05 15:21:32 user nova-compute[75080]: DEBUG nova.compute.manager [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:21:32 user nova-compute[75080]: DEBUG nova.network.neutron [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:21:32 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:21:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f56cda2a-5eb0-4a96-b85f-c9935918345f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f56cda2a-5eb0-4a96-b85f-c9935918345f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:32 user nova-compute[75080]: DEBUG nova.compute.manager [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:21:32 user nova-compute[75080]: DEBUG nova.policy [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc3019c10eb549e984490b34eee7814e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902ae7a7ca524dfa83b98c3baebc42eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:21:32 user nova-compute[75080]: DEBUG nova.compute.manager [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:21:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:21:32 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Creating image(s)
Dec 05 15:21:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Acquiring lock "/opt/stack/data/nova/instances/aeb779d7-8841-4f61-bd48-2781609ae66d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Lock "/opt/stack/data/nova/instances/aeb779d7-8841-4f61-bd48-2781609ae66d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Lock "/opt/stack/data/nova/instances/aeb779d7-8841-4f61-bd48-2781609ae66d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:32 user nova-compute[75080]: DEBUG nova.compute.manager [req-e2d50686-6313-4bc9-a0a8-54e2c0f66b44 req-afb15ec8-4520-41d7-8a8a-8f36cc043af3 service nova] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Received event network-vif-plugged-1ba3c430-69cf-40e7-bfe4-f12fb016fcc6 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:21:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-e2d50686-6313-4bc9-a0a8-54e2c0f66b44 req-afb15ec8-4520-41d7-8a8a-8f36cc043af3 service nova] Acquiring lock "33078a88-4858-4c6b-bfa9-c3d9b83cf78b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-e2d50686-6313-4bc9-a0a8-54e2c0f66b44 req-afb15ec8-4520-41d7-8a8a-8f36cc043af3 service nova] Lock "33078a88-4858-4c6b-bfa9-c3d9b83cf78b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-e2d50686-6313-4bc9-a0a8-54e2c0f66b44 req-afb15ec8-4520-41d7-8a8a-8f36cc043af3 service nova] Lock "33078a88-4858-4c6b-bfa9-c3d9b83cf78b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:32 user nova-compute[75080]: DEBUG nova.compute.manager [req-e2d50686-6313-4bc9-a0a8-54e2c0f66b44 req-afb15ec8-4520-41d7-8a8a-8f36cc043af3 service nova] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] No waiting events found dispatching network-vif-plugged-1ba3c430-69cf-40e7-bfe4-f12fb016fcc6 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:21:32 user nova-compute[75080]: WARNING nova.compute.manager [req-e2d50686-6313-4bc9-a0a8-54e2c0f66b44 req-afb15ec8-4520-41d7-8a8a-8f36cc043af3 service nova] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Received unexpected event network-vif-plugged-1ba3c430-69cf-40e7-bfe4-f12fb016fcc6 for instance with vm_state deleted and task_state None.
Dec 05 15:21:32 user nova-compute[75080]: DEBUG nova.compute.manager [req-e2d50686-6313-4bc9-a0a8-54e2c0f66b44 req-afb15ec8-4520-41d7-8a8a-8f36cc043af3 service nova] [instance: 33078a88-4858-4c6b-bfa9-c3d9b83cf78b] Received event network-vif-deleted-1ba3c430-69cf-40e7-bfe4-f12fb016fcc6 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:21:32 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-f56cda2a-5eb0-4a96-b85f-c9935918345f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:21:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.199s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:32 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Updating instance_info_cache with network_info: [{"id": "fe1ce7fc-22e0-4814-b15f-c3e9f82574b6", "address": "fa:16:3e:ad:48:50", "network": {"id": "ab471423-0f49-4695-a2d0-76abb88aec8e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-408483206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e445361a61f44659ba229fd8c053d736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1ce7fc-22", "ovs_interfaceid": "fe1ce7fc-22e0-4814-b15f-c3e9f82574b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:21:32 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-f56cda2a-5eb0-4a96-b85f-c9935918345f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:21:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-1830878a-71e0-48f1-85b8-9ed83b1419cd" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:21:32 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 15:21:32 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:21:32 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:21:32 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:21:32 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:21:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f56cda2a-5eb0-4a96-b85f-c9935918345f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.565s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:32 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-f56cda2a-5eb0-4a96-b85f-c9935918345f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Deleted allocations for instance 33078a88-4858-4c6b-bfa9-c3d9b83cf78b
Dec 05 15:21:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.206s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/aeb779d7-8841-4f61-bd48-2781609ae66d/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f56cda2a-5eb0-4a96-b85f-c9935918345f tempest-VolumesAssistedSnapshotsTest-339249874 tempest-VolumesAssistedSnapshotsTest-339249874-project-member] Lock "33078a88-4858-4c6b-bfa9-c3d9b83cf78b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.877s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/aeb779d7-8841-4f61-bd48-2781609ae66d/disk 1073741824" returned: 0 in 0.065s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:33 user nova-compute[75080]: DEBUG nova.network.neutron [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Successfully created port: 7189c99b-944c-4956-8d70-0c98f2ddbf22 {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:21:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.193s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:33 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aeb779d7-8841-4f61-bd48-2781609ae66d/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 15:21:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb779d7-8841-4f61-bd48-2781609ae66d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb779d7-8841-4f61-bd48-2781609ae66d/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:33 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Cannot resize image /opt/stack/data/nova/instances/aeb779d7-8841-4f61-bd48-2781609ae66d/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 15:21:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:21:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Ensure instance console log exists: /opt/stack/data/nova/instances/aeb779d7-8841-4f61-bd48-2781609ae66d/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:21:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:33 user nova-compute[75080]: DEBUG nova.network.neutron [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Successfully updated port: 7189c99b-944c-4956-8d70-0c98f2ddbf22 {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:21:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Acquiring lock "refresh_cache-aeb779d7-8841-4f61-bd48-2781609ae66d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:21:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Acquired lock "refresh_cache-aeb779d7-8841-4f61-bd48-2781609ae66d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:21:33 user nova-compute[75080]: DEBUG nova.network.neutron [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG nova.network.neutron [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG nova.network.neutron [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Updating instance_info_cache with network_info: [{"id": "7189c99b-944c-4956-8d70-0c98f2ddbf22", "address": "fa:16:3e:9b:0a:c8", "network": {"id": "6d5934bf-c431-4a09-8065-8928349e88a0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-238283929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "902ae7a7ca524dfa83b98c3baebc42eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7189c99b-94", "ovs_interfaceid": "7189c99b-944c-4956-8d70-0c98f2ddbf22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Releasing lock "refresh_cache-aeb779d7-8841-4f61-bd48-2781609ae66d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG nova.compute.manager [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Instance network_info: |[{"id": "7189c99b-944c-4956-8d70-0c98f2ddbf22", "address": "fa:16:3e:9b:0a:c8", "network": {"id": "6d5934bf-c431-4a09-8065-8928349e88a0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-238283929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "902ae7a7ca524dfa83b98c3baebc42eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7189c99b-94", "ovs_interfaceid": "7189c99b-944c-4956-8d70-0c98f2ddbf22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Start _get_guest_xml network_info=[{"id": "7189c99b-944c-4956-8d70-0c98f2ddbf22", "address": "fa:16:3e:9b:0a:c8", "network": {"id": "6d5934bf-c431-4a09-8065-8928349e88a0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-238283929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "902ae7a7ca524dfa83b98c3baebc42eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7189c99b-94", "ovs_interfaceid": "7189c99b-944c-4956-8d70-0c98f2ddbf22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:21:34 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:21:34 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:21:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1839844675',display_name='tempest-VolumesActionsTest-instance-1839844675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1839844675',id=15,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='902ae7a7ca524dfa83b98c3baebc42eb',ramdisk_id='',reservation_id='r-yszav6o1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-10205127',owner_user_name='tempest-VolumesActionsTest-10205127-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:21:32Z,user_data=None,user_id='fc3019c10eb549e984490b34eee7814e',uuid=aeb779d7-8841-4f61-bd48-2781609ae66d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7189c99b-944c-4956-8d70-0c98f2ddbf22", "address": "fa:16:3e:9b:0a:c8", "network": {"id": "6d5934bf-c431-4a09-8065-8928349e88a0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-238283929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "902ae7a7ca524dfa83b98c3baebc42eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7189c99b-94", "ovs_interfaceid": "7189c99b-944c-4956-8d70-0c98f2ddbf22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Converting VIF {"id": "7189c99b-944c-4956-8d70-0c98f2ddbf22", "address": "fa:16:3e:9b:0a:c8", "network": {"id": "6d5934bf-c431-4a09-8065-8928349e88a0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-238283929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "902ae7a7ca524dfa83b98c3baebc42eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7189c99b-94", "ovs_interfaceid": "7189c99b-944c-4956-8d70-0c98f2ddbf22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:0a:c8,bridge_name='br-int',has_traffic_filtering=True,id=7189c99b-944c-4956-8d70-0c98f2ddbf22,network=Network(6d5934bf-c431-4a09-8065-8928349e88a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7189c99b-94') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG nova.objects.instance [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Lazy-loading 'pci_devices' on Instance uuid aeb779d7-8841-4f61-bd48-2781609ae66d {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:21:34 user nova-compute[75080]:   <uuid>aeb779d7-8841-4f61-bd48-2781609ae66d</uuid>
Dec 05 15:21:34 user nova-compute[75080]:   <name>instance-0000000f</name>
Dec 05 15:21:34 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:21:34 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:21:34 user nova-compute[75080]:   <metadata>
Dec 05 15:21:34 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:21:34 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:21:34 user nova-compute[75080]:       <nova:name>tempest-VolumesActionsTest-instance-1839844675</nova:name>
Dec 05 15:21:34 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:21:34</nova:creationTime>
Dec 05 15:21:34 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:21:34 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:21:34 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:21:34 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:21:34 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:21:34 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:21:34 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:21:34 user nova-compute[75080]:       <nova:owner>
Dec 05 15:21:34 user nova-compute[75080]:         <nova:user uuid="fc3019c10eb549e984490b34eee7814e">tempest-VolumesActionsTest-10205127-project-member</nova:user>
Dec 05 15:21:34 user nova-compute[75080]:         <nova:project uuid="902ae7a7ca524dfa83b98c3baebc42eb">tempest-VolumesActionsTest-10205127</nova:project>
Dec 05 15:21:34 user nova-compute[75080]:       </nova:owner>
Dec 05 15:21:34 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:21:34 user nova-compute[75080]:       <nova:ports>
Dec 05 15:21:34 user nova-compute[75080]:         <nova:port uuid="7189c99b-944c-4956-8d70-0c98f2ddbf22">
Dec 05 15:21:34 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 05 15:21:34 user nova-compute[75080]:         </nova:port>
Dec 05 15:21:34 user nova-compute[75080]:       </nova:ports>
Dec 05 15:21:34 user nova-compute[75080]:     </nova:instance>
Dec 05 15:21:34 user nova-compute[75080]:   </metadata>
Dec 05 15:21:34 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:21:34 user nova-compute[75080]:     <system>
Dec 05 15:21:34 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:21:34 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:21:34 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:21:34 user nova-compute[75080]:       <entry name="serial">aeb779d7-8841-4f61-bd48-2781609ae66d</entry>
Dec 05 15:21:34 user nova-compute[75080]:       <entry name="uuid">aeb779d7-8841-4f61-bd48-2781609ae66d</entry>
Dec 05 15:21:34 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:21:34 user nova-compute[75080]:     </system>
Dec 05 15:21:34 user nova-compute[75080]:   </sysinfo>
Dec 05 15:21:34 user nova-compute[75080]:   <os>
Dec 05 15:21:34 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:21:34 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:21:34 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:21:34 user nova-compute[75080]:   </os>
Dec 05 15:21:34 user nova-compute[75080]:   <features>
Dec 05 15:21:34 user nova-compute[75080]:     <acpi/>
Dec 05 15:21:34 user nova-compute[75080]:     <apic/>
Dec 05 15:21:34 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:21:34 user nova-compute[75080]:   </features>
Dec 05 15:21:34 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:21:34 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:21:34 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:21:34 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:21:34 user nova-compute[75080]:   </clock>
Dec 05 15:21:34 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:21:34 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:21:34 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:21:34 user nova-compute[75080]:   </cpu>
Dec 05 15:21:34 user nova-compute[75080]:   <devices>
Dec 05 15:21:34 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:21:34 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:21:34 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/aeb779d7-8841-4f61-bd48-2781609ae66d/disk"/>
Dec 05 15:21:34 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:21:34 user nova-compute[75080]:     </disk>
Dec 05 15:21:34 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:21:34 user nova-compute[75080]:       <mac address="fa:16:3e:9b:0a:c8"/>
Dec 05 15:21:34 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:21:34 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:21:34 user nova-compute[75080]:       <target dev="tap7189c99b-94"/>
Dec 05 15:21:34 user nova-compute[75080]:     </interface>
Dec 05 15:21:34 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:21:34 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/aeb779d7-8841-4f61-bd48-2781609ae66d/console.log" append="off"/>
Dec 05 15:21:34 user nova-compute[75080]:     </serial>
Dec 05 15:21:34 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:21:34 user nova-compute[75080]:     <video>
Dec 05 15:21:34 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:21:34 user nova-compute[75080]:     </video>
Dec 05 15:21:34 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:21:34 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:21:34 user nova-compute[75080]:     </rng>
Dec 05 15:21:34 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:21:34 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:21:34 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:21:34 user nova-compute[75080]:     </memballoon>
Dec 05 15:21:34 user nova-compute[75080]:   </devices>
Dec 05 15:21:34 user nova-compute[75080]: </domain>
Dec 05 15:21:34 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1839844675',display_name='tempest-VolumesActionsTest-instance-1839844675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1839844675',id=15,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='902ae7a7ca524dfa83b98c3baebc42eb',ramdisk_id='',reservation_id='r-yszav6o1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-10205127',owner_user_name='tempest-VolumesActionsTest-10205127-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:21:32Z,user_data=None,user_id='fc3019c10eb549e984490b34eee7814e',uuid=aeb779d7-8841-4f61-bd48-2781609ae66d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7189c99b-944c-4956-8d70-0c98f2ddbf22", "address": "fa:16:3e:9b:0a:c8", "network": {"id": "6d5934bf-c431-4a09-8065-8928349e88a0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-238283929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "902ae7a7ca524dfa83b98c3baebc42eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7189c99b-94", "ovs_interfaceid": "7189c99b-944c-4956-8d70-0c98f2ddbf22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Converting VIF {"id": "7189c99b-944c-4956-8d70-0c98f2ddbf22", "address": "fa:16:3e:9b:0a:c8", "network": {"id": "6d5934bf-c431-4a09-8065-8928349e88a0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-238283929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "902ae7a7ca524dfa83b98c3baebc42eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7189c99b-94", "ovs_interfaceid": "7189c99b-944c-4956-8d70-0c98f2ddbf22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:0a:c8,bridge_name='br-int',has_traffic_filtering=True,id=7189c99b-944c-4956-8d70-0c98f2ddbf22,network=Network(6d5934bf-c431-4a09-8065-8928349e88a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7189c99b-94') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG os_vif [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:0a:c8,bridge_name='br-int',has_traffic_filtering=True,id=7189c99b-944c-4956-8d70-0c98f2ddbf22,network=Network(6d5934bf-c431-4a09-8065-8928349e88a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7189c99b-94') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7dc6742e-235d-50ec-b497-753847fc03e1', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7189c99b-94, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7189c99b-94, col_values=(('qos', UUID('7317cd53-1917-4d4a-898c-7c071bf6f171')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7189c99b-94, col_values=(('external_ids', {'iface-id': '7189c99b-944c-4956-8d70-0c98f2ddbf22', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:0a:c8', 'vm-uuid': 'aeb779d7-8841-4f61-bd48-2781609ae66d'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG nova.compute.manager [req-9d971aa2-144e-48c2-9afd-1effb08df1a2 req-7b516714-b631-49cf-af24-9ecdf0908a0f service nova] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Received event network-changed-7189c99b-944c-4956-8d70-0c98f2ddbf22 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG nova.compute.manager [req-9d971aa2-144e-48c2-9afd-1effb08df1a2 req-7b516714-b631-49cf-af24-9ecdf0908a0f service nova] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Refreshing instance network info cache due to event network-changed-7189c99b-944c-4956-8d70-0c98f2ddbf22. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9d971aa2-144e-48c2-9afd-1effb08df1a2 req-7b516714-b631-49cf-af24-9ecdf0908a0f service nova] Acquiring lock "refresh_cache-aeb779d7-8841-4f61-bd48-2781609ae66d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9d971aa2-144e-48c2-9afd-1effb08df1a2 req-7b516714-b631-49cf-af24-9ecdf0908a0f service nova] Acquired lock "refresh_cache-aeb779d7-8841-4f61-bd48-2781609ae66d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG nova.network.neutron [req-9d971aa2-144e-48c2-9afd-1effb08df1a2 req-7b516714-b631-49cf-af24-9ecdf0908a0f service nova] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Refreshing network info cache for port 7189c99b-944c-4956-8d70-0c98f2ddbf22 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:34 user nova-compute[75080]: INFO os_vif [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:0a:c8,bridge_name='br-int',has_traffic_filtering=True,id=7189c99b-944c-4956-8d70-0c98f2ddbf22,network=Network(6d5934bf-c431-4a09-8065-8928349e88a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7189c99b-94')
Dec 05 15:21:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:21:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] No VIF found with MAC fa:16:3e:9b:0a:c8, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:21:35 user nova-compute[75080]: DEBUG nova.network.neutron [req-9d971aa2-144e-48c2-9afd-1effb08df1a2 req-7b516714-b631-49cf-af24-9ecdf0908a0f service nova] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Updated VIF entry in instance network info cache for port 7189c99b-944c-4956-8d70-0c98f2ddbf22. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:21:35 user nova-compute[75080]: DEBUG nova.network.neutron [req-9d971aa2-144e-48c2-9afd-1effb08df1a2 req-7b516714-b631-49cf-af24-9ecdf0908a0f service nova] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Updating instance_info_cache with network_info: [{"id": "7189c99b-944c-4956-8d70-0c98f2ddbf22", "address": "fa:16:3e:9b:0a:c8", "network": {"id": "6d5934bf-c431-4a09-8065-8928349e88a0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-238283929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "902ae7a7ca524dfa83b98c3baebc42eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7189c99b-94", "ovs_interfaceid": "7189c99b-944c-4956-8d70-0c98f2ddbf22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:21:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9d971aa2-144e-48c2-9afd-1effb08df1a2 req-7b516714-b631-49cf-af24-9ecdf0908a0f service nova] Releasing lock "refresh_cache-aeb779d7-8841-4f61-bd48-2781609ae66d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:21:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:36 user nova-compute[75080]: DEBUG nova.compute.manager [req-c4af2124-b44e-4731-9b5f-4a027541df7e req-37552626-0483-4178-a099-3ed294b28602 service nova] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Received event network-vif-plugged-7189c99b-944c-4956-8d70-0c98f2ddbf22 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:21:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c4af2124-b44e-4731-9b5f-4a027541df7e req-37552626-0483-4178-a099-3ed294b28602 service nova] Acquiring lock "aeb779d7-8841-4f61-bd48-2781609ae66d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c4af2124-b44e-4731-9b5f-4a027541df7e req-37552626-0483-4178-a099-3ed294b28602 service nova] Lock "aeb779d7-8841-4f61-bd48-2781609ae66d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c4af2124-b44e-4731-9b5f-4a027541df7e req-37552626-0483-4178-a099-3ed294b28602 service nova] Lock "aeb779d7-8841-4f61-bd48-2781609ae66d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:36 user nova-compute[75080]: DEBUG nova.compute.manager [req-c4af2124-b44e-4731-9b5f-4a027541df7e req-37552626-0483-4178-a099-3ed294b28602 service nova] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] No waiting events found dispatching network-vif-plugged-7189c99b-944c-4956-8d70-0c98f2ddbf22 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:21:36 user nova-compute[75080]: WARNING nova.compute.manager [req-c4af2124-b44e-4731-9b5f-4a027541df7e req-37552626-0483-4178-a099-3ed294b28602 service nova] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Received unexpected event network-vif-plugged-7189c99b-944c-4956-8d70-0c98f2ddbf22 for instance with vm_state building and task_state spawning.
Dec 05 15:21:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:38 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-ace46e9b-d9f1-4e95-ad0a-48f826e72c9b tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance d69bc0bc-b6e8-447b-b529-54031fc78ce1 is timed out.
Dec 05 15:21:38 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-ace46e9b-d9f1-4e95-ad0a-48f826e72c9b tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Successfully detached device vdc from instance d69bc0bc-b6e8-447b-b529-54031fc78ce1 from the live domain config.
Dec 05 15:21:38 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ace46e9b-d9f1-4e95-ad0a-48f826e72c9b tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace46e9b-d9f1-4e95-ad0a-48f826e72c9b tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JgfABlYZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:21:38 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-ace46e9b-d9f1-4e95-ad0a-48f826e72c9b tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:21:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-ace46e9b-d9f1-4e95-ad0a-48f826e72c9b tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-ace46e9b-d9f1-4e95-ad0a-48f826e72c9b tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5373f5-0bc1-460f-802f-85164763afb4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace46e9b-d9f1-4e95-ad0a-48f826e72c9b tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:21:38 user nova-compute[75080]: No targets found.
Dec 05 15:21:38 user nova-compute[75080]: iSNS:
Dec 05 15:21:38 user nova-compute[75080]: No targets found.
Dec 05 15:21:38 user nova-compute[75080]: STATIC:
Dec 05 15:21:38 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a
Dec 05 15:21:38 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:21:38 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:21:38 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece
Dec 05 15:21:38 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:21:38 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:21:38 user nova-compute[75080]: FIRMWARE:
Dec 05 15:21:38 user nova-compute[75080]: No targets found.
Dec 05 15:21:38 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace46e9b-d9f1-4e95-ad0a-48f826e72c9b tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:21:38 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:21:38 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace46e9b-d9f1-4e95-ad0a-48f826e72c9b tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[984dcce6-ee54-41e5-805b-2241d016c7cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8018b80b-9fff-4afc-a953-ed3e5f679f4c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace46e9b-d9f1-4e95-ad0a-48f826e72c9b tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a (non-flash)
Dec 05 15:21:38 user nova-compute[75080]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece (non-flash)
Dec 05 15:21:38 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace46e9b-d9f1-4e95-ad0a-48f826e72c9b tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a (non-flash)
Dec 05 15:21:38 user nova-compute[75080]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece (non-flash)
Dec 05 15:21:38 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace46e9b-d9f1-4e95-ad0a-48f826e72c9b tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f665c3d68c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece'): ({'sdb'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-ace46e9b-d9f1-4e95-ad0a-48f826e72c9b tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Removing single pathed devices sdb {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG nova.compute.manager [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:21:38 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Instance spawned successfully.
Dec 05 15:21:38 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c728a9e0-18d3-4fda-9703-2a4045685ee7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac63e8d-da7b-4db2-9349-bb8f3896d484]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-ace46e9b-d9f1-4e95-ad0a-48f826e72c9b tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Flushing IO for device /dev/sdb {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70d12b5-36c9-46d8-9a4d-dd1c31db6cfd]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-ace46e9b-d9f1-4e95-ad0a-48f826e72c9b tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[add547a2-9a36-4547-b671-1730c9dcad5c]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-ace46e9b-d9f1-4e95-ad0a-48f826e72c9b tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-ace46e9b-d9f1-4e95-ad0a-48f826e72c9b tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace46e9b-d9f1-4e95-ad0a-48f826e72c9b tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:38 user nova-compute[75080]: INFO nova.compute.manager [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Took 6.08 seconds to spawn the instance on the hypervisor.
Dec 05 15:21:38 user nova-compute[75080]: DEBUG nova.compute.manager [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d541b8c4-c54a-4230-9a76-685f80f7e5a2]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace46e9b-d9f1-4e95-ad0a-48f826e72c9b tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9caf2a04-421a-4e88-b3cd-20c81e26e6ad]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace46e9b-d9f1-4e95-ad0a-48f826e72c9b tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece, portal: 172.16.0.220,3260]
Dec 05 15:21:38 user nova-compute[75080]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece, portal: 172.16.0.220,3260] successful.
Dec 05 15:21:38 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb9f4e6b-a6c8-4bd2-9350-7e095d54fece -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e219dbfa-70df-4d8f-a2ac-4ca02cf1aa1c]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace46e9b-d9f1-4e95-ad0a-48f826e72c9b tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-ace46e9b-d9f1-4e95-ad0a-48f826e72c9b tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace46e9b-d9f1-4e95-ad0a-48f826e72c9b tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] <== disconnect_volume: return (325ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ace46e9b-d9f1-4e95-ad0a-48f826e72c9b tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:21:38 user nova-compute[75080]: INFO nova.compute.manager [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Took 8.50 seconds to build instance.
Dec 05 15:21:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9b6747d5-f0d6-4b4d-95c2-925c73b683b1 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Lock "aeb779d7-8841-4f61-bd48-2781609ae66d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.670s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG nova.compute.manager [req-cc788fc5-ecb5-43f6-a20f-8edaf9d306e2 req-ff58fa08-3b45-41c7-83b7-7a4579519865 service nova] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Received event network-vif-plugged-7189c99b-944c-4956-8d70-0c98f2ddbf22 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-cc788fc5-ecb5-43f6-a20f-8edaf9d306e2 req-ff58fa08-3b45-41c7-83b7-7a4579519865 service nova] Acquiring lock "aeb779d7-8841-4f61-bd48-2781609ae66d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-cc788fc5-ecb5-43f6-a20f-8edaf9d306e2 req-ff58fa08-3b45-41c7-83b7-7a4579519865 service nova] Lock "aeb779d7-8841-4f61-bd48-2781609ae66d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-cc788fc5-ecb5-43f6-a20f-8edaf9d306e2 req-ff58fa08-3b45-41c7-83b7-7a4579519865 service nova] Lock "aeb779d7-8841-4f61-bd48-2781609ae66d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:38 user nova-compute[75080]: DEBUG nova.compute.manager [req-cc788fc5-ecb5-43f6-a20f-8edaf9d306e2 req-ff58fa08-3b45-41c7-83b7-7a4579519865 service nova] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] No waiting events found dispatching network-vif-plugged-7189c99b-944c-4956-8d70-0c98f2ddbf22 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:21:38 user nova-compute[75080]: WARNING nova.compute.manager [req-cc788fc5-ecb5-43f6-a20f-8edaf9d306e2 req-ff58fa08-3b45-41c7-83b7-7a4579519865 service nova] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Received unexpected event network-vif-plugged-7189c99b-944c-4956-8d70-0c98f2ddbf22 for instance with vm_state active and task_state None.
Dec 05 15:21:39 user nova-compute[75080]: DEBUG nova.objects.instance [None req-ace46e9b-d9f1-4e95-ad0a-48f826e72c9b tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lazy-loading 'flavor' on Instance uuid d69bc0bc-b6e8-447b-b529-54031fc78ce1 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:21:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ace46e9b-d9f1-4e95-ad0a-48f826e72c9b tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "d69bc0bc-b6e8-447b-b529-54031fc78ce1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.894s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1b9adeb0-28be-4070-bedb-4b81c6b73c59 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Acquiring lock "1830878a-71e0-48f1-85b8-9ed83b1419cd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1b9adeb0-28be-4070-bedb-4b81c6b73c59 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Lock "1830878a-71e0-48f1-85b8-9ed83b1419cd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1b9adeb0-28be-4070-bedb-4b81c6b73c59 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Acquiring lock "1830878a-71e0-48f1-85b8-9ed83b1419cd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1b9adeb0-28be-4070-bedb-4b81c6b73c59 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Lock "1830878a-71e0-48f1-85b8-9ed83b1419cd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1b9adeb0-28be-4070-bedb-4b81c6b73c59 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Lock "1830878a-71e0-48f1-85b8-9ed83b1419cd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:57 user nova-compute[75080]: INFO nova.compute.manager [None req-1b9adeb0-28be-4070-bedb-4b81c6b73c59 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Terminating instance
Dec 05 15:21:57 user nova-compute[75080]: DEBUG nova.compute.manager [None req-1b9adeb0-28be-4070-bedb-4b81c6b73c59 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:21:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:58 user nova-compute[75080]: DEBUG nova.compute.manager [req-26aca516-a934-48d8-a585-2675d52fdf43 req-df48e511-8610-4d16-96fd-5ab48bb9c100 service nova] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Received event network-vif-unplugged-fe1ce7fc-22e0-4814-b15f-c3e9f82574b6 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:21:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-26aca516-a934-48d8-a585-2675d52fdf43 req-df48e511-8610-4d16-96fd-5ab48bb9c100 service nova] Acquiring lock "1830878a-71e0-48f1-85b8-9ed83b1419cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-26aca516-a934-48d8-a585-2675d52fdf43 req-df48e511-8610-4d16-96fd-5ab48bb9c100 service nova] Lock "1830878a-71e0-48f1-85b8-9ed83b1419cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:21:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-26aca516-a934-48d8-a585-2675d52fdf43 req-df48e511-8610-4d16-96fd-5ab48bb9c100 service nova] Lock "1830878a-71e0-48f1-85b8-9ed83b1419cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:21:58 user nova-compute[75080]: DEBUG nova.compute.manager [req-26aca516-a934-48d8-a585-2675d52fdf43 req-df48e511-8610-4d16-96fd-5ab48bb9c100 service nova] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] No waiting events found dispatching network-vif-unplugged-fe1ce7fc-22e0-4814-b15f-c3e9f82574b6 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:21:58 user nova-compute[75080]: DEBUG nova.compute.manager [req-26aca516-a934-48d8-a585-2675d52fdf43 req-df48e511-8610-4d16-96fd-5ab48bb9c100 service nova] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Received event network-vif-unplugged-fe1ce7fc-22e0-4814-b15f-c3e9f82574b6 for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:21:58 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Instance destroyed successfully.
Dec 05 15:21:58 user nova-compute[75080]: DEBUG nova.objects.instance [None req-1b9adeb0-28be-4070-bedb-4b81c6b73c59 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Lazy-loading 'resources' on Instance uuid 1830878a-71e0-48f1-85b8-9ed83b1419cd {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:21:58 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-1b9adeb0-28be-4070-bedb-4b81c6b73c59 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-608458288',display_name='tempest-TestVolumeSwap-server-608458288',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-608458288',id=6,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4nKWT3kevLDzIEOokPsLWwjhxX/4JanSvTEXO4JVpCAZWeY9fq6fKYuCeo/fldiGMQ7P6pnqVv8PFcaH7ofpBcb2B6GGN33n4/haaH0wEbDn6b0etg+9HrPw7iWmOHFw==',key_name='tempest-keypair-948032841',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:18:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e445361a61f44659ba229fd8c053d736',ramdisk_id='',reservation_id='r-dj7hd7xv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1634269124',owner_user_name='tempest-TestVolumeSwap-1634269124-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:18:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0ac495788b648378f17f70d42727ced',uuid=1830878a-71e0-48f1-85b8-9ed83b1419cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe1ce7fc-22e0-4814-b15f-c3e9f82574b6", "address": "fa:16:3e:ad:48:50", "network": {"id": "ab471423-0f49-4695-a2d0-76abb88aec8e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-408483206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e445361a61f44659ba229fd8c053d736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1ce7fc-22", "ovs_interfaceid": "fe1ce7fc-22e0-4814-b15f-c3e9f82574b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:21:58 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-1b9adeb0-28be-4070-bedb-4b81c6b73c59 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Converting VIF {"id": "fe1ce7fc-22e0-4814-b15f-c3e9f82574b6", "address": "fa:16:3e:ad:48:50", "network": {"id": "ab471423-0f49-4695-a2d0-76abb88aec8e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-408483206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e445361a61f44659ba229fd8c053d736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1ce7fc-22", "ovs_interfaceid": "fe1ce7fc-22e0-4814-b15f-c3e9f82574b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:21:58 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-1b9adeb0-28be-4070-bedb-4b81c6b73c59 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:48:50,bridge_name='br-int',has_traffic_filtering=True,id=fe1ce7fc-22e0-4814-b15f-c3e9f82574b6,network=Network(ab471423-0f49-4695-a2d0-76abb88aec8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe1ce7fc-22') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:21:58 user nova-compute[75080]: DEBUG os_vif [None req-1b9adeb0-28be-4070-bedb-4b81c6b73c59 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:48:50,bridge_name='br-int',has_traffic_filtering=True,id=fe1ce7fc-22e0-4814-b15f-c3e9f82574b6,network=Network(ab471423-0f49-4695-a2d0-76abb88aec8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe1ce7fc-22') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:21:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe1ce7fc-22, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:21:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:21:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d9dad0d2-079f-4a5b-8565-0ad164c0e756) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:21:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:21:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:21:58 user nova-compute[75080]: INFO os_vif [None req-1b9adeb0-28be-4070-bedb-4b81c6b73c59 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:48:50,bridge_name='br-int',has_traffic_filtering=True,id=fe1ce7fc-22e0-4814-b15f-c3e9f82574b6,network=Network(ab471423-0f49-4695-a2d0-76abb88aec8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe1ce7fc-22')
Dec 05 15:21:58 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-1b9adeb0-28be-4070-bedb-4b81c6b73c59 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Deleting instance files /opt/stack/data/nova/instances/1830878a-71e0-48f1-85b8-9ed83b1419cd_del
Dec 05 15:21:58 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-1b9adeb0-28be-4070-bedb-4b81c6b73c59 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Deletion of /opt/stack/data/nova/instances/1830878a-71e0-48f1-85b8-9ed83b1419cd_del complete
Dec 05 15:21:58 user nova-compute[75080]: INFO nova.compute.manager [None req-1b9adeb0-28be-4070-bedb-4b81c6b73c59 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Took 0.90 seconds to destroy the instance on the hypervisor.
Dec 05 15:21:58 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-1b9adeb0-28be-4070-bedb-4b81c6b73c59 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:21:58 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:21:58 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:21:59 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:21:59 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Took 0.96 seconds to deallocate network for instance.
Dec 05 15:21:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1b9adeb0-28be-4070-bedb-4b81c6b73c59 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:21:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1b9adeb0-28be-4070-bedb-4b81c6b73c59 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:22:00 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-1b9adeb0-28be-4070-bedb-4b81c6b73c59 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:22:00 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-1b9adeb0-28be-4070-bedb-4b81c6b73c59 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:22:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1b9adeb0-28be-4070-bedb-4b81c6b73c59 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:22:00 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-1b9adeb0-28be-4070-bedb-4b81c6b73c59 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Deleted allocations for instance 1830878a-71e0-48f1-85b8-9ed83b1419cd
Dec 05 15:22:00 user nova-compute[75080]: DEBUG nova.compute.manager [req-7b2ad669-6446-4071-b01a-53d26ab7b6d3 req-656d9a1d-b27e-4c30-99f3-010a0450093d service nova] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Received event network-vif-plugged-fe1ce7fc-22e0-4814-b15f-c3e9f82574b6 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:22:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7b2ad669-6446-4071-b01a-53d26ab7b6d3 req-656d9a1d-b27e-4c30-99f3-010a0450093d service nova] Acquiring lock "1830878a-71e0-48f1-85b8-9ed83b1419cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:22:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7b2ad669-6446-4071-b01a-53d26ab7b6d3 req-656d9a1d-b27e-4c30-99f3-010a0450093d service nova] Lock "1830878a-71e0-48f1-85b8-9ed83b1419cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:22:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7b2ad669-6446-4071-b01a-53d26ab7b6d3 req-656d9a1d-b27e-4c30-99f3-010a0450093d service nova] Lock "1830878a-71e0-48f1-85b8-9ed83b1419cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:22:00 user nova-compute[75080]: DEBUG nova.compute.manager [req-7b2ad669-6446-4071-b01a-53d26ab7b6d3 req-656d9a1d-b27e-4c30-99f3-010a0450093d service nova] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] No waiting events found dispatching network-vif-plugged-fe1ce7fc-22e0-4814-b15f-c3e9f82574b6 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:22:00 user nova-compute[75080]: WARNING nova.compute.manager [req-7b2ad669-6446-4071-b01a-53d26ab7b6d3 req-656d9a1d-b27e-4c30-99f3-010a0450093d service nova] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Received unexpected event network-vif-plugged-fe1ce7fc-22e0-4814-b15f-c3e9f82574b6 for instance with vm_state deleted and task_state None.
Dec 05 15:22:00 user nova-compute[75080]: DEBUG nova.compute.manager [req-7b2ad669-6446-4071-b01a-53d26ab7b6d3 req-656d9a1d-b27e-4c30-99f3-010a0450093d service nova] [instance: 1830878a-71e0-48f1-85b8-9ed83b1419cd] Received event network-vif-deleted-fe1ce7fc-22e0-4814-b15f-c3e9f82574b6 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:22:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1b9adeb0-28be-4070-bedb-4b81c6b73c59 tempest-TestVolumeSwap-1634269124 tempest-TestVolumeSwap-1634269124-project-member] Lock "1830878a-71e0-48f1-85b8-9ed83b1419cd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.520s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:22:01 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:06 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2fe4b376-0f32-4e20-b044-f9fe7e61f370 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Acquiring lock "d69bc0bc-b6e8-447b-b529-54031fc78ce1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:22:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2fe4b376-0f32-4e20-b044-f9fe7e61f370 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "d69bc0bc-b6e8-447b-b529-54031fc78ce1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.004s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:22:08 user nova-compute[75080]: INFO nova.compute.manager [None req-2fe4b376-0f32-4e20-b044-f9fe7e61f370 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Detaching volume 953c464d-b8f7-42c1-a489-f1573851a20a
Dec 05 15:22:08 user nova-compute[75080]: INFO nova.virt.block_device [None req-2fe4b376-0f32-4e20-b044-f9fe7e61f370 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Attempting to driver detach volume 953c464d-b8f7-42c1-a489-f1573851a20a from mountpoint /dev/vdb
Dec 05 15:22:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2fe4b376-0f32-4e20-b044-f9fe7e61f370 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Attempting to detach device vdb from instance d69bc0bc-b6e8-447b-b529-54031fc78ce1 from the persistent domain config. {{(pid=75080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 15:22:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-2fe4b376-0f32-4e20-b044-f9fe7e61f370 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:22:08 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:22:08 user nova-compute[75080]:   <source dev="/dev/sdd"/>
Dec 05 15:22:08 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:22:08 user nova-compute[75080]:   <serial>953c464d-b8f7-42c1-a489-f1573851a20a</serial>
Dec 05 15:22:08 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 15:22:08 user nova-compute[75080]: </disk>
Dec 05 15:22:08 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:22:08 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-2fe4b376-0f32-4e20-b044-f9fe7e61f370 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Successfully detached device vdb from instance d69bc0bc-b6e8-447b-b529-54031fc78ce1 from the persistent domain config.
Dec 05 15:22:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2fe4b376-0f32-4e20-b044-f9fe7e61f370 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d69bc0bc-b6e8-447b-b529-54031fc78ce1 from the live domain config. {{(pid=75080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 15:22:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-2fe4b376-0f32-4e20-b044-f9fe7e61f370 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:22:08 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:22:08 user nova-compute[75080]:   <source dev="/dev/sdd"/>
Dec 05 15:22:08 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:22:08 user nova-compute[75080]:   <serial>953c464d-b8f7-42c1-a489-f1573851a20a</serial>
Dec 05 15:22:08 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 15:22:08 user nova-compute[75080]: </disk>
Dec 05 15:22:08 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:22:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2fe4b376-0f32-4e20-b044-f9fe7e61f370 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d69bc0bc-b6e8-447b-b529-54031fc78ce1 {{(pid=75080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 15:22:11 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:15 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "607acee2-b585-43d2-a897-eca4983d62db" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:22:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "607acee2-b585-43d2-a897-eca4983d62db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:22:20 user nova-compute[75080]: DEBUG nova.compute.manager [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:22:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:22:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:22:20 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:22:20 user nova-compute[75080]: INFO nova.compute.claims [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Claim successful on node user
Dec 05 15:22:20 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:22:20 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:22:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:22:20 user nova-compute[75080]: DEBUG nova.compute.manager [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:22:20 user nova-compute[75080]: DEBUG nova.compute.manager [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:22:20 user nova-compute[75080]: DEBUG nova.network.neutron [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:22:20 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:22:20 user nova-compute[75080]: DEBUG nova.compute.manager [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:22:21 user nova-compute[75080]: INFO nova.virt.block_device [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Booting with volume 5b948b23-bb33-4107-9e97-aad44fb22598 at /dev/vda
Dec 05 15:22:21 user nova-compute[75080]: DEBUG os_brick.utils [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:22:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:21 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d09944-7063-4963-b525-e1d760920e9e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:22:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:21 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c4ae4a-fe8e-4622-bfc0-d4d5f8becee1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:22:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:21 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c787bda-417d-4de1-80b1-32c20fcd1118]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:22:21 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee35eabc-06e2-4746-b780-a9a78f6d2b25]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:22:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:22:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:22:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:22:21 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:22:21 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d71031e-3496-4d41-abcf-627c90d8c723]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:22:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:22:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:22:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:22:21 user nova-compute[75080]: DEBUG os_brick.utils [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:22:21 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Updating existing volume attachment record: f05413d0-dfdb-408f-9d6d-28382940a393 {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:22:21 user nova-compute[75080]: DEBUG nova.policy [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '15be5b54cc8346bb86683e4ed2fbba9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11227acd507347ae9c5a3bc710707f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:22:22 user nova-compute[75080]: DEBUG nova.network.neutron [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Successfully created port: 5979a08d-6941-4e54-9f0f-a6aa1af07de8 {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:22:23 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:22:23 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:22:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:24 user nova-compute[75080]: DEBUG nova.network.neutron [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Successfully updated port: 5979a08d-6941-4e54-9f0f-a6aa1af07de8 {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:22:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "refresh_cache-607acee2-b585-43d2-a897-eca4983d62db" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:22:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquired lock "refresh_cache-607acee2-b585-43d2-a897-eca4983d62db" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:22:24 user nova-compute[75080]: DEBUG nova.network.neutron [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:22:24 user nova-compute[75080]: DEBUG nova.compute.manager [req-c8965c19-7395-4130-9700-908e8c11b12e req-fb2cc27d-cf78-4651-87a5-5ee3d59d07d1 service nova] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Received event network-changed-5979a08d-6941-4e54-9f0f-a6aa1af07de8 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:22:24 user nova-compute[75080]: DEBUG nova.compute.manager [req-c8965c19-7395-4130-9700-908e8c11b12e req-fb2cc27d-cf78-4651-87a5-5ee3d59d07d1 service nova] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Refreshing instance network info cache due to event network-changed-5979a08d-6941-4e54-9f0f-a6aa1af07de8. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:22:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c8965c19-7395-4130-9700-908e8c11b12e req-fb2cc27d-cf78-4651-87a5-5ee3d59d07d1 service nova] Acquiring lock "refresh_cache-607acee2-b585-43d2-a897-eca4983d62db" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:22:24 user nova-compute[75080]: DEBUG nova.network.neutron [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:22:24 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:22:24 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:22:24 user nova-compute[75080]: DEBUG nova.network.neutron [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Updating instance_info_cache with network_info: [{"id": "5979a08d-6941-4e54-9f0f-a6aa1af07de8", "address": "fa:16:3e:94:6b:4c", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5979a08d-69", "ovs_interfaceid": "5979a08d-6941-4e54-9f0f-a6aa1af07de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:22:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Releasing lock "refresh_cache-607acee2-b585-43d2-a897-eca4983d62db" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:22:25 user nova-compute[75080]: DEBUG nova.compute.manager [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Instance network_info: |[{"id": "5979a08d-6941-4e54-9f0f-a6aa1af07de8", "address": "fa:16:3e:94:6b:4c", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5979a08d-69", "ovs_interfaceid": "5979a08d-6941-4e54-9f0f-a6aa1af07de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:22:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c8965c19-7395-4130-9700-908e8c11b12e req-fb2cc27d-cf78-4651-87a5-5ee3d59d07d1 service nova] Acquired lock "refresh_cache-607acee2-b585-43d2-a897-eca4983d62db" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:22:25 user nova-compute[75080]: DEBUG nova.network.neutron [req-c8965c19-7395-4130-9700-908e8c11b12e req-fb2cc27d-cf78-4651-87a5-5ee3d59d07d1 service nova] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Refreshing network info cache for port 5979a08d-6941-4e54-9f0f-a6aa1af07de8 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:22:25 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:22:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:22:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.004s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:22:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:22:25 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:22:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:26 user nova-compute[75080]: DEBUG nova.network.neutron [req-c8965c19-7395-4130-9700-908e8c11b12e req-fb2cc27d-cf78-4651-87a5-5ee3d59d07d1 service nova] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Updated VIF entry in instance network info cache for port 5979a08d-6941-4e54-9f0f-a6aa1af07de8. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:22:26 user nova-compute[75080]: DEBUG nova.network.neutron [req-c8965c19-7395-4130-9700-908e8c11b12e req-fb2cc27d-cf78-4651-87a5-5ee3d59d07d1 service nova] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Updating instance_info_cache with network_info: [{"id": "5979a08d-6941-4e54-9f0f-a6aa1af07de8", "address": "fa:16:3e:94:6b:4c", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5979a08d-69", "ovs_interfaceid": "5979a08d-6941-4e54-9f0f-a6aa1af07de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:22:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c8965c19-7395-4130-9700-908e8c11b12e req-fb2cc27d-cf78-4651-87a5-5ee3d59d07d1 service nova] Releasing lock "refresh_cache-607acee2-b585-43d2-a897-eca4983d62db" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:22:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69bc0bc-b6e8-447b-b529-54031fc78ce1/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69bc0bc-b6e8-447b-b529-54031fc78ce1/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69bc0bc-b6e8-447b-b529-54031fc78ce1/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69bc0bc-b6e8-447b-b529-54031fc78ce1/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb779d7-8841-4f61-bd48-2781609ae66d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb779d7-8841-4f61-bd48-2781609ae66d/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb779d7-8841-4f61-bd48-2781609ae66d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb779d7-8841-4f61-bd48-2781609ae66d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30a4dd31-76bf-497e-b0d0-82bd70940e6c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30a4dd31-76bf-497e-b0d0-82bd70940e6c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30a4dd31-76bf-497e-b0d0-82bd70940e6c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30a4dd31-76bf-497e-b0d0-82bd70940e6c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:29 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-2fe4b376-0f32-4e20-b044-f9fe7e61f370 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d69bc0bc-b6e8-447b-b529-54031fc78ce1 is timed out.
Dec 05 15:22:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:22:29 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-2fe4b376-0f32-4e20-b044-f9fe7e61f370 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Successfully detached device vdb from instance d69bc0bc-b6e8-447b-b529-54031fc78ce1 from the live domain config.
Dec 05 15:22:29 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:22:29 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:22:29 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=7934MB free_disk=25.46670913696289GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fe4b376-0f32-4e20-b044-f9fe7e61f370 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe4b376-0f32-4e20-b044-f9fe7e61f370 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WwcFtnfv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:22:29 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-2fe4b376-0f32-4e20-b044-f9fe7e61f370 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:22:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-2fe4b376-0f32-4e20-b044-f9fe7e61f370 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-2fe4b376-0f32-4e20-b044-f9fe7e61f370 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c97f24-7fbc-43af-a816-9582295d6c26]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe4b376-0f32-4e20-b044-f9fe7e61f370 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:22:29 user nova-compute[75080]: No targets found.
Dec 05 15:22:29 user nova-compute[75080]: iSNS:
Dec 05 15:22:29 user nova-compute[75080]: No targets found.
Dec 05 15:22:29 user nova-compute[75080]: STATIC:
Dec 05 15:22:29 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a
Dec 05 15:22:29 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:22:29 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:22:29 user nova-compute[75080]: FIRMWARE:
Dec 05 15:22:29 user nova-compute[75080]: No targets found.
Dec 05 15:22:29 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe4b376-0f32-4e20-b044-f9fe7e61f370 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:22:29 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:22:29 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe4b376-0f32-4e20-b044-f9fe7e61f370 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[87dfc812-36b0-488f-a415-60e52e6b4307]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4263d122-3e43-4100-9566-2ee6575e2e13]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe4b376-0f32-4e20-b044-f9fe7e61f370 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a (non-flash)
Dec 05 15:22:29 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe4b376-0f32-4e20-b044-f9fe7e61f370 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a (non-flash)
Dec 05 15:22:29 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe4b376-0f32-4e20-b044-f9fe7e61f370 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f665c5c97e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a'): ({'sdd'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-2fe4b376-0f32-4e20-b044-f9fe7e61f370 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Removing single pathed devices sdd {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1061d1b4-f38b-4700-8bd0-6cb91c083a47]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance bd75375a-8b70-4bc2-a72b-14213ebaa4e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance eedd1529-4feb-4f85-8625-0c20d8e0359d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance d69bc0bc-b6e8-447b-b529-54031fc78ce1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 30a4dd31-76bf-497e-b0d0-82bd70940e6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 5e29bda9-f1d6-4951-9343-f189934a8a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance aeb779d7-8841-4f61-bd48-2781609ae66d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 607acee2-b585-43d2-a897-eca4983d62db actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61a3f6a-6134-4a3d-9c30-e13186d92655]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-2fe4b376-0f32-4e20-b044-f9fe7e61f370 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Flushing IO for device /dev/sdd {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d3a043-366e-4a88-8518-14c9359d3578]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-2fe4b376-0f32-4e20-b044-f9fe7e61f370 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7486e91-eccd-481f-b21c-f81e513f35ec]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-2fe4b376-0f32-4e20-b044-f9fe7e61f370 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-2fe4b376-0f32-4e20-b044-f9fe7e61f370 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] SCSI volumes sdd have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe4b376-0f32-4e20-b044-f9fe7e61f370 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef5a9c3-073f-4289-8a46-0c2213957522]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe4b376-0f32-4e20-b044-f9fe7e61f370 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[203535b6-716c-4ce6-8985-20536ec9003b]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe4b376-0f32-4e20-b044-f9fe7e61f370 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a, portal: 172.16.0.220,3260]
Dec 05 15:22:29 user nova-compute[75080]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a, portal: 172.16.0.220,3260] successful.
Dec 05 15:22:29 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:953c464d-b8f7-42c1-a489-f1573851a20a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c66223-f0e4-40b2-85d9-a9ac7302f6eb]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe4b376-0f32-4e20-b044-f9fe7e61f370 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-2fe4b376-0f32-4e20-b044-f9fe7e61f370 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe4b376-0f32-4e20-b044-f9fe7e61f370 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] <== disconnect_volume: return (316ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fe4b376-0f32-4e20-b044-f9fe7e61f370 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:22:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.496s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:22:30 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:22:30 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:22:30 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:22:30 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Didn't find any instances for network info cache update. {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 15:22:30 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:22:30 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:22:30 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:22:30 user nova-compute[75080]: DEBUG nova.objects.instance [None req-2fe4b376-0f32-4e20-b044-f9fe7e61f370 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lazy-loading 'flavor' on Instance uuid d69bc0bc-b6e8-447b-b529-54031fc78ce1 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:22:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2fe4b376-0f32-4e20-b044-f9fe7e61f370 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "d69bc0bc-b6e8-447b-b529-54031fc78ce1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.382s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:22:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Acquiring lock "412e1e40-082a-429e-9d35-013b72322761" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:22:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "412e1e40-082a-429e-9d35-013b72322761" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:22:32 user nova-compute[75080]: DEBUG nova.compute.manager [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:22:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:22:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:22:32 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:22:32 user nova-compute[75080]: INFO nova.compute.claims [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Claim successful on node user
Dec 05 15:22:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:33 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:22:33 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:22:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.502s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:22:33 user nova-compute[75080]: DEBUG nova.compute.manager [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:22:33 user nova-compute[75080]: DEBUG nova.compute.manager [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:22:33 user nova-compute[75080]: DEBUG nova.network.neutron [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:22:33 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:22:33 user nova-compute[75080]: DEBUG nova.compute.manager [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:22:33 user nova-compute[75080]: DEBUG nova.policy [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '512e60f95c314913959f037132353c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00d040579ca46338e01b8110a0ebc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:22:33 user nova-compute[75080]: DEBUG nova.compute.manager [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:22:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:22:33 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Creating image(s)
Dec 05 15:22:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Acquiring lock "/opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:22:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "/opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:22:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "/opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:22:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.193s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:22:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:22:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.206s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk 1073741824" returned: 0 in 0.061s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:22:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.197s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:34 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Checking if we can resize image /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 15:22:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:34 user nova-compute[75080]: DEBUG nova.network.neutron [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Successfully created port: 78547a5f-e10d-4a62-8d35-5584ce87d2c5 {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:22:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:34 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Cannot resize image /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 15:22:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:22:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Ensure instance console log exists: /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:22:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:22:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:22:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:22:34 user nova-compute[75080]: DEBUG nova.compute.manager [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:22:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:22:34 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Creating image(s)
Dec 05 15:22:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Did not create local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 05 15:22:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Ensure instance console log exists: /opt/stack/data/nova/instances/607acee2-b585-43d2-a897-eca4983d62db/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:22:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:22:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:22:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:22:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Start _get_guest_xml network_info=[{"id": "5979a08d-6941-4e54-9f0f-a6aa1af07de8", "address": "fa:16:3e:94:6b:4c", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5979a08d-69", "ovs_interfaceid": "5979a08d-6941-4e54-9f0f-a6aa1af07de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UyWpYcnM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '607acee2-b585-43d2-a897-eca4983d62db', 'attached_at': '', 'detached_at': '', 'volume_id': '5b948b23-bb33-4107-9e97-aad44fb22598', 'serial': '5b948b23-bb33-4107-9e97-aad44fb22598'}, 'device_type': 'disk', 'attachment_id': 'f05413d0-dfdb-408f-9d6d-28382940a393', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:22:34 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:22:34 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:22:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:22:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:22:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:22:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:22:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:22:34 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:22:34 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:22:34 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:22:34 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:22:34 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:22:34 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:22:34 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UyWpYcnM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:22:35 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:22:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:22:35 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:22:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:22:35 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:22:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0d6bff-3d59-4fab-b2a8-5d00fdaf92e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:22:35 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[42adbb9f-1b49-4990-bfc1-056e3ab0b18b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598] added
Dec 05 15:22:35 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e08bb5d-c6cc-4510-b6ed-589411221b9a]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e6ee92-365e-4d96-a93f-502f5715a176]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UyWpYcnM {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UyWpYcnM" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd33c96-8216-48f4-9963-866b084c3a79]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UyWpYcnM'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4441821-8d74-4018-b875-a5f347550f6d]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9ca57c-81a5-4aa1-b8a0-34d54fb0b361]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 05 15:22:35 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 05 15:22:35 user nova-compute[75080]:  {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:22:35 user nova-compute[75080]: WARNING os_brick.initiator.connectors.iscsi [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 05 15:22:35 user nova-compute[75080]: 
Dec 05 15:22:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a8923b-ba21-4e6d-af53-1f1b8f97cccf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598, portal: 172.16.0.220,3260]
Dec 05 15:22:35 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598, portal: 172.16.0.220,3260] successful.
Dec 05 15:22:35 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c60a04-8fc2-43ad-a329-78f8e1a56b4b]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2184eada-c72d-4993-99f7-dae08ac46acf]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:22:35 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:22:35 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[27eb040a-26c1-48f7-8351-220f8b3cfaa0]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UyWpYcnM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG nova.network.neutron [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Successfully updated port: 78547a5f-e10d-4a62-8d35-5584ce87d2c5 {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Acquiring lock "refresh_cache-412e1e40-082a-429e-9d35-013b72322761" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Acquired lock "refresh_cache-412e1e40-082a-429e-9d35-013b72322761" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG nova.network.neutron [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG nova.compute.manager [req-e62553c6-d630-48bf-8aed-7391a8b344c0 req-f713efe2-c955-4b4b-a472-4c6fb05f2077 service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] Received event network-changed-78547a5f-e10d-4a62-8d35-5584ce87d2c5 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG nova.compute.manager [req-e62553c6-d630-48bf-8aed-7391a8b344c0 req-f713efe2-c955-4b4b-a472-4c6fb05f2077 service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] Refreshing instance network info cache due to event network-changed-78547a5f-e10d-4a62-8d35-5584ce87d2c5. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-e62553c6-d630-48bf-8aed-7391a8b344c0 req-f713efe2-c955-4b4b-a472-4c6fb05f2077 service nova] Acquiring lock "refresh_cache-412e1e40-082a-429e-9d35-013b72322761" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:22:35 user nova-compute[75080]: DEBUG nova.network.neutron [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.network.neutron [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Updating instance_info_cache with network_info: [{"id": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "address": "fa:16:3e:ab:04:37", "network": {"id": "3f7b7f16-6cc0-45b9-9f9c-efd112a71092", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-47517680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00d040579ca46338e01b8110a0ebc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78547a5f-e1", "ovs_interfaceid": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Releasing lock "refresh_cache-412e1e40-082a-429e-9d35-013b72322761" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.compute.manager [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Instance network_info: |[{"id": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "address": "fa:16:3e:ab:04:37", "network": {"id": "3f7b7f16-6cc0-45b9-9f9c-efd112a71092", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-47517680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00d040579ca46338e01b8110a0ebc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78547a5f-e1", "ovs_interfaceid": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-e62553c6-d630-48bf-8aed-7391a8b344c0 req-f713efe2-c955-4b4b-a472-4c6fb05f2077 service nova] Acquired lock "refresh_cache-412e1e40-082a-429e-9d35-013b72322761" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.network.neutron [req-e62553c6-d630-48bf-8aed-7391a8b344c0 req-f713efe2-c955-4b4b-a472-4c6fb05f2077 service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] Refreshing network info cache for port 78547a5f-e10d-4a62-8d35-5584ce87d2c5 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Start _get_guest_xml network_info=[{"id": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "address": "fa:16:3e:ab:04:37", "network": {"id": "3f7b7f16-6cc0-45b9-9f9c-efd112a71092", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-47517680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00d040579ca46338e01b8110a0ebc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78547a5f-e1", "ovs_interfaceid": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:22:36 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:22:36 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:22:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1475628522',display_name='tempest-ServerActionsTestOtherB-server-1475628522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1475628522',id=17,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwmHJwK89ZUQ4UynGDWrkxG5H0hE1b2MJmPt/rTqIdK43uWLaFbVA/0/Nip6RjSnsKkWhAWpaEvyfqDY42bj2ESHH8OvSzPeboVnwtrtWSkYdz3jR4YJhIMViK+6gUdwg==',key_name='tempest-keypair-508009308',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c00d040579ca46338e01b8110a0ebc05',ramdisk_id='',reservation_id='r-col74in8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1903161286',owner_user_name='tempest-ServerActionsTestOtherB-1903161286-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:22:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='512e60f95c314913959f037132353c9e',uuid=412e1e40-082a-429e-9d35-013b72322761,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "address": "fa:16:3e:ab:04:37", "network": {"id": "3f7b7f16-6cc0-45b9-9f9c-efd112a71092", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-47517680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00d040579ca46338e01b8110a0ebc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78547a5f-e1", "ovs_interfaceid": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Converting VIF {"id": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "address": "fa:16:3e:ab:04:37", "network": {"id": "3f7b7f16-6cc0-45b9-9f9c-efd112a71092", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-47517680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00d040579ca46338e01b8110a0ebc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78547a5f-e1", "ovs_interfaceid": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:04:37,bridge_name='br-int',has_traffic_filtering=True,id=78547a5f-e10d-4a62-8d35-5584ce87d2c5,network=Network(3f7b7f16-6cc0-45b9-9f9c-efd112a71092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78547a5f-e1') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.objects.instance [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lazy-loading 'pci_devices' on Instance uuid 412e1e40-082a-429e-9d35-013b72322761 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:22:36 user nova-compute[75080]:   <uuid>412e1e40-082a-429e-9d35-013b72322761</uuid>
Dec 05 15:22:36 user nova-compute[75080]:   <name>instance-00000011</name>
Dec 05 15:22:36 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:22:36 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:22:36 user nova-compute[75080]:   <metadata>
Dec 05 15:22:36 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:22:36 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:22:36 user nova-compute[75080]:       <nova:name>tempest-ServerActionsTestOtherB-server-1475628522</nova:name>
Dec 05 15:22:36 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:22:36</nova:creationTime>
Dec 05 15:22:36 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:22:36 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:22:36 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:22:36 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:22:36 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:22:36 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:22:36 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:22:36 user nova-compute[75080]:       <nova:owner>
Dec 05 15:22:36 user nova-compute[75080]:         <nova:user uuid="512e60f95c314913959f037132353c9e">tempest-ServerActionsTestOtherB-1903161286-project-member</nova:user>
Dec 05 15:22:36 user nova-compute[75080]:         <nova:project uuid="c00d040579ca46338e01b8110a0ebc05">tempest-ServerActionsTestOtherB-1903161286</nova:project>
Dec 05 15:22:36 user nova-compute[75080]:       </nova:owner>
Dec 05 15:22:36 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:22:36 user nova-compute[75080]:       <nova:ports>
Dec 05 15:22:36 user nova-compute[75080]:         <nova:port uuid="78547a5f-e10d-4a62-8d35-5584ce87d2c5">
Dec 05 15:22:36 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 05 15:22:36 user nova-compute[75080]:         </nova:port>
Dec 05 15:22:36 user nova-compute[75080]:       </nova:ports>
Dec 05 15:22:36 user nova-compute[75080]:     </nova:instance>
Dec 05 15:22:36 user nova-compute[75080]:   </metadata>
Dec 05 15:22:36 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:22:36 user nova-compute[75080]:     <system>
Dec 05 15:22:36 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:22:36 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:22:36 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:22:36 user nova-compute[75080]:       <entry name="serial">412e1e40-082a-429e-9d35-013b72322761</entry>
Dec 05 15:22:36 user nova-compute[75080]:       <entry name="uuid">412e1e40-082a-429e-9d35-013b72322761</entry>
Dec 05 15:22:36 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:22:36 user nova-compute[75080]:     </system>
Dec 05 15:22:36 user nova-compute[75080]:   </sysinfo>
Dec 05 15:22:36 user nova-compute[75080]:   <os>
Dec 05 15:22:36 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:22:36 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:22:36 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:22:36 user nova-compute[75080]:   </os>
Dec 05 15:22:36 user nova-compute[75080]:   <features>
Dec 05 15:22:36 user nova-compute[75080]:     <acpi/>
Dec 05 15:22:36 user nova-compute[75080]:     <apic/>
Dec 05 15:22:36 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:22:36 user nova-compute[75080]:   </features>
Dec 05 15:22:36 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:22:36 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:22:36 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:22:36 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:22:36 user nova-compute[75080]:   </clock>
Dec 05 15:22:36 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:22:36 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:22:36 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:22:36 user nova-compute[75080]:   </cpu>
Dec 05 15:22:36 user nova-compute[75080]:   <devices>
Dec 05 15:22:36 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:22:36 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:22:36 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk"/>
Dec 05 15:22:36 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:22:36 user nova-compute[75080]:     </disk>
Dec 05 15:22:36 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:22:36 user nova-compute[75080]:       <mac address="fa:16:3e:ab:04:37"/>
Dec 05 15:22:36 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:22:36 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:22:36 user nova-compute[75080]:       <target dev="tap78547a5f-e1"/>
Dec 05 15:22:36 user nova-compute[75080]:     </interface>
Dec 05 15:22:36 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:22:36 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/console.log" append="off"/>
Dec 05 15:22:36 user nova-compute[75080]:     </serial>
Dec 05 15:22:36 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:22:36 user nova-compute[75080]:     <video>
Dec 05 15:22:36 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:22:36 user nova-compute[75080]:     </video>
Dec 05 15:22:36 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:22:36 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:22:36 user nova-compute[75080]:     </rng>
Dec 05 15:22:36 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:22:36 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:22:36 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:22:36 user nova-compute[75080]:     </memballoon>
Dec 05 15:22:36 user nova-compute[75080]:   </devices>
Dec 05 15:22:36 user nova-compute[75080]: </domain>
Dec 05 15:22:36 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:22:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1475628522',display_name='tempest-ServerActionsTestOtherB-server-1475628522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1475628522',id=17,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwmHJwK89ZUQ4UynGDWrkxG5H0hE1b2MJmPt/rTqIdK43uWLaFbVA/0/Nip6RjSnsKkWhAWpaEvyfqDY42bj2ESHH8OvSzPeboVnwtrtWSkYdz3jR4YJhIMViK+6gUdwg==',key_name='tempest-keypair-508009308',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c00d040579ca46338e01b8110a0ebc05',ramdisk_id='',reservation_id='r-col74in8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1903161286',owner_user_name='tempest-ServerActionsTestOtherB-1903161286-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:22:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='512e60f95c314913959f037132353c9e',uuid=412e1e40-082a-429e-9d35-013b72322761,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "address": "fa:16:3e:ab:04:37", "network": {"id": "3f7b7f16-6cc0-45b9-9f9c-efd112a71092", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-47517680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00d040579ca46338e01b8110a0ebc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78547a5f-e1", "ovs_interfaceid": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Converting VIF {"id": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "address": "fa:16:3e:ab:04:37", "network": {"id": "3f7b7f16-6cc0-45b9-9f9c-efd112a71092", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-47517680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00d040579ca46338e01b8110a0ebc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78547a5f-e1", "ovs_interfaceid": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:04:37,bridge_name='br-int',has_traffic_filtering=True,id=78547a5f-e10d-4a62-8d35-5584ce87d2c5,network=Network(3f7b7f16-6cc0-45b9-9f9c-efd112a71092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78547a5f-e1') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG os_vif [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:04:37,bridge_name='br-int',has_traffic_filtering=True,id=78547a5f-e10d-4a62-8d35-5584ce87d2c5,network=Network(3f7b7f16-6cc0-45b9-9f9c-efd112a71092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78547a5f-e1') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '41ed10b0-ba5b-52f0-a9c7-7087de9df1c3', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78547a5f-e1, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap78547a5f-e1, col_values=(('qos', UUID('31b2147b-3f06-4615-8642-c647c7d1572f')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap78547a5f-e1, col_values=(('external_ids', {'iface-id': '78547a5f-e10d-4a62-8d35-5584ce87d2c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:04:37', 'vm-uuid': '412e1e40-082a-429e-9d35-013b72322761'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:36 user nova-compute[75080]: INFO os_vif [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:04:37,bridge_name='br-int',has_traffic_filtering=True,id=78547a5f-e10d-4a62-8d35-5584ce87d2c5,network=Network(3f7b7f16-6cc0-45b9-9f9c-efd112a71092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78547a5f-e1')
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] No VIF found with MAC fa:16:3e:ab:04:37, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23030326334373165', 'path': '/dev/sdb'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030326334373165', 'path': '/dev/sdb'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:22:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1343643765',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1343643765',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1343643765',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqhKohd/+Zu6WwJoPk+5PrlLuGFqnOTiENkWbBD5QSU5b+evA78SirwvOPaECiBFl5SfxUnl88cNfR23Qb+3NSlS7eK4mKt4l9nS7owjbXuvRlUEghiewHtV6WdVUnbDw==',key_name='tempest-keypair-1335740552',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11227acd507347ae9c5a3bc710707f84',ramdisk_id='',reservation_id='r-u407s099',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-23416231',owner_user_name='tempest-TestVolumeBootPattern-23416231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:22:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15be5b54cc8346bb86683e4ed2fbba9e',uuid=607acee2-b585-43d2-a897-eca4983d62db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5979a08d-6941-4e54-9f0f-a6aa1af07de8", "address": "fa:16:3e:94:6b:4c", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5979a08d-69", "ovs_interfaceid": "5979a08d-6941-4e54-9f0f-a6aa1af07de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Converting VIF {"id": "5979a08d-6941-4e54-9f0f-a6aa1af07de8", "address": "fa:16:3e:94:6b:4c", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5979a08d-69", "ovs_interfaceid": "5979a08d-6941-4e54-9f0f-a6aa1af07de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:6b:4c,bridge_name='br-int',has_traffic_filtering=True,id=5979a08d-6941-4e54-9f0f-a6aa1af07de8,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5979a08d-69') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.objects.instance [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lazy-loading 'pci_devices' on Instance uuid 607acee2-b585-43d2-a897-eca4983d62db {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:22:36 user nova-compute[75080]:   <uuid>607acee2-b585-43d2-a897-eca4983d62db</uuid>
Dec 05 15:22:36 user nova-compute[75080]:   <name>instance-00000010</name>
Dec 05 15:22:36 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:22:36 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:22:36 user nova-compute[75080]:   <metadata>
Dec 05 15:22:36 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:22:36 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:22:36 user nova-compute[75080]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1343643765</nova:name>
Dec 05 15:22:36 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:22:34</nova:creationTime>
Dec 05 15:22:36 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:22:36 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:22:36 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:22:36 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:22:36 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:22:36 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:22:36 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:22:36 user nova-compute[75080]:       <nova:owner>
Dec 05 15:22:36 user nova-compute[75080]:         <nova:user uuid="15be5b54cc8346bb86683e4ed2fbba9e">tempest-TestVolumeBootPattern-23416231-project-member</nova:user>
Dec 05 15:22:36 user nova-compute[75080]:         <nova:project uuid="11227acd507347ae9c5a3bc710707f84">tempest-TestVolumeBootPattern-23416231</nova:project>
Dec 05 15:22:36 user nova-compute[75080]:       </nova:owner>
Dec 05 15:22:36 user nova-compute[75080]:       <nova:ports>
Dec 05 15:22:36 user nova-compute[75080]:         <nova:port uuid="5979a08d-6941-4e54-9f0f-a6aa1af07de8">
Dec 05 15:22:36 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 05 15:22:36 user nova-compute[75080]:         </nova:port>
Dec 05 15:22:36 user nova-compute[75080]:       </nova:ports>
Dec 05 15:22:36 user nova-compute[75080]:     </nova:instance>
Dec 05 15:22:36 user nova-compute[75080]:   </metadata>
Dec 05 15:22:36 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:22:36 user nova-compute[75080]:     <system>
Dec 05 15:22:36 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:22:36 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:22:36 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:22:36 user nova-compute[75080]:       <entry name="serial">607acee2-b585-43d2-a897-eca4983d62db</entry>
Dec 05 15:22:36 user nova-compute[75080]:       <entry name="uuid">607acee2-b585-43d2-a897-eca4983d62db</entry>
Dec 05 15:22:36 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:22:36 user nova-compute[75080]:     </system>
Dec 05 15:22:36 user nova-compute[75080]:   </sysinfo>
Dec 05 15:22:36 user nova-compute[75080]:   <os>
Dec 05 15:22:36 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:22:36 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:22:36 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:22:36 user nova-compute[75080]:   </os>
Dec 05 15:22:36 user nova-compute[75080]:   <features>
Dec 05 15:22:36 user nova-compute[75080]:     <acpi/>
Dec 05 15:22:36 user nova-compute[75080]:     <apic/>
Dec 05 15:22:36 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:22:36 user nova-compute[75080]:   </features>
Dec 05 15:22:36 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:22:36 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:22:36 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:22:36 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:22:36 user nova-compute[75080]:   </clock>
Dec 05 15:22:36 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:22:36 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:22:36 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:22:36 user nova-compute[75080]:   </cpu>
Dec 05 15:22:36 user nova-compute[75080]:   <devices>
Dec 05 15:22:36 user nova-compute[75080]:     <disk type="block" device="disk">
Dec 05 15:22:36 user nova-compute[75080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:22:36 user nova-compute[75080]:       <source dev="/dev/sdb"/>
Dec 05 15:22:36 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:22:36 user nova-compute[75080]:       <serial>5b948b23-bb33-4107-9e97-aad44fb22598</serial>
Dec 05 15:22:36 user nova-compute[75080]:     </disk>
Dec 05 15:22:36 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:22:36 user nova-compute[75080]:       <mac address="fa:16:3e:94:6b:4c"/>
Dec 05 15:22:36 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:22:36 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:22:36 user nova-compute[75080]:       <target dev="tap5979a08d-69"/>
Dec 05 15:22:36 user nova-compute[75080]:     </interface>
Dec 05 15:22:36 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:22:36 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/607acee2-b585-43d2-a897-eca4983d62db/console.log" append="off"/>
Dec 05 15:22:36 user nova-compute[75080]:     </serial>
Dec 05 15:22:36 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:22:36 user nova-compute[75080]:     <video>
Dec 05 15:22:36 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:22:36 user nova-compute[75080]:     </video>
Dec 05 15:22:36 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:22:36 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:22:36 user nova-compute[75080]:     </rng>
Dec 05 15:22:36 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:22:36 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:22:36 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:22:36 user nova-compute[75080]:     </memballoon>
Dec 05 15:22:36 user nova-compute[75080]:   </devices>
Dec 05 15:22:36 user nova-compute[75080]: </domain>
Dec 05 15:22:36 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:22:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1343643765',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1343643765',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1343643765',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqhKohd/+Zu6WwJoPk+5PrlLuGFqnOTiENkWbBD5QSU5b+evA78SirwvOPaECiBFl5SfxUnl88cNfR23Qb+3NSlS7eK4mKt4l9nS7owjbXuvRlUEghiewHtV6WdVUnbDw==',key_name='tempest-keypair-1335740552',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11227acd507347ae9c5a3bc710707f84',ramdisk_id='',reservation_id='r-u407s099',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-23416231',owner_user_name='tempest-TestVolumeBootPattern-23416231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:22:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15be5b54cc8346bb86683e4ed2fbba9e',uuid=607acee2-b585-43d2-a897-eca4983d62db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5979a08d-6941-4e54-9f0f-a6aa1af07de8", "address": "fa:16:3e:94:6b:4c", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5979a08d-69", "ovs_interfaceid": "5979a08d-6941-4e54-9f0f-a6aa1af07de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Converting VIF {"id": "5979a08d-6941-4e54-9f0f-a6aa1af07de8", "address": "fa:16:3e:94:6b:4c", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5979a08d-69", "ovs_interfaceid": "5979a08d-6941-4e54-9f0f-a6aa1af07de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:6b:4c,bridge_name='br-int',has_traffic_filtering=True,id=5979a08d-6941-4e54-9f0f-a6aa1af07de8,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5979a08d-69') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG os_vif [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:6b:4c,bridge_name='br-int',has_traffic_filtering=True,id=5979a08d-6941-4e54-9f0f-a6aa1af07de8,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5979a08d-69') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '19199b1e-a95f-5a19-a1f6-0b1bb2263054', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5979a08d-69, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5979a08d-69, col_values=(('qos', UUID('eee59cf4-9f7a-48d6-a039-3034540a27fe')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5979a08d-69, col_values=(('external_ids', {'iface-id': '5979a08d-6941-4e54-9f0f-a6aa1af07de8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:6b:4c', 'vm-uuid': '607acee2-b585-43d2-a897-eca4983d62db'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:36 user nova-compute[75080]: INFO os_vif [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:6b:4c,bridge_name='br-int',has_traffic_filtering=True,id=5979a08d-6941-4e54-9f0f-a6aa1af07de8,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5979a08d-69')
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.network.neutron [req-e62553c6-d630-48bf-8aed-7391a8b344c0 req-f713efe2-c955-4b4b-a472-4c6fb05f2077 service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] Updated VIF entry in instance network info cache for port 78547a5f-e10d-4a62-8d35-5584ce87d2c5. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.network.neutron [req-e62553c6-d630-48bf-8aed-7391a8b344c0 req-f713efe2-c955-4b4b-a472-4c6fb05f2077 service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] Updating instance_info_cache with network_info: [{"id": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "address": "fa:16:3e:ab:04:37", "network": {"id": "3f7b7f16-6cc0-45b9-9f9c-efd112a71092", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-47517680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00d040579ca46338e01b8110a0ebc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78547a5f-e1", "ovs_interfaceid": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-e62553c6-d630-48bf-8aed-7391a8b344c0 req-f713efe2-c955-4b4b-a472-4c6fb05f2077 service nova] Releasing lock "refresh_cache-412e1e40-082a-429e-9d35-013b72322761" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:22:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] No VIF found with MAC fa:16:3e:94:6b:4c, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:22:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:39 user nova-compute[75080]: DEBUG nova.compute.manager [req-f8445dd1-efa1-41e6-913a-abd474ca4678 req-32b06d09-dcaf-4668-9b97-20b22d0920b7 service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] Received event network-vif-plugged-78547a5f-e10d-4a62-8d35-5584ce87d2c5 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:22:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f8445dd1-efa1-41e6-913a-abd474ca4678 req-32b06d09-dcaf-4668-9b97-20b22d0920b7 service nova] Acquiring lock "412e1e40-082a-429e-9d35-013b72322761-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:22:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f8445dd1-efa1-41e6-913a-abd474ca4678 req-32b06d09-dcaf-4668-9b97-20b22d0920b7 service nova] Lock "412e1e40-082a-429e-9d35-013b72322761-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:22:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f8445dd1-efa1-41e6-913a-abd474ca4678 req-32b06d09-dcaf-4668-9b97-20b22d0920b7 service nova] Lock "412e1e40-082a-429e-9d35-013b72322761-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:22:39 user nova-compute[75080]: DEBUG nova.compute.manager [req-f8445dd1-efa1-41e6-913a-abd474ca4678 req-32b06d09-dcaf-4668-9b97-20b22d0920b7 service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] No waiting events found dispatching network-vif-plugged-78547a5f-e10d-4a62-8d35-5584ce87d2c5 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:22:39 user nova-compute[75080]: WARNING nova.compute.manager [req-f8445dd1-efa1-41e6-913a-abd474ca4678 req-32b06d09-dcaf-4668-9b97-20b22d0920b7 service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] Received unexpected event network-vif-plugged-78547a5f-e10d-4a62-8d35-5584ce87d2c5 for instance with vm_state building and task_state spawning.
Dec 05 15:22:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:39 user nova-compute[75080]: DEBUG nova.compute.manager [req-94c52105-8c11-43f0-b0a5-e14af2b3cb51 req-30ff791e-57be-4703-8791-69c541bb30c5 service nova] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Received event network-vif-plugged-5979a08d-6941-4e54-9f0f-a6aa1af07de8 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:22:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-94c52105-8c11-43f0-b0a5-e14af2b3cb51 req-30ff791e-57be-4703-8791-69c541bb30c5 service nova] Acquiring lock "607acee2-b585-43d2-a897-eca4983d62db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:22:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-94c52105-8c11-43f0-b0a5-e14af2b3cb51 req-30ff791e-57be-4703-8791-69c541bb30c5 service nova] Lock "607acee2-b585-43d2-a897-eca4983d62db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:22:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-94c52105-8c11-43f0-b0a5-e14af2b3cb51 req-30ff791e-57be-4703-8791-69c541bb30c5 service nova] Lock "607acee2-b585-43d2-a897-eca4983d62db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:22:39 user nova-compute[75080]: DEBUG nova.compute.manager [req-94c52105-8c11-43f0-b0a5-e14af2b3cb51 req-30ff791e-57be-4703-8791-69c541bb30c5 service nova] [instance: 607acee2-b585-43d2-a897-eca4983d62db] No waiting events found dispatching network-vif-plugged-5979a08d-6941-4e54-9f0f-a6aa1af07de8 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:22:39 user nova-compute[75080]: WARNING nova.compute.manager [req-94c52105-8c11-43f0-b0a5-e14af2b3cb51 req-30ff791e-57be-4703-8791-69c541bb30c5 service nova] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Received unexpected event network-vif-plugged-5979a08d-6941-4e54-9f0f-a6aa1af07de8 for instance with vm_state building and task_state spawning.
Dec 05 15:22:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:41 user nova-compute[75080]: DEBUG nova.compute.manager [req-b29f1fa1-87bf-4104-b106-c6ad0024e02c req-0fddd61b-dab3-4062-b949-7ab9edcbbc1d service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] Received event network-vif-plugged-78547a5f-e10d-4a62-8d35-5584ce87d2c5 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:22:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-b29f1fa1-87bf-4104-b106-c6ad0024e02c req-0fddd61b-dab3-4062-b949-7ab9edcbbc1d service nova] Acquiring lock "412e1e40-082a-429e-9d35-013b72322761-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:22:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-b29f1fa1-87bf-4104-b106-c6ad0024e02c req-0fddd61b-dab3-4062-b949-7ab9edcbbc1d service nova] Lock "412e1e40-082a-429e-9d35-013b72322761-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:22:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-b29f1fa1-87bf-4104-b106-c6ad0024e02c req-0fddd61b-dab3-4062-b949-7ab9edcbbc1d service nova] Lock "412e1e40-082a-429e-9d35-013b72322761-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:22:41 user nova-compute[75080]: DEBUG nova.compute.manager [req-b29f1fa1-87bf-4104-b106-c6ad0024e02c req-0fddd61b-dab3-4062-b949-7ab9edcbbc1d service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] No waiting events found dispatching network-vif-plugged-78547a5f-e10d-4a62-8d35-5584ce87d2c5 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:22:41 user nova-compute[75080]: WARNING nova.compute.manager [req-b29f1fa1-87bf-4104-b106-c6ad0024e02c req-0fddd61b-dab3-4062-b949-7ab9edcbbc1d service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] Received unexpected event network-vif-plugged-78547a5f-e10d-4a62-8d35-5584ce87d2c5 for instance with vm_state building and task_state spawning.
Dec 05 15:22:41 user nova-compute[75080]: DEBUG nova.compute.manager [req-cfc99637-de92-457d-baa4-bc9d973df09d req-4db22005-d9ec-4665-9b98-6c993f6a99de service nova] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Received event network-vif-plugged-5979a08d-6941-4e54-9f0f-a6aa1af07de8 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:22:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-cfc99637-de92-457d-baa4-bc9d973df09d req-4db22005-d9ec-4665-9b98-6c993f6a99de service nova] Acquiring lock "607acee2-b585-43d2-a897-eca4983d62db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:22:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-cfc99637-de92-457d-baa4-bc9d973df09d req-4db22005-d9ec-4665-9b98-6c993f6a99de service nova] Lock "607acee2-b585-43d2-a897-eca4983d62db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:22:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-cfc99637-de92-457d-baa4-bc9d973df09d req-4db22005-d9ec-4665-9b98-6c993f6a99de service nova] Lock "607acee2-b585-43d2-a897-eca4983d62db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:22:41 user nova-compute[75080]: DEBUG nova.compute.manager [req-cfc99637-de92-457d-baa4-bc9d973df09d req-4db22005-d9ec-4665-9b98-6c993f6a99de service nova] [instance: 607acee2-b585-43d2-a897-eca4983d62db] No waiting events found dispatching network-vif-plugged-5979a08d-6941-4e54-9f0f-a6aa1af07de8 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:22:41 user nova-compute[75080]: WARNING nova.compute.manager [req-cfc99637-de92-457d-baa4-bc9d973df09d req-4db22005-d9ec-4665-9b98-6c993f6a99de service nova] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Received unexpected event network-vif-plugged-5979a08d-6941-4e54-9f0f-a6aa1af07de8 for instance with vm_state building and task_state spawning.
Dec 05 15:22:41 user nova-compute[75080]: DEBUG nova.compute.manager [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:22:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:22:41 user nova-compute[75080]: DEBUG nova.compute.manager [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:22:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:22:41 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 412e1e40-082a-429e-9d35-013b72322761] Instance spawned successfully.
Dec 05 15:22:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:22:41 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Instance spawned successfully.
Dec 05 15:22:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:22:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:22:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:22:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:22:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:22:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:22:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:22:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:22:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:22:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:22:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:22:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:22:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:22:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:41 user nova-compute[75080]: INFO nova.compute.manager [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Took 6.64 seconds to spawn the instance on the hypervisor.
Dec 05 15:22:41 user nova-compute[75080]: DEBUG nova.compute.manager [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:22:41 user nova-compute[75080]: INFO nova.compute.manager [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Took 7.97 seconds to spawn the instance on the hypervisor.
Dec 05 15:22:41 user nova-compute[75080]: DEBUG nova.compute.manager [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:22:41 user nova-compute[75080]: INFO nova.compute.manager [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Took 21.39 seconds to build instance.
Dec 05 15:22:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07a8081f-3a97-4be8-b4d0-3316e72a0a70 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "607acee2-b585-43d2-a897-eca4983d62db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.511s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:22:41 user nova-compute[75080]: INFO nova.compute.manager [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Took 8.94 seconds to build instance.
Dec 05 15:22:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b525e76d-ef06-4c7b-8f4d-2697a5c559e4 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "412e1e40-082a-429e-9d35-013b72322761" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.047s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:22:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "07b025ff-4a9d-48a2-b950-b8f2d165f33c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:22:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "07b025ff-4a9d-48a2-b950-b8f2d165f33c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:22:45 user nova-compute[75080]: DEBUG nova.compute.manager [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:22:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:22:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:22:46 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:22:46 user nova-compute[75080]: INFO nova.compute.claims [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Claim successful on node user
Dec 05 15:22:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:46 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:22:46 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:22:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.562s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:22:46 user nova-compute[75080]: DEBUG nova.compute.manager [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:22:46 user nova-compute[75080]: DEBUG nova.compute.manager [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:22:46 user nova-compute[75080]: DEBUG nova.network.neutron [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:22:46 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:22:46 user nova-compute[75080]: DEBUG nova.compute.manager [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:22:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:46 user nova-compute[75080]: DEBUG nova.policy [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '829d709c32db431199af609ddbc8b090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97145ab79b414c4fb8772c71e9414581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:22:46 user nova-compute[75080]: DEBUG nova.compute.manager [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:22:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:22:46 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Creating image(s)
Dec 05 15:22:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "/opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:22:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "/opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:22:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "/opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:22:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.191s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:22:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:22:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.200s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk 1073741824" returned: 0 in 0.052s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:22:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.199s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:47 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Checking if we can resize image /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 15:22:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:22:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:22:47 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Cannot resize image /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 15:22:47 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:22:47 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Ensure instance console log exists: /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:22:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:22:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:22:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:22:47 user nova-compute[75080]: DEBUG nova.network.neutron [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Successfully created port: b499a54e-2aab-4f63-a634-66c6a627bb4a {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:22:48 user nova-compute[75080]: DEBUG nova.network.neutron [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Successfully updated port: b499a54e-2aab-4f63-a634-66c6a627bb4a {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:22:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "refresh_cache-07b025ff-4a9d-48a2-b950-b8f2d165f33c" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:22:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquired lock "refresh_cache-07b025ff-4a9d-48a2-b950-b8f2d165f33c" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:22:48 user nova-compute[75080]: DEBUG nova.network.neutron [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:22:48 user nova-compute[75080]: DEBUG nova.compute.manager [req-a5a40d58-9768-41c4-bbe0-51f3219799a7 req-f12b162c-6ba8-4bd8-b844-0ee94b0ce3ef service nova] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Received event network-changed-b499a54e-2aab-4f63-a634-66c6a627bb4a {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:22:48 user nova-compute[75080]: DEBUG nova.compute.manager [req-a5a40d58-9768-41c4-bbe0-51f3219799a7 req-f12b162c-6ba8-4bd8-b844-0ee94b0ce3ef service nova] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Refreshing instance network info cache due to event network-changed-b499a54e-2aab-4f63-a634-66c6a627bb4a. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:22:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a5a40d58-9768-41c4-bbe0-51f3219799a7 req-f12b162c-6ba8-4bd8-b844-0ee94b0ce3ef service nova] Acquiring lock "refresh_cache-07b025ff-4a9d-48a2-b950-b8f2d165f33c" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:22:48 user nova-compute[75080]: DEBUG nova.network.neutron [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:22:48 user nova-compute[75080]: DEBUG nova.network.neutron [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Updating instance_info_cache with network_info: [{"id": "b499a54e-2aab-4f63-a634-66c6a627bb4a", "address": "fa:16:3e:14:03:09", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb499a54e-2a", "ovs_interfaceid": "b499a54e-2aab-4f63-a634-66c6a627bb4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:22:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Releasing lock "refresh_cache-07b025ff-4a9d-48a2-b950-b8f2d165f33c" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:22:48 user nova-compute[75080]: DEBUG nova.compute.manager [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Instance network_info: |[{"id": "b499a54e-2aab-4f63-a634-66c6a627bb4a", "address": "fa:16:3e:14:03:09", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb499a54e-2a", "ovs_interfaceid": "b499a54e-2aab-4f63-a634-66c6a627bb4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:22:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a5a40d58-9768-41c4-bbe0-51f3219799a7 req-f12b162c-6ba8-4bd8-b844-0ee94b0ce3ef service nova] Acquired lock "refresh_cache-07b025ff-4a9d-48a2-b950-b8f2d165f33c" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:22:48 user nova-compute[75080]: DEBUG nova.network.neutron [req-a5a40d58-9768-41c4-bbe0-51f3219799a7 req-f12b162c-6ba8-4bd8-b844-0ee94b0ce3ef service nova] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Refreshing network info cache for port b499a54e-2aab-4f63-a634-66c6a627bb4a {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:22:48 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Start _get_guest_xml network_info=[{"id": "b499a54e-2aab-4f63-a634-66c6a627bb4a", "address": "fa:16:3e:14:03:09", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb499a54e-2a", "ovs_interfaceid": "b499a54e-2aab-4f63-a634-66c6a627bb4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:22:49 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:22:49 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:22:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:22:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-636436384',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-636436384',id=18,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97145ab79b414c4fb8772c71e9414581',ramdisk_id='',reservation_id='r-vxqa80e6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2060228993',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:22:47Z,user_data=None,user_id='829d709c32db431199af609ddbc8b090',uuid=07b025ff-4a9d-48a2-b950-b8f2d165f33c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b499a54e-2aab-4f63-a634-66c6a627bb4a", "address": "fa:16:3e:14:03:09", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb499a54e-2a", "ovs_interfaceid": "b499a54e-2aab-4f63-a634-66c6a627bb4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Converting VIF {"id": "b499a54e-2aab-4f63-a634-66c6a627bb4a", "address": "fa:16:3e:14:03:09", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb499a54e-2a", "ovs_interfaceid": "b499a54e-2aab-4f63-a634-66c6a627bb4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:03:09,bridge_name='br-int',has_traffic_filtering=True,id=b499a54e-2aab-4f63-a634-66c6a627bb4a,network=Network(61aa968d-7e44-4ef2-955f-2e5441416f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb499a54e-2a') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG nova.objects.instance [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lazy-loading 'pci_devices' on Instance uuid 07b025ff-4a9d-48a2-b950-b8f2d165f33c {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:22:49 user nova-compute[75080]:   <uuid>07b025ff-4a9d-48a2-b950-b8f2d165f33c</uuid>
Dec 05 15:22:49 user nova-compute[75080]:   <name>instance-00000012</name>
Dec 05 15:22:49 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:22:49 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:22:49 user nova-compute[75080]:   <metadata>
Dec 05 15:22:49 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:22:49 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:22:49 user nova-compute[75080]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-636436384</nova:name>
Dec 05 15:22:49 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:22:49</nova:creationTime>
Dec 05 15:22:49 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:22:49 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:22:49 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:22:49 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:22:49 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:22:49 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:22:49 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:22:49 user nova-compute[75080]:       <nova:owner>
Dec 05 15:22:49 user nova-compute[75080]:         <nova:user uuid="829d709c32db431199af609ddbc8b090">tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member</nova:user>
Dec 05 15:22:49 user nova-compute[75080]:         <nova:project uuid="97145ab79b414c4fb8772c71e9414581">tempest-ServerBootFromVolumeStableRescueTest-2060228993</nova:project>
Dec 05 15:22:49 user nova-compute[75080]:       </nova:owner>
Dec 05 15:22:49 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:22:49 user nova-compute[75080]:       <nova:ports>
Dec 05 15:22:49 user nova-compute[75080]:         <nova:port uuid="b499a54e-2aab-4f63-a634-66c6a627bb4a">
Dec 05 15:22:49 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 05 15:22:49 user nova-compute[75080]:         </nova:port>
Dec 05 15:22:49 user nova-compute[75080]:       </nova:ports>
Dec 05 15:22:49 user nova-compute[75080]:     </nova:instance>
Dec 05 15:22:49 user nova-compute[75080]:   </metadata>
Dec 05 15:22:49 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:22:49 user nova-compute[75080]:     <system>
Dec 05 15:22:49 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:22:49 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:22:49 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:22:49 user nova-compute[75080]:       <entry name="serial">07b025ff-4a9d-48a2-b950-b8f2d165f33c</entry>
Dec 05 15:22:49 user nova-compute[75080]:       <entry name="uuid">07b025ff-4a9d-48a2-b950-b8f2d165f33c</entry>
Dec 05 15:22:49 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:22:49 user nova-compute[75080]:     </system>
Dec 05 15:22:49 user nova-compute[75080]:   </sysinfo>
Dec 05 15:22:49 user nova-compute[75080]:   <os>
Dec 05 15:22:49 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:22:49 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:22:49 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:22:49 user nova-compute[75080]:   </os>
Dec 05 15:22:49 user nova-compute[75080]:   <features>
Dec 05 15:22:49 user nova-compute[75080]:     <acpi/>
Dec 05 15:22:49 user nova-compute[75080]:     <apic/>
Dec 05 15:22:49 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:22:49 user nova-compute[75080]:   </features>
Dec 05 15:22:49 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:22:49 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:22:49 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:22:49 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:22:49 user nova-compute[75080]:   </clock>
Dec 05 15:22:49 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:22:49 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:22:49 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:22:49 user nova-compute[75080]:   </cpu>
Dec 05 15:22:49 user nova-compute[75080]:   <devices>
Dec 05 15:22:49 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:22:49 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:22:49 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk"/>
Dec 05 15:22:49 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:22:49 user nova-compute[75080]:     </disk>
Dec 05 15:22:49 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:22:49 user nova-compute[75080]:       <mac address="fa:16:3e:14:03:09"/>
Dec 05 15:22:49 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:22:49 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:22:49 user nova-compute[75080]:       <target dev="tapb499a54e-2a"/>
Dec 05 15:22:49 user nova-compute[75080]:     </interface>
Dec 05 15:22:49 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:22:49 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/console.log" append="off"/>
Dec 05 15:22:49 user nova-compute[75080]:     </serial>
Dec 05 15:22:49 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:22:49 user nova-compute[75080]:     <video>
Dec 05 15:22:49 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:22:49 user nova-compute[75080]:     </video>
Dec 05 15:22:49 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:22:49 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:22:49 user nova-compute[75080]:     </rng>
Dec 05 15:22:49 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:22:49 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:22:49 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:22:49 user nova-compute[75080]:     </memballoon>
Dec 05 15:22:49 user nova-compute[75080]:   </devices>
Dec 05 15:22:49 user nova-compute[75080]: </domain>
Dec 05 15:22:49 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:22:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-636436384',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-636436384',id=18,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97145ab79b414c4fb8772c71e9414581',ramdisk_id='',reservation_id='r-vxqa80e6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2060228993',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:22:47Z,user_data=None,user_id='829d709c32db431199af609ddbc8b090',uuid=07b025ff-4a9d-48a2-b950-b8f2d165f33c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b499a54e-2aab-4f63-a634-66c6a627bb4a", "address": "fa:16:3e:14:03:09", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb499a54e-2a", "ovs_interfaceid": "b499a54e-2aab-4f63-a634-66c6a627bb4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Converting VIF {"id": "b499a54e-2aab-4f63-a634-66c6a627bb4a", "address": "fa:16:3e:14:03:09", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb499a54e-2a", "ovs_interfaceid": "b499a54e-2aab-4f63-a634-66c6a627bb4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:03:09,bridge_name='br-int',has_traffic_filtering=True,id=b499a54e-2aab-4f63-a634-66c6a627bb4a,network=Network(61aa968d-7e44-4ef2-955f-2e5441416f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb499a54e-2a') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG os_vif [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:03:09,bridge_name='br-int',has_traffic_filtering=True,id=b499a54e-2aab-4f63-a634-66c6a627bb4a,network=Network(61aa968d-7e44-4ef2-955f-2e5441416f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb499a54e-2a') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a2f9b40d-6917-544e-9074-c0403746d7c2', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb499a54e-2a, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb499a54e-2a, col_values=(('qos', UUID('3833955b-60bb-49a2-a82c-5bf8ee51db09')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb499a54e-2a, col_values=(('external_ids', {'iface-id': 'b499a54e-2aab-4f63-a634-66c6a627bb4a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:03:09', 'vm-uuid': '07b025ff-4a9d-48a2-b950-b8f2d165f33c'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:49 user nova-compute[75080]: INFO os_vif [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:03:09,bridge_name='br-int',has_traffic_filtering=True,id=b499a54e-2aab-4f63-a634-66c6a627bb4a,network=Network(61aa968d-7e44-4ef2-955f-2e5441416f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb499a54e-2a')
Dec 05 15:22:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] No VIF found with MAC fa:16:3e:14:03:09, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG nova.network.neutron [req-a5a40d58-9768-41c4-bbe0-51f3219799a7 req-f12b162c-6ba8-4bd8-b844-0ee94b0ce3ef service nova] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Updated VIF entry in instance network info cache for port b499a54e-2aab-4f63-a634-66c6a627bb4a. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG nova.network.neutron [req-a5a40d58-9768-41c4-bbe0-51f3219799a7 req-f12b162c-6ba8-4bd8-b844-0ee94b0ce3ef service nova] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Updating instance_info_cache with network_info: [{"id": "b499a54e-2aab-4f63-a634-66c6a627bb4a", "address": "fa:16:3e:14:03:09", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb499a54e-2a", "ovs_interfaceid": "b499a54e-2aab-4f63-a634-66c6a627bb4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:22:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a5a40d58-9768-41c4-bbe0-51f3219799a7 req-f12b162c-6ba8-4bd8-b844-0ee94b0ce3ef service nova] Releasing lock "refresh_cache-07b025ff-4a9d-48a2-b950-b8f2d165f33c" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:22:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-20bfabdd-f5d0-4a6f-8d11-2a2abdd009fb req-3c5646de-79fc-4f6e-bae8-6cf9a55ed374 service nova] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Received event network-vif-plugged-b499a54e-2aab-4f63-a634-66c6a627bb4a {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:22:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-20bfabdd-f5d0-4a6f-8d11-2a2abdd009fb req-3c5646de-79fc-4f6e-bae8-6cf9a55ed374 service nova] Acquiring lock "07b025ff-4a9d-48a2-b950-b8f2d165f33c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:22:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-20bfabdd-f5d0-4a6f-8d11-2a2abdd009fb req-3c5646de-79fc-4f6e-bae8-6cf9a55ed374 service nova] Lock "07b025ff-4a9d-48a2-b950-b8f2d165f33c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:22:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-20bfabdd-f5d0-4a6f-8d11-2a2abdd009fb req-3c5646de-79fc-4f6e-bae8-6cf9a55ed374 service nova] Lock "07b025ff-4a9d-48a2-b950-b8f2d165f33c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:22:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-20bfabdd-f5d0-4a6f-8d11-2a2abdd009fb req-3c5646de-79fc-4f6e-bae8-6cf9a55ed374 service nova] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] No waiting events found dispatching network-vif-plugged-b499a54e-2aab-4f63-a634-66c6a627bb4a {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:22:51 user nova-compute[75080]: WARNING nova.compute.manager [req-20bfabdd-f5d0-4a6f-8d11-2a2abdd009fb req-3c5646de-79fc-4f6e-bae8-6cf9a55ed374 service nova] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Received unexpected event network-vif-plugged-b499a54e-2aab-4f63-a634-66c6a627bb4a for instance with vm_state building and task_state spawning.
Dec 05 15:22:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:53 user nova-compute[75080]: DEBUG nova.compute.manager [req-631160eb-56c2-4252-8040-6b233771c85b req-1408065e-37a0-459b-9834-2aa6b2c2369d service nova] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Received event network-vif-plugged-b499a54e-2aab-4f63-a634-66c6a627bb4a {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:22:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-631160eb-56c2-4252-8040-6b233771c85b req-1408065e-37a0-459b-9834-2aa6b2c2369d service nova] Acquiring lock "07b025ff-4a9d-48a2-b950-b8f2d165f33c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:22:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-631160eb-56c2-4252-8040-6b233771c85b req-1408065e-37a0-459b-9834-2aa6b2c2369d service nova] Lock "07b025ff-4a9d-48a2-b950-b8f2d165f33c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:22:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-631160eb-56c2-4252-8040-6b233771c85b req-1408065e-37a0-459b-9834-2aa6b2c2369d service nova] Lock "07b025ff-4a9d-48a2-b950-b8f2d165f33c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:22:53 user nova-compute[75080]: DEBUG nova.compute.manager [req-631160eb-56c2-4252-8040-6b233771c85b req-1408065e-37a0-459b-9834-2aa6b2c2369d service nova] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] No waiting events found dispatching network-vif-plugged-b499a54e-2aab-4f63-a634-66c6a627bb4a {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:22:53 user nova-compute[75080]: WARNING nova.compute.manager [req-631160eb-56c2-4252-8040-6b233771c85b req-1408065e-37a0-459b-9834-2aa6b2c2369d service nova] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Received unexpected event network-vif-plugged-b499a54e-2aab-4f63-a634-66c6a627bb4a for instance with vm_state building and task_state spawning.
Dec 05 15:22:53 user nova-compute[75080]: DEBUG nova.compute.manager [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:22:53 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:22:53 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Instance spawned successfully.
Dec 05 15:22:53 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:22:53 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:22:53 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:22:53 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:22:53 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:22:53 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:22:53 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:22:53 user nova-compute[75080]: INFO nova.compute.manager [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Took 6.76 seconds to spawn the instance on the hypervisor.
Dec 05 15:22:53 user nova-compute[75080]: DEBUG nova.compute.manager [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:22:53 user nova-compute[75080]: INFO nova.compute.manager [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Took 7.71 seconds to build instance.
Dec 05 15:22:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-01fae4e1-2e73-4a54-8a65-17b7bdb02873 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "07b025ff-4a9d-48a2-b950-b8f2d165f33c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.824s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:22:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-57a71c0e-2e5d-4d61-a8fe-8a1adcbc5286 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Acquiring lock "d69bc0bc-b6e8-447b-b529-54031fc78ce1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:22:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-57a71c0e-2e5d-4d61-a8fe-8a1adcbc5286 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "d69bc0bc-b6e8-447b-b529-54031fc78ce1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:22:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-57a71c0e-2e5d-4d61-a8fe-8a1adcbc5286 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Acquiring lock "d69bc0bc-b6e8-447b-b529-54031fc78ce1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:22:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-57a71c0e-2e5d-4d61-a8fe-8a1adcbc5286 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "d69bc0bc-b6e8-447b-b529-54031fc78ce1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:22:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-57a71c0e-2e5d-4d61-a8fe-8a1adcbc5286 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "d69bc0bc-b6e8-447b-b529-54031fc78ce1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:22:58 user nova-compute[75080]: INFO nova.compute.manager [None req-57a71c0e-2e5d-4d61-a8fe-8a1adcbc5286 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Terminating instance
Dec 05 15:22:58 user nova-compute[75080]: DEBUG nova.compute.manager [None req-57a71c0e-2e5d-4d61-a8fe-8a1adcbc5286 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:22:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:59 user nova-compute[75080]: DEBUG nova.compute.manager [req-366a48e0-db45-44d1-a6f0-1fabc0c10f4b req-7962e48b-15fb-4f13-9951-dfa3a7d16378 service nova] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Received event network-vif-unplugged-1c52a0de-1054-487a-9f4b-467d9151f1b0 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:22:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-366a48e0-db45-44d1-a6f0-1fabc0c10f4b req-7962e48b-15fb-4f13-9951-dfa3a7d16378 service nova] Acquiring lock "d69bc0bc-b6e8-447b-b529-54031fc78ce1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:22:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-366a48e0-db45-44d1-a6f0-1fabc0c10f4b req-7962e48b-15fb-4f13-9951-dfa3a7d16378 service nova] Lock "d69bc0bc-b6e8-447b-b529-54031fc78ce1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:22:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-366a48e0-db45-44d1-a6f0-1fabc0c10f4b req-7962e48b-15fb-4f13-9951-dfa3a7d16378 service nova] Lock "d69bc0bc-b6e8-447b-b529-54031fc78ce1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:22:59 user nova-compute[75080]: DEBUG nova.compute.manager [req-366a48e0-db45-44d1-a6f0-1fabc0c10f4b req-7962e48b-15fb-4f13-9951-dfa3a7d16378 service nova] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] No waiting events found dispatching network-vif-unplugged-1c52a0de-1054-487a-9f4b-467d9151f1b0 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:22:59 user nova-compute[75080]: DEBUG nova.compute.manager [req-366a48e0-db45-44d1-a6f0-1fabc0c10f4b req-7962e48b-15fb-4f13-9951-dfa3a7d16378 service nova] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Received event network-vif-unplugged-1c52a0de-1054-487a-9f4b-467d9151f1b0 for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:22:59 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Instance destroyed successfully.
Dec 05 15:22:59 user nova-compute[75080]: DEBUG nova.objects.instance [None req-57a71c0e-2e5d-4d61-a8fe-8a1adcbc5286 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lazy-loading 'resources' on Instance uuid d69bc0bc-b6e8-447b-b529-54031fc78ce1 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:22:59 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-57a71c0e-2e5d-4d61-a8fe-8a1adcbc5286 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:18:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-783074315',display_name='tempest-TestServerVolumeAttachmentScenario-server-783074315',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-783074315',id=8,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5zNy+1ow33S20RcKvu1jD4khVEugsbpHZP0w5gwoHui4slwMVZuggEneoxgHpzG9XxLj0Ox43tVuGV/dMq8xnA87LiYq7FAbpkRDpapW42sRtTn6Fz7mT3cBHuJNGGwA==',key_name='tempest-keypair-1191671367',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:18:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='787d8b299b8b4940b04446b4189fdf05',ramdisk_id='',reservation_id='r-yep2vq2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-291896938',owner_user_name='tempest-TestServerVolumeAttachmentScenario-291896938-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:18:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73fc83883fde496180489f170285d97f',uuid=d69bc0bc-b6e8-447b-b529-54031fc78ce1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c52a0de-1054-487a-9f4b-467d9151f1b0", "address": "fa:16:3e:b4:f4:d6", "network": {"id": "73bdb098-8c6b-4af3-b3f5-5fb4b213a0ab", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1357180398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "787d8b299b8b4940b04446b4189fdf05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c52a0de-10", "ovs_interfaceid": "1c52a0de-1054-487a-9f4b-467d9151f1b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:22:59 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-57a71c0e-2e5d-4d61-a8fe-8a1adcbc5286 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Converting VIF {"id": "1c52a0de-1054-487a-9f4b-467d9151f1b0", "address": "fa:16:3e:b4:f4:d6", "network": {"id": "73bdb098-8c6b-4af3-b3f5-5fb4b213a0ab", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1357180398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "787d8b299b8b4940b04446b4189fdf05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c52a0de-10", "ovs_interfaceid": "1c52a0de-1054-487a-9f4b-467d9151f1b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:22:59 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-57a71c0e-2e5d-4d61-a8fe-8a1adcbc5286 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:f4:d6,bridge_name='br-int',has_traffic_filtering=True,id=1c52a0de-1054-487a-9f4b-467d9151f1b0,network=Network(73bdb098-8c6b-4af3-b3f5-5fb4b213a0ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c52a0de-10') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:22:59 user nova-compute[75080]: DEBUG os_vif [None req-57a71c0e-2e5d-4d61-a8fe-8a1adcbc5286 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:f4:d6,bridge_name='br-int',has_traffic_filtering=True,id=1c52a0de-1054-487a-9f4b-467d9151f1b0,network=Network(73bdb098-8c6b-4af3-b3f5-5fb4b213a0ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c52a0de-10') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:22:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c52a0de-10, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:22:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:22:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=625cbe16-0aef-48e6-b5fa-88ac5377cf54) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:22:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:22:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:22:59 user nova-compute[75080]: INFO os_vif [None req-57a71c0e-2e5d-4d61-a8fe-8a1adcbc5286 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:f4:d6,bridge_name='br-int',has_traffic_filtering=True,id=1c52a0de-1054-487a-9f4b-467d9151f1b0,network=Network(73bdb098-8c6b-4af3-b3f5-5fb4b213a0ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c52a0de-10')
Dec 05 15:22:59 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-57a71c0e-2e5d-4d61-a8fe-8a1adcbc5286 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Deleting instance files /opt/stack/data/nova/instances/d69bc0bc-b6e8-447b-b529-54031fc78ce1_del
Dec 05 15:22:59 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-57a71c0e-2e5d-4d61-a8fe-8a1adcbc5286 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Deletion of /opt/stack/data/nova/instances/d69bc0bc-b6e8-447b-b529-54031fc78ce1_del complete
Dec 05 15:22:59 user nova-compute[75080]: INFO nova.compute.manager [None req-57a71c0e-2e5d-4d61-a8fe-8a1adcbc5286 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Took 0.99 seconds to destroy the instance on the hypervisor.
Dec 05 15:22:59 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-57a71c0e-2e5d-4d61-a8fe-8a1adcbc5286 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:22:59 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:22:59 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:23:00 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:23:00 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Took 0.82 seconds to deallocate network for instance.
Dec 05 15:23:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-57a71c0e-2e5d-4d61-a8fe-8a1adcbc5286 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:23:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-57a71c0e-2e5d-4d61-a8fe-8a1adcbc5286 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:23:01 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-57a71c0e-2e5d-4d61-a8fe-8a1adcbc5286 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:23:01 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-57a71c0e-2e5d-4d61-a8fe-8a1adcbc5286 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:23:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-57a71c0e-2e5d-4d61-a8fe-8a1adcbc5286 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.426s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:23:01 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-57a71c0e-2e5d-4d61-a8fe-8a1adcbc5286 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Deleted allocations for instance d69bc0bc-b6e8-447b-b529-54031fc78ce1
Dec 05 15:23:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-57a71c0e-2e5d-4d61-a8fe-8a1adcbc5286 tempest-TestServerVolumeAttachmentScenario-291896938 tempest-TestServerVolumeAttachmentScenario-291896938-project-member] Lock "d69bc0bc-b6e8-447b-b529-54031fc78ce1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.444s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:23:01 user nova-compute[75080]: DEBUG nova.compute.manager [req-85d80253-81e3-4f34-a6ac-69c4f9899a0e req-57bfbc04-a088-4cc1-b6d8-3bb5e0a3a019 service nova] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Received event network-vif-plugged-1c52a0de-1054-487a-9f4b-467d9151f1b0 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:23:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-85d80253-81e3-4f34-a6ac-69c4f9899a0e req-57bfbc04-a088-4cc1-b6d8-3bb5e0a3a019 service nova] Acquiring lock "d69bc0bc-b6e8-447b-b529-54031fc78ce1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:23:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-85d80253-81e3-4f34-a6ac-69c4f9899a0e req-57bfbc04-a088-4cc1-b6d8-3bb5e0a3a019 service nova] Lock "d69bc0bc-b6e8-447b-b529-54031fc78ce1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:23:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-85d80253-81e3-4f34-a6ac-69c4f9899a0e req-57bfbc04-a088-4cc1-b6d8-3bb5e0a3a019 service nova] Lock "d69bc0bc-b6e8-447b-b529-54031fc78ce1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:23:01 user nova-compute[75080]: DEBUG nova.compute.manager [req-85d80253-81e3-4f34-a6ac-69c4f9899a0e req-57bfbc04-a088-4cc1-b6d8-3bb5e0a3a019 service nova] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] No waiting events found dispatching network-vif-plugged-1c52a0de-1054-487a-9f4b-467d9151f1b0 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:23:01 user nova-compute[75080]: WARNING nova.compute.manager [req-85d80253-81e3-4f34-a6ac-69c4f9899a0e req-57bfbc04-a088-4cc1-b6d8-3bb5e0a3a019 service nova] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Received unexpected event network-vif-plugged-1c52a0de-1054-487a-9f4b-467d9151f1b0 for instance with vm_state deleted and task_state None.
Dec 05 15:23:01 user nova-compute[75080]: DEBUG nova.compute.manager [req-85d80253-81e3-4f34-a6ac-69c4f9899a0e req-57bfbc04-a088-4cc1-b6d8-3bb5e0a3a019 service nova] [instance: d69bc0bc-b6e8-447b-b529-54031fc78ce1] Received event network-vif-deleted-1c52a0de-1054-487a-9f4b-467d9151f1b0 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:23:01 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:06 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6a3613d4-b6fc-4329-bcc9-8a006da1ceed tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Acquiring lock "30a4dd31-76bf-497e-b0d0-82bd70940e6c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:23:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6a3613d4-b6fc-4329-bcc9-8a006da1ceed tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "30a4dd31-76bf-497e-b0d0-82bd70940e6c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:23:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6a3613d4-b6fc-4329-bcc9-8a006da1ceed tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Acquiring lock "30a4dd31-76bf-497e-b0d0-82bd70940e6c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:23:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6a3613d4-b6fc-4329-bcc9-8a006da1ceed tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "30a4dd31-76bf-497e-b0d0-82bd70940e6c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:23:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6a3613d4-b6fc-4329-bcc9-8a006da1ceed tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "30a4dd31-76bf-497e-b0d0-82bd70940e6c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:23:08 user nova-compute[75080]: INFO nova.compute.manager [None req-6a3613d4-b6fc-4329-bcc9-8a006da1ceed tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Terminating instance
Dec 05 15:23:08 user nova-compute[75080]: DEBUG nova.compute.manager [None req-6a3613d4-b6fc-4329-bcc9-8a006da1ceed tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:23:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:09 user nova-compute[75080]: DEBUG nova.compute.manager [req-88accadf-e334-45ae-ae38-ff7db22bdb98 req-13b19827-3d25-40d7-9d3d-382023e3c575 service nova] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Received event network-vif-unplugged-47cfa76f-2a3d-42e2-b7e9-824651b1dfe4 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:23:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-88accadf-e334-45ae-ae38-ff7db22bdb98 req-13b19827-3d25-40d7-9d3d-382023e3c575 service nova] Acquiring lock "30a4dd31-76bf-497e-b0d0-82bd70940e6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:23:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-88accadf-e334-45ae-ae38-ff7db22bdb98 req-13b19827-3d25-40d7-9d3d-382023e3c575 service nova] Lock "30a4dd31-76bf-497e-b0d0-82bd70940e6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:23:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-88accadf-e334-45ae-ae38-ff7db22bdb98 req-13b19827-3d25-40d7-9d3d-382023e3c575 service nova] Lock "30a4dd31-76bf-497e-b0d0-82bd70940e6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:23:09 user nova-compute[75080]: DEBUG nova.compute.manager [req-88accadf-e334-45ae-ae38-ff7db22bdb98 req-13b19827-3d25-40d7-9d3d-382023e3c575 service nova] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] No waiting events found dispatching network-vif-unplugged-47cfa76f-2a3d-42e2-b7e9-824651b1dfe4 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:23:09 user nova-compute[75080]: DEBUG nova.compute.manager [req-88accadf-e334-45ae-ae38-ff7db22bdb98 req-13b19827-3d25-40d7-9d3d-382023e3c575 service nova] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Received event network-vif-unplugged-47cfa76f-2a3d-42e2-b7e9-824651b1dfe4 for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:23:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:09 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Instance destroyed successfully.
Dec 05 15:23:09 user nova-compute[75080]: DEBUG nova.objects.instance [None req-6a3613d4-b6fc-4329-bcc9-8a006da1ceed tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lazy-loading 'resources' on Instance uuid 30a4dd31-76bf-497e-b0d0-82bd70940e6c {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:23:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-6a3613d4-b6fc-4329-bcc9-8a006da1ceed tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:21:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1171516528',display_name='tempest-VolumesAdminNegativeTest-server-1171516528',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1171516528',id=13,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:21:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b74a9586932440678d59170e174336a1',ramdisk_id='',reservation_id='r-7i0srliq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-98453510',owner_user_name='tempest-VolumesAdminNegativeTest-98453510-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:21:14Z,user_data=None,user_id='d5fa6ef27452432c8c1b6d57906b9de2',uuid=30a4dd31-76bf-497e-b0d0-82bd70940e6c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47cfa76f-2a3d-42e2-b7e9-824651b1dfe4", "address": "fa:16:3e:7a:09:fb", "network": {"id": "ecbc1165-663e-47ca-87c7-ecda194bb3cc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-140281562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b74a9586932440678d59170e174336a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47cfa76f-2a", "ovs_interfaceid": "47cfa76f-2a3d-42e2-b7e9-824651b1dfe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:23:09 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-6a3613d4-b6fc-4329-bcc9-8a006da1ceed tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Converting VIF {"id": "47cfa76f-2a3d-42e2-b7e9-824651b1dfe4", "address": "fa:16:3e:7a:09:fb", "network": {"id": "ecbc1165-663e-47ca-87c7-ecda194bb3cc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-140281562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b74a9586932440678d59170e174336a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47cfa76f-2a", "ovs_interfaceid": "47cfa76f-2a3d-42e2-b7e9-824651b1dfe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:23:09 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-6a3613d4-b6fc-4329-bcc9-8a006da1ceed tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:09:fb,bridge_name='br-int',has_traffic_filtering=True,id=47cfa76f-2a3d-42e2-b7e9-824651b1dfe4,network=Network(ecbc1165-663e-47ca-87c7-ecda194bb3cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47cfa76f-2a') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:23:09 user nova-compute[75080]: DEBUG os_vif [None req-6a3613d4-b6fc-4329-bcc9-8a006da1ceed tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:09:fb,bridge_name='br-int',has_traffic_filtering=True,id=47cfa76f-2a3d-42e2-b7e9-824651b1dfe4,network=Network(ecbc1165-663e-47ca-87c7-ecda194bb3cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47cfa76f-2a') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:23:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47cfa76f-2a, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:23:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:23:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=37f0ae83-f442-44cd-bb19-91a98a177619) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:23:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:23:09 user nova-compute[75080]: INFO os_vif [None req-6a3613d4-b6fc-4329-bcc9-8a006da1ceed tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:09:fb,bridge_name='br-int',has_traffic_filtering=True,id=47cfa76f-2a3d-42e2-b7e9-824651b1dfe4,network=Network(ecbc1165-663e-47ca-87c7-ecda194bb3cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47cfa76f-2a')
Dec 05 15:23:09 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-6a3613d4-b6fc-4329-bcc9-8a006da1ceed tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Deleting instance files /opt/stack/data/nova/instances/30a4dd31-76bf-497e-b0d0-82bd70940e6c_del
Dec 05 15:23:09 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-6a3613d4-b6fc-4329-bcc9-8a006da1ceed tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Deletion of /opt/stack/data/nova/instances/30a4dd31-76bf-497e-b0d0-82bd70940e6c_del complete
Dec 05 15:23:09 user nova-compute[75080]: INFO nova.compute.manager [None req-6a3613d4-b6fc-4329-bcc9-8a006da1ceed tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Took 1.00 seconds to destroy the instance on the hypervisor.
Dec 05 15:23:09 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-6a3613d4-b6fc-4329-bcc9-8a006da1ceed tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:23:09 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:23:09 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:23:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:10 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:23:10 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Took 0.49 seconds to deallocate network for instance.
Dec 05 15:23:10 user nova-compute[75080]: DEBUG nova.compute.manager [req-bcc6d1d4-f6ab-4d20-8a0f-a975245a06ea req-7dc3bf91-6a2b-4a04-baa4-3df5823339b1 service nova] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Received event network-vif-deleted-47cfa76f-2a3d-42e2-b7e9-824651b1dfe4 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:23:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6a3613d4-b6fc-4329-bcc9-8a006da1ceed tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:23:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6a3613d4-b6fc-4329-bcc9-8a006da1ceed tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:23:10 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-6a3613d4-b6fc-4329-bcc9-8a006da1ceed tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:23:10 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-6a3613d4-b6fc-4329-bcc9-8a006da1ceed tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:23:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6a3613d4-b6fc-4329-bcc9-8a006da1ceed tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:23:10 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-6a3613d4-b6fc-4329-bcc9-8a006da1ceed tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Deleted allocations for instance 30a4dd31-76bf-497e-b0d0-82bd70940e6c
Dec 05 15:23:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6a3613d4-b6fc-4329-bcc9-8a006da1ceed tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "30a4dd31-76bf-497e-b0d0-82bd70940e6c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.115s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:23:11 user nova-compute[75080]: DEBUG nova.compute.manager [req-23c4793f-42e4-4ad5-9722-210d6a38424a req-75a4b48a-90c4-49f1-a194-55e54acbdc6e service nova] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Received event network-vif-plugged-47cfa76f-2a3d-42e2-b7e9-824651b1dfe4 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:23:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-23c4793f-42e4-4ad5-9722-210d6a38424a req-75a4b48a-90c4-49f1-a194-55e54acbdc6e service nova] Acquiring lock "30a4dd31-76bf-497e-b0d0-82bd70940e6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:23:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-23c4793f-42e4-4ad5-9722-210d6a38424a req-75a4b48a-90c4-49f1-a194-55e54acbdc6e service nova] Lock "30a4dd31-76bf-497e-b0d0-82bd70940e6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:23:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-23c4793f-42e4-4ad5-9722-210d6a38424a req-75a4b48a-90c4-49f1-a194-55e54acbdc6e service nova] Lock "30a4dd31-76bf-497e-b0d0-82bd70940e6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:23:11 user nova-compute[75080]: DEBUG nova.compute.manager [req-23c4793f-42e4-4ad5-9722-210d6a38424a req-75a4b48a-90c4-49f1-a194-55e54acbdc6e service nova] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] No waiting events found dispatching network-vif-plugged-47cfa76f-2a3d-42e2-b7e9-824651b1dfe4 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:23:11 user nova-compute[75080]: WARNING nova.compute.manager [req-23c4793f-42e4-4ad5-9722-210d6a38424a req-75a4b48a-90c4-49f1-a194-55e54acbdc6e service nova] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Received unexpected event network-vif-plugged-47cfa76f-2a3d-42e2-b7e9-824651b1dfe4 for instance with vm_state deleted and task_state None.
Dec 05 15:23:11 user nova-compute[75080]: DEBUG nova.compute.manager [req-23c4793f-42e4-4ad5-9722-210d6a38424a req-75a4b48a-90c4-49f1-a194-55e54acbdc6e service nova] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Received event network-vif-plugged-47cfa76f-2a3d-42e2-b7e9-824651b1dfe4 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:23:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-23c4793f-42e4-4ad5-9722-210d6a38424a req-75a4b48a-90c4-49f1-a194-55e54acbdc6e service nova] Acquiring lock "30a4dd31-76bf-497e-b0d0-82bd70940e6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:23:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-23c4793f-42e4-4ad5-9722-210d6a38424a req-75a4b48a-90c4-49f1-a194-55e54acbdc6e service nova] Lock "30a4dd31-76bf-497e-b0d0-82bd70940e6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:23:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-23c4793f-42e4-4ad5-9722-210d6a38424a req-75a4b48a-90c4-49f1-a194-55e54acbdc6e service nova] Lock "30a4dd31-76bf-497e-b0d0-82bd70940e6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:23:11 user nova-compute[75080]: DEBUG nova.compute.manager [req-23c4793f-42e4-4ad5-9722-210d6a38424a req-75a4b48a-90c4-49f1-a194-55e54acbdc6e service nova] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] No waiting events found dispatching network-vif-plugged-47cfa76f-2a3d-42e2-b7e9-824651b1dfe4 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:23:11 user nova-compute[75080]: WARNING nova.compute.manager [req-23c4793f-42e4-4ad5-9722-210d6a38424a req-75a4b48a-90c4-49f1-a194-55e54acbdc6e service nova] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Received unexpected event network-vif-plugged-47cfa76f-2a3d-42e2-b7e9-824651b1dfe4 for instance with vm_state deleted and task_state None.
Dec 05 15:23:11 user nova-compute[75080]: DEBUG nova.compute.manager [req-23c4793f-42e4-4ad5-9722-210d6a38424a req-75a4b48a-90c4-49f1-a194-55e54acbdc6e service nova] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Received event network-vif-plugged-47cfa76f-2a3d-42e2-b7e9-824651b1dfe4 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:23:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-23c4793f-42e4-4ad5-9722-210d6a38424a req-75a4b48a-90c4-49f1-a194-55e54acbdc6e service nova] Acquiring lock "30a4dd31-76bf-497e-b0d0-82bd70940e6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:23:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-23c4793f-42e4-4ad5-9722-210d6a38424a req-75a4b48a-90c4-49f1-a194-55e54acbdc6e service nova] Lock "30a4dd31-76bf-497e-b0d0-82bd70940e6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:23:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-23c4793f-42e4-4ad5-9722-210d6a38424a req-75a4b48a-90c4-49f1-a194-55e54acbdc6e service nova] Lock "30a4dd31-76bf-497e-b0d0-82bd70940e6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:23:11 user nova-compute[75080]: DEBUG nova.compute.manager [req-23c4793f-42e4-4ad5-9722-210d6a38424a req-75a4b48a-90c4-49f1-a194-55e54acbdc6e service nova] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] No waiting events found dispatching network-vif-plugged-47cfa76f-2a3d-42e2-b7e9-824651b1dfe4 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:23:11 user nova-compute[75080]: WARNING nova.compute.manager [req-23c4793f-42e4-4ad5-9722-210d6a38424a req-75a4b48a-90c4-49f1-a194-55e54acbdc6e service nova] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Received unexpected event network-vif-plugged-47cfa76f-2a3d-42e2-b7e9-824651b1dfe4 for instance with vm_state deleted and task_state None.
Dec 05 15:23:11 user nova-compute[75080]: DEBUG nova.compute.manager [req-23c4793f-42e4-4ad5-9722-210d6a38424a req-75a4b48a-90c4-49f1-a194-55e54acbdc6e service nova] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Received event network-vif-plugged-47cfa76f-2a3d-42e2-b7e9-824651b1dfe4 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:23:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-23c4793f-42e4-4ad5-9722-210d6a38424a req-75a4b48a-90c4-49f1-a194-55e54acbdc6e service nova] Acquiring lock "30a4dd31-76bf-497e-b0d0-82bd70940e6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:23:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-23c4793f-42e4-4ad5-9722-210d6a38424a req-75a4b48a-90c4-49f1-a194-55e54acbdc6e service nova] Lock "30a4dd31-76bf-497e-b0d0-82bd70940e6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:23:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-23c4793f-42e4-4ad5-9722-210d6a38424a req-75a4b48a-90c4-49f1-a194-55e54acbdc6e service nova] Lock "30a4dd31-76bf-497e-b0d0-82bd70940e6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:23:11 user nova-compute[75080]: DEBUG nova.compute.manager [req-23c4793f-42e4-4ad5-9722-210d6a38424a req-75a4b48a-90c4-49f1-a194-55e54acbdc6e service nova] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] No waiting events found dispatching network-vif-plugged-47cfa76f-2a3d-42e2-b7e9-824651b1dfe4 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:23:11 user nova-compute[75080]: WARNING nova.compute.manager [req-23c4793f-42e4-4ad5-9722-210d6a38424a req-75a4b48a-90c4-49f1-a194-55e54acbdc6e service nova] [instance: 30a4dd31-76bf-497e-b0d0-82bd70940e6c] Received unexpected event network-vif-plugged-47cfa76f-2a3d-42e2-b7e9-824651b1dfe4 for instance with vm_state deleted and task_state None.
Dec 05 15:23:11 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:14 user nova-compute[75080]: DEBUG nova.compute.manager [req-ad52d881-54f4-4b5d-9064-37ccb5aa5fe7 req-0fa7a2d6-b2d6-4b84-a00f-150e64a9ab90 service nova] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Received event network-changed-fb2619ea-ffe7-4d82-9b44-984ee393620c {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:23:14 user nova-compute[75080]: DEBUG nova.compute.manager [req-ad52d881-54f4-4b5d-9064-37ccb5aa5fe7 req-0fa7a2d6-b2d6-4b84-a00f-150e64a9ab90 service nova] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Refreshing instance network info cache due to event network-changed-fb2619ea-ffe7-4d82-9b44-984ee393620c. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:23:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-ad52d881-54f4-4b5d-9064-37ccb5aa5fe7 req-0fa7a2d6-b2d6-4b84-a00f-150e64a9ab90 service nova] Acquiring lock "refresh_cache-5e29bda9-f1d6-4951-9343-f189934a8a23" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:23:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-ad52d881-54f4-4b5d-9064-37ccb5aa5fe7 req-0fa7a2d6-b2d6-4b84-a00f-150e64a9ab90 service nova] Acquired lock "refresh_cache-5e29bda9-f1d6-4951-9343-f189934a8a23" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:23:14 user nova-compute[75080]: DEBUG nova.network.neutron [req-ad52d881-54f4-4b5d-9064-37ccb5aa5fe7 req-0fa7a2d6-b2d6-4b84-a00f-150e64a9ab90 service nova] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Refreshing network info cache for port fb2619ea-ffe7-4d82-9b44-984ee393620c {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:23:14 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:14 user nova-compute[75080]: DEBUG nova.network.neutron [req-ad52d881-54f4-4b5d-9064-37ccb5aa5fe7 req-0fa7a2d6-b2d6-4b84-a00f-150e64a9ab90 service nova] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Updated VIF entry in instance network info cache for port fb2619ea-ffe7-4d82-9b44-984ee393620c. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:23:14 user nova-compute[75080]: DEBUG nova.network.neutron [req-ad52d881-54f4-4b5d-9064-37ccb5aa5fe7 req-0fa7a2d6-b2d6-4b84-a00f-150e64a9ab90 service nova] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Updating instance_info_cache with network_info: [{"id": "fb2619ea-ffe7-4d82-9b44-984ee393620c", "address": "fa:16:3e:4b:c9:8b", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb2619ea-ff", "ovs_interfaceid": "fb2619ea-ffe7-4d82-9b44-984ee393620c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:23:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-ad52d881-54f4-4b5d-9064-37ccb5aa5fe7 req-0fa7a2d6-b2d6-4b84-a00f-150e64a9ab90 service nova] Releasing lock "refresh_cache-5e29bda9-f1d6-4951-9343-f189934a8a23" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:23:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "5e29bda9-f1d6-4951-9343-f189934a8a23" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:23:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "5e29bda9-f1d6-4951-9343-f189934a8a23" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:23:14 user nova-compute[75080]: DEBUG nova.objects.instance [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lazy-loading 'flavor' on Instance uuid 5e29bda9-f1d6-4951-9343-f189934a8a23 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:23:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "5e29bda9-f1d6-4951-9343-f189934a8a23" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:23:14 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "5e29bda9-f1d6-4951-9343-f189934a8a23" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:23:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "5e29bda9-f1d6-4951-9343-f189934a8a23" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:23:15 user nova-compute[75080]: INFO nova.compute.manager [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Attaching volume fd29efe7-d1b9-4460-86f2-9eb719695989 to /dev/vdb
Dec 05 15:23:15 user nova-compute[75080]: DEBUG os_brick.utils [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:23:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:15 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1acffdc-dfaf-4315-80dc-20f3b71e5313]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:15 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd09b034-66b6-4a35-bd8a-e447ca89810c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:15 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8febadc6-e5eb-4a09-8d37-1cd12ae19000]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:15 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6486103-7809-41a3-aeeb-759291d50de0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:23:15 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:23:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:23:15 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:23:15 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5cc616-8a57-43ac-bc75-2f5262b07345]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:15 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:23:15 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:23:15 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:23:15 user nova-compute[75080]: DEBUG os_brick.utils [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:23:15 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Updating existing volume attachment record: 2b973bb2-db03-4423-9537-a75e1568981b {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:23:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:19 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:23:19 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Cleaning up deleted instances {{(pid=75080) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 05 15:23:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:19 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] There are 0 instances to clean {{(pid=75080) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 05 15:23:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b5ed3fbe-f8e2-43d0-8d6b-64a4a97d0338 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Acquiring lock "aeb779d7-8841-4f61-bd48-2781609ae66d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:23:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b5ed3fbe-f8e2-43d0-8d6b-64a4a97d0338 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Lock "aeb779d7-8841-4f61-bd48-2781609ae66d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:23:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b5ed3fbe-f8e2-43d0-8d6b-64a4a97d0338 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Acquiring lock "aeb779d7-8841-4f61-bd48-2781609ae66d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:23:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b5ed3fbe-f8e2-43d0-8d6b-64a4a97d0338 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Lock "aeb779d7-8841-4f61-bd48-2781609ae66d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:23:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b5ed3fbe-f8e2-43d0-8d6b-64a4a97d0338 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Lock "aeb779d7-8841-4f61-bd48-2781609ae66d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:23:19 user nova-compute[75080]: INFO nova.compute.manager [None req-b5ed3fbe-f8e2-43d0-8d6b-64a4a97d0338 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Terminating instance
Dec 05 15:23:19 user nova-compute[75080]: DEBUG nova.compute.manager [None req-b5ed3fbe-f8e2-43d0-8d6b-64a4a97d0338 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:23:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:20 user nova-compute[75080]: DEBUG nova.compute.manager [req-beeeb941-c1a5-4322-b501-be8565bf5be5 req-956b4f20-f514-4efb-8df1-7386daca4c71 service nova] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Received event network-vif-unplugged-7189c99b-944c-4956-8d70-0c98f2ddbf22 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:23:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-beeeb941-c1a5-4322-b501-be8565bf5be5 req-956b4f20-f514-4efb-8df1-7386daca4c71 service nova] Acquiring lock "aeb779d7-8841-4f61-bd48-2781609ae66d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:23:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-beeeb941-c1a5-4322-b501-be8565bf5be5 req-956b4f20-f514-4efb-8df1-7386daca4c71 service nova] Lock "aeb779d7-8841-4f61-bd48-2781609ae66d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:23:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-beeeb941-c1a5-4322-b501-be8565bf5be5 req-956b4f20-f514-4efb-8df1-7386daca4c71 service nova] Lock "aeb779d7-8841-4f61-bd48-2781609ae66d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:23:20 user nova-compute[75080]: DEBUG nova.compute.manager [req-beeeb941-c1a5-4322-b501-be8565bf5be5 req-956b4f20-f514-4efb-8df1-7386daca4c71 service nova] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] No waiting events found dispatching network-vif-unplugged-7189c99b-944c-4956-8d70-0c98f2ddbf22 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:23:20 user nova-compute[75080]: DEBUG nova.compute.manager [req-beeeb941-c1a5-4322-b501-be8565bf5be5 req-956b4f20-f514-4efb-8df1-7386daca4c71 service nova] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Received event network-vif-unplugged-7189c99b-944c-4956-8d70-0c98f2ddbf22 for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:23:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Acquiring lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:23:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:23:20 user nova-compute[75080]: DEBUG nova.compute.manager [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:23:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:23:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:23:20 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:23:20 user nova-compute[75080]: INFO nova.compute.claims [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Claim successful on node user
Dec 05 15:23:20 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Instance destroyed successfully.
Dec 05 15:23:20 user nova-compute[75080]: DEBUG nova.objects.instance [None req-b5ed3fbe-f8e2-43d0-8d6b-64a4a97d0338 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Lazy-loading 'resources' on Instance uuid aeb779d7-8841-4f61-bd48-2781609ae66d {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:23:20 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-b5ed3fbe-f8e2-43d0-8d6b-64a4a97d0338 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1839844675',display_name='tempest-VolumesActionsTest-instance-1839844675',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1839844675',id=15,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:21:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='902ae7a7ca524dfa83b98c3baebc42eb',ramdisk_id='',reservation_id='r-yszav6o1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-10205127',owner_user_name='tempest-VolumesActionsTest-10205127-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:21:39Z,user_data=None,user_id='fc3019c10eb549e984490b34eee7814e',uuid=aeb779d7-8841-4f61-bd48-2781609ae66d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7189c99b-944c-4956-8d70-0c98f2ddbf22", "address": "fa:16:3e:9b:0a:c8", "network": {"id": "6d5934bf-c431-4a09-8065-8928349e88a0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-238283929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "902ae7a7ca524dfa83b98c3baebc42eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7189c99b-94", "ovs_interfaceid": "7189c99b-944c-4956-8d70-0c98f2ddbf22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:23:20 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-b5ed3fbe-f8e2-43d0-8d6b-64a4a97d0338 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Converting VIF {"id": "7189c99b-944c-4956-8d70-0c98f2ddbf22", "address": "fa:16:3e:9b:0a:c8", "network": {"id": "6d5934bf-c431-4a09-8065-8928349e88a0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-238283929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "902ae7a7ca524dfa83b98c3baebc42eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7189c99b-94", "ovs_interfaceid": "7189c99b-944c-4956-8d70-0c98f2ddbf22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:23:20 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-b5ed3fbe-f8e2-43d0-8d6b-64a4a97d0338 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:0a:c8,bridge_name='br-int',has_traffic_filtering=True,id=7189c99b-944c-4956-8d70-0c98f2ddbf22,network=Network(6d5934bf-c431-4a09-8065-8928349e88a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7189c99b-94') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:23:20 user nova-compute[75080]: DEBUG os_vif [None req-b5ed3fbe-f8e2-43d0-8d6b-64a4a97d0338 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:0a:c8,bridge_name='br-int',has_traffic_filtering=True,id=7189c99b-944c-4956-8d70-0c98f2ddbf22,network=Network(6d5934bf-c431-4a09-8065-8928349e88a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7189c99b-94') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:23:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7189c99b-94, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:23:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:23:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7317cd53-1917-4d4a-898c-7c071bf6f171) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:23:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:20 user nova-compute[75080]: INFO os_vif [None req-b5ed3fbe-f8e2-43d0-8d6b-64a4a97d0338 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:0a:c8,bridge_name='br-int',has_traffic_filtering=True,id=7189c99b-944c-4956-8d70-0c98f2ddbf22,network=Network(6d5934bf-c431-4a09-8065-8928349e88a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7189c99b-94')
Dec 05 15:23:20 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-b5ed3fbe-f8e2-43d0-8d6b-64a4a97d0338 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Deleting instance files /opt/stack/data/nova/instances/aeb779d7-8841-4f61-bd48-2781609ae66d_del
Dec 05 15:23:20 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-b5ed3fbe-f8e2-43d0-8d6b-64a4a97d0338 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Deletion of /opt/stack/data/nova/instances/aeb779d7-8841-4f61-bd48-2781609ae66d_del complete
Dec 05 15:23:20 user nova-compute[75080]: INFO nova.compute.manager [None req-b5ed3fbe-f8e2-43d0-8d6b-64a4a97d0338 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Took 0.96 seconds to destroy the instance on the hypervisor.
Dec 05 15:23:20 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-b5ed3fbe-f8e2-43d0-8d6b-64a4a97d0338 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:23:20 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:23:20 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:23:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Acquiring lock "6bf0a828-329b-46cf-aa76-bf6c24f08212" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:23:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:23:20 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:23:20 user nova-compute[75080]: DEBUG nova.compute.manager [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:23:20 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:23:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.568s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:23:20 user nova-compute[75080]: DEBUG nova.compute.manager [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:23:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:23:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:23:21 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:23:21 user nova-compute[75080]: INFO nova.compute.claims [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Claim successful on node user
Dec 05 15:23:21 user nova-compute[75080]: DEBUG nova.compute.manager [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:23:21 user nova-compute[75080]: DEBUG nova.network.neutron [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:23:21 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:23:21 user nova-compute[75080]: DEBUG nova.compute.manager [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:23:21 user nova-compute[75080]: DEBUG nova.policy [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '180f6d2698714da0b8585c593d91412f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf8f0b6db8b4faeb2c3f5b580e05600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:23:21 user nova-compute[75080]: DEBUG nova.compute.manager [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:23:21 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:23:21 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Creating image(s)
Dec 05 15:23:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Acquiring lock "/opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:23:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lock "/opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:23:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lock "/opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:23:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.187s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:23:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:23:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:21 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:23:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.182s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:21 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:23:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk 1073741824" returned: 0 in 0.062s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:23:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.672s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:23:21 user nova-compute[75080]: DEBUG nova.compute.manager [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:23:21 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:23:21 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Took 1.10 seconds to deallocate network for instance.
Dec 05 15:23:21 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:21 user nova-compute[75080]: DEBUG nova.compute.manager [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:23:21 user nova-compute[75080]: DEBUG nova.network.neutron [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:23:21 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:23:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b5ed3fbe-f8e2-43d0-8d6b-64a4a97d0338 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:23:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b5ed3fbe-f8e2-43d0-8d6b-64a4a97d0338 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:23:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.197s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:21 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Checking if we can resize image /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 15:23:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:21 user nova-compute[75080]: DEBUG nova.network.neutron [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Successfully created port: 6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:23:21 user nova-compute[75080]: DEBUG nova.compute.manager [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:23:21 user nova-compute[75080]: INFO nova.virt.block_device [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Booting with volume d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb at /dev/vda
Dec 05 15:23:22 user nova-compute[75080]: DEBUG nova.policy [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c369909d6cb47cfaad8670df22f4e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318ca7ad8bc84749ab0d0fb1e8aa34e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Cannot resize image /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Ensure instance console log exists: /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG os_brick.utils [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c290779-a0b6-4f33-a832-9ca965e3699a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc53d4c2-081f-4824-9ba1-eddba253a95a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b93548a-0bb3-41ae-aa7a-4865ca247691]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[133271d5-13d8-4b63-960c-5845acc9b1ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG nova.compute.manager [req-ec68e5d9-f54b-489f-b540-789ca822bfa8 req-59c321af-6f93-4978-ac6e-d0cc9343ed36 service nova] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Received event network-vif-plugged-7189c99b-944c-4956-8d70-0c98f2ddbf22 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-ec68e5d9-f54b-489f-b540-789ca822bfa8 req-59c321af-6f93-4978-ac6e-d0cc9343ed36 service nova] Acquiring lock "aeb779d7-8841-4f61-bd48-2781609ae66d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-ec68e5d9-f54b-489f-b540-789ca822bfa8 req-59c321af-6f93-4978-ac6e-d0cc9343ed36 service nova] Lock "aeb779d7-8841-4f61-bd48-2781609ae66d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-ec68e5d9-f54b-489f-b540-789ca822bfa8 req-59c321af-6f93-4978-ac6e-d0cc9343ed36 service nova] Lock "aeb779d7-8841-4f61-bd48-2781609ae66d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG nova.compute.manager [req-ec68e5d9-f54b-489f-b540-789ca822bfa8 req-59c321af-6f93-4978-ac6e-d0cc9343ed36 service nova] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] No waiting events found dispatching network-vif-plugged-7189c99b-944c-4956-8d70-0c98f2ddbf22 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:23:22 user nova-compute[75080]: WARNING nova.compute.manager [req-ec68e5d9-f54b-489f-b540-789ca822bfa8 req-59c321af-6f93-4978-ac6e-d0cc9343ed36 service nova] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Received unexpected event network-vif-plugged-7189c99b-944c-4956-8d70-0c98f2ddbf22 for instance with vm_state deleted and task_state None.
Dec 05 15:23:22 user nova-compute[75080]: DEBUG nova.compute.manager [req-ec68e5d9-f54b-489f-b540-789ca822bfa8 req-59c321af-6f93-4978-ac6e-d0cc9343ed36 service nova] [instance: aeb779d7-8841-4f61-bd48-2781609ae66d] Received event network-vif-deleted-7189c99b-944c-4956-8d70-0c98f2ddbf22 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:23:22 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:23:22 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c137c44d-101b-4719-8b69-fcb4428488f1]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG os_brick.utils [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Updating existing volume attachment record: 12f9146b-5c45-4bf7-b00a-e517038546b3 {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-b5ed3fbe-f8e2-43d0-8d6b-64a4a97d0338 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-b5ed3fbe-f8e2-43d0-8d6b-64a4a97d0338 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b5ed3fbe-f8e2-43d0-8d6b-64a4a97d0338 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.534s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:23:22 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-b5ed3fbe-f8e2-43d0-8d6b-64a4a97d0338 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Deleted allocations for instance aeb779d7-8841-4f61-bd48-2781609ae66d
Dec 05 15:23:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75080) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b5ed3fbe-f8e2-43d0-8d6b-64a4a97d0338 tempest-VolumesActionsTest-10205127 tempest-VolumesActionsTest-10205127-project-member] Lock "aeb779d7-8841-4f61-bd48-2781609ae66d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.826s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG nova.network.neutron [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Successfully updated port: 6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Acquiring lock "refresh_cache-60b8e21f-5fbd-4bc5-95ad-8d743ec796f7" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Acquired lock "refresh_cache-60b8e21f-5fbd-4bc5-95ad-8d743ec796f7" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG nova.network.neutron [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG nova.compute.manager [req-643bf37b-b1cc-4498-a786-c093f1b45c65 req-84d25eca-63fa-4e8c-a4b1-0127231ab599 service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Received event network-changed-6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG nova.compute.manager [req-643bf37b-b1cc-4498-a786-c093f1b45c65 req-84d25eca-63fa-4e8c-a4b1-0127231ab599 service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Refreshing instance network info cache due to event network-changed-6b187ba9-e311-4d40-8aa9-8f00feb45d88. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-643bf37b-b1cc-4498-a786-c093f1b45c65 req-84d25eca-63fa-4e8c-a4b1-0127231ab599 service nova] Acquiring lock "refresh_cache-60b8e21f-5fbd-4bc5-95ad-8d743ec796f7" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG nova.network.neutron [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:23:22 user nova-compute[75080]: DEBUG nova.network.neutron [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Successfully created port: 0250593a-4991-4e30-9e86-4f403f81bbe6 {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG nova.network.neutron [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Successfully created port: 7a891d10-f2c1-4a8e-b404-67372485e9a5 {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG nova.network.neutron [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Updating instance_info_cache with network_info: [{"id": "6b187ba9-e311-4d40-8aa9-8f00feb45d88", "address": "fa:16:3e:3b:1f:ec", "network": {"id": "98270770-6a03-4b54-9160-a049184a508d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1275663774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecf8f0b6db8b4faeb2c3f5b580e05600", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b187ba9-e3", "ovs_interfaceid": "6b187ba9-e311-4d40-8aa9-8f00feb45d88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Releasing lock "refresh_cache-60b8e21f-5fbd-4bc5-95ad-8d743ec796f7" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG nova.compute.manager [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Instance network_info: |[{"id": "6b187ba9-e311-4d40-8aa9-8f00feb45d88", "address": "fa:16:3e:3b:1f:ec", "network": {"id": "98270770-6a03-4b54-9160-a049184a508d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1275663774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecf8f0b6db8b4faeb2c3f5b580e05600", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b187ba9-e3", "ovs_interfaceid": "6b187ba9-e311-4d40-8aa9-8f00feb45d88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-643bf37b-b1cc-4498-a786-c093f1b45c65 req-84d25eca-63fa-4e8c-a4b1-0127231ab599 service nova] Acquired lock "refresh_cache-60b8e21f-5fbd-4bc5-95ad-8d743ec796f7" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG nova.network.neutron [req-643bf37b-b1cc-4498-a786-c093f1b45c65 req-84d25eca-63fa-4e8c-a4b1-0127231ab599 service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Refreshing network info cache for port 6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Start _get_guest_xml network_info=[{"id": "6b187ba9-e311-4d40-8aa9-8f00feb45d88", "address": "fa:16:3e:3b:1f:ec", "network": {"id": "98270770-6a03-4b54-9160-a049184a508d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1275663774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecf8f0b6db8b4faeb2c3f5b580e05600", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b187ba9-e3", "ovs_interfaceid": "6b187ba9-e311-4d40-8aa9-8f00feb45d88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:23:23 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:23:23 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:23:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-44459294',display_name='tempest-ServerStableDeviceRescueTest-server-44459294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-44459294',id=19,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPWS3/W2vhVnzZ3NaYXtEquVmBoozY3zOCiGSaoCx4S9+RZI8lcD2eBXGHkJL7aTNIcbbWFdKvFHZ3EJ7KZ38K040A64F6R0O0DMD87IGDq0dpPKOqp9lZ2b8iXtRJnSg==',key_name='tempest-keypair-110561965',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ecf8f0b6db8b4faeb2c3f5b580e05600',ramdisk_id='',reservation_id='r-9pxkj28l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-701514044',owner_user_name='tempest-ServerStableDeviceRescueTest-701514044-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:23:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='180f6d2698714da0b8585c593d91412f',uuid=60b8e21f-5fbd-4bc5-95ad-8d743ec796f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b187ba9-e311-4d40-8aa9-8f00feb45d88", "address": "fa:16:3e:3b:1f:ec", "network": {"id": "98270770-6a03-4b54-9160-a049184a508d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1275663774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecf8f0b6db8b4faeb2c3f5b580e05600", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b187ba9-e3", "ovs_interfaceid": "6b187ba9-e311-4d40-8aa9-8f00feb45d88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Converting VIF {"id": "6b187ba9-e311-4d40-8aa9-8f00feb45d88", "address": "fa:16:3e:3b:1f:ec", "network": {"id": "98270770-6a03-4b54-9160-a049184a508d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1275663774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecf8f0b6db8b4faeb2c3f5b580e05600", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b187ba9-e3", "ovs_interfaceid": "6b187ba9-e311-4d40-8aa9-8f00feb45d88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:1f:ec,bridge_name='br-int',has_traffic_filtering=True,id=6b187ba9-e311-4d40-8aa9-8f00feb45d88,network=Network(98270770-6a03-4b54-9160-a049184a508d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b187ba9-e3') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG nova.objects.instance [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lazy-loading 'pci_devices' on Instance uuid 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:23:23 user nova-compute[75080]:   <uuid>60b8e21f-5fbd-4bc5-95ad-8d743ec796f7</uuid>
Dec 05 15:23:23 user nova-compute[75080]:   <name>instance-00000013</name>
Dec 05 15:23:23 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:23:23 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:23:23 user nova-compute[75080]:   <metadata>
Dec 05 15:23:23 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:23:23 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:23:23 user nova-compute[75080]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-44459294</nova:name>
Dec 05 15:23:23 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:23:23</nova:creationTime>
Dec 05 15:23:23 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:23:23 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:23:23 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:23:23 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:23:23 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:23:23 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:23:23 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:23:23 user nova-compute[75080]:       <nova:owner>
Dec 05 15:23:23 user nova-compute[75080]:         <nova:user uuid="180f6d2698714da0b8585c593d91412f">tempest-ServerStableDeviceRescueTest-701514044-project-member</nova:user>
Dec 05 15:23:23 user nova-compute[75080]:         <nova:project uuid="ecf8f0b6db8b4faeb2c3f5b580e05600">tempest-ServerStableDeviceRescueTest-701514044</nova:project>
Dec 05 15:23:23 user nova-compute[75080]:       </nova:owner>
Dec 05 15:23:23 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:23:23 user nova-compute[75080]:       <nova:ports>
Dec 05 15:23:23 user nova-compute[75080]:         <nova:port uuid="6b187ba9-e311-4d40-8aa9-8f00feb45d88">
Dec 05 15:23:23 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 05 15:23:23 user nova-compute[75080]:         </nova:port>
Dec 05 15:23:23 user nova-compute[75080]:       </nova:ports>
Dec 05 15:23:23 user nova-compute[75080]:     </nova:instance>
Dec 05 15:23:23 user nova-compute[75080]:   </metadata>
Dec 05 15:23:23 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:23:23 user nova-compute[75080]:     <system>
Dec 05 15:23:23 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:23:23 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:23:23 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:23:23 user nova-compute[75080]:       <entry name="serial">60b8e21f-5fbd-4bc5-95ad-8d743ec796f7</entry>
Dec 05 15:23:23 user nova-compute[75080]:       <entry name="uuid">60b8e21f-5fbd-4bc5-95ad-8d743ec796f7</entry>
Dec 05 15:23:23 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:23:23 user nova-compute[75080]:     </system>
Dec 05 15:23:23 user nova-compute[75080]:   </sysinfo>
Dec 05 15:23:23 user nova-compute[75080]:   <os>
Dec 05 15:23:23 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:23:23 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:23:23 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:23:23 user nova-compute[75080]:   </os>
Dec 05 15:23:23 user nova-compute[75080]:   <features>
Dec 05 15:23:23 user nova-compute[75080]:     <acpi/>
Dec 05 15:23:23 user nova-compute[75080]:     <apic/>
Dec 05 15:23:23 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:23:23 user nova-compute[75080]:   </features>
Dec 05 15:23:23 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:23:23 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:23:23 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:23:23 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:23:23 user nova-compute[75080]:   </clock>
Dec 05 15:23:23 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:23:23 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:23:23 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:23:23 user nova-compute[75080]:   </cpu>
Dec 05 15:23:23 user nova-compute[75080]:   <devices>
Dec 05 15:23:23 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:23:23 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:23:23 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk"/>
Dec 05 15:23:23 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:23:23 user nova-compute[75080]:     </disk>
Dec 05 15:23:23 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:23:23 user nova-compute[75080]:       <mac address="fa:16:3e:3b:1f:ec"/>
Dec 05 15:23:23 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:23:23 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:23:23 user nova-compute[75080]:       <target dev="tap6b187ba9-e3"/>
Dec 05 15:23:23 user nova-compute[75080]:     </interface>
Dec 05 15:23:23 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:23:23 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/console.log" append="off"/>
Dec 05 15:23:23 user nova-compute[75080]:     </serial>
Dec 05 15:23:23 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:23:23 user nova-compute[75080]:     <video>
Dec 05 15:23:23 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:23:23 user nova-compute[75080]:     </video>
Dec 05 15:23:23 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:23:23 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:23:23 user nova-compute[75080]:     </rng>
Dec 05 15:23:23 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:23:23 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:23:23 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:23:23 user nova-compute[75080]:     </memballoon>
Dec 05 15:23:23 user nova-compute[75080]:   </devices>
Dec 05 15:23:23 user nova-compute[75080]: </domain>
Dec 05 15:23:23 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-44459294',display_name='tempest-ServerStableDeviceRescueTest-server-44459294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-44459294',id=19,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPWS3/W2vhVnzZ3NaYXtEquVmBoozY3zOCiGSaoCx4S9+RZI8lcD2eBXGHkJL7aTNIcbbWFdKvFHZ3EJ7KZ38K040A64F6R0O0DMD87IGDq0dpPKOqp9lZ2b8iXtRJnSg==',key_name='tempest-keypair-110561965',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ecf8f0b6db8b4faeb2c3f5b580e05600',ramdisk_id='',reservation_id='r-9pxkj28l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-701514044',owner_user_name='tempest-ServerStableDeviceRescueTest-701514044-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:23:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='180f6d2698714da0b8585c593d91412f',uuid=60b8e21f-5fbd-4bc5-95ad-8d743ec796f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b187ba9-e311-4d40-8aa9-8f00feb45d88", "address": "fa:16:3e:3b:1f:ec", "network": {"id": "98270770-6a03-4b54-9160-a049184a508d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1275663774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecf8f0b6db8b4faeb2c3f5b580e05600", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b187ba9-e3", "ovs_interfaceid": "6b187ba9-e311-4d40-8aa9-8f00feb45d88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Converting VIF {"id": "6b187ba9-e311-4d40-8aa9-8f00feb45d88", "address": "fa:16:3e:3b:1f:ec", "network": {"id": "98270770-6a03-4b54-9160-a049184a508d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1275663774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecf8f0b6db8b4faeb2c3f5b580e05600", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b187ba9-e3", "ovs_interfaceid": "6b187ba9-e311-4d40-8aa9-8f00feb45d88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:1f:ec,bridge_name='br-int',has_traffic_filtering=True,id=6b187ba9-e311-4d40-8aa9-8f00feb45d88,network=Network(98270770-6a03-4b54-9160-a049184a508d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b187ba9-e3') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG os_vif [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:1f:ec,bridge_name='br-int',has_traffic_filtering=True,id=6b187ba9-e311-4d40-8aa9-8f00feb45d88,network=Network(98270770-6a03-4b54-9160-a049184a508d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b187ba9-e3') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f5f06f51-8977-59e4-9107-c049b3cc5246', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b187ba9-e3, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6b187ba9-e3, col_values=(('qos', UUID('c36a5223-c8cf-45b9-b98b-93602932bd88')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6b187ba9-e3, col_values=(('external_ids', {'iface-id': '6b187ba9-e311-4d40-8aa9-8f00feb45d88', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:1f:ec', 'vm-uuid': '60b8e21f-5fbd-4bc5-95ad-8d743ec796f7'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:23 user nova-compute[75080]: INFO os_vif [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:1f:ec,bridge_name='br-int',has_traffic_filtering=True,id=6b187ba9-e311-4d40-8aa9-8f00feb45d88,network=Network(98270770-6a03-4b54-9160-a049184a508d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b187ba9-e3')
Dec 05 15:23:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] No VIF found with MAC fa:16:3e:3b:1f:ec, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG nova.network.neutron [req-643bf37b-b1cc-4498-a786-c093f1b45c65 req-84d25eca-63fa-4e8c-a4b1-0127231ab599 service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Updated VIF entry in instance network info cache for port 6b187ba9-e311-4d40-8aa9-8f00feb45d88. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG nova.network.neutron [req-643bf37b-b1cc-4498-a786-c093f1b45c65 req-84d25eca-63fa-4e8c-a4b1-0127231ab599 service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Updating instance_info_cache with network_info: [{"id": "6b187ba9-e311-4d40-8aa9-8f00feb45d88", "address": "fa:16:3e:3b:1f:ec", "network": {"id": "98270770-6a03-4b54-9160-a049184a508d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1275663774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecf8f0b6db8b4faeb2c3f5b580e05600", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b187ba9-e3", "ovs_interfaceid": "6b187ba9-e311-4d40-8aa9-8f00feb45d88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-643bf37b-b1cc-4498-a786-c093f1b45c65 req-84d25eca-63fa-4e8c-a4b1-0127231ab599 service nova] Releasing lock "refresh_cache-60b8e21f-5fbd-4bc5-95ad-8d743ec796f7" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:23:23 user nova-compute[75080]: DEBUG nova.network.neutron [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Successfully created port: 362dc737-7651-44c0-a618-ed6a1bcbee5c {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:23:24 user nova-compute[75080]: DEBUG nova.network.neutron [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Successfully created port: eb4d8798-73e9-4b84-91f1-8a6578f22ac1 {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:23:24 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:23:24 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:23:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:24 user nova-compute[75080]: DEBUG nova.network.neutron [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Successfully created port: 510c5cfb-99de-4b45-aa65-a1c7a53969ea {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:23:25 user nova-compute[75080]: DEBUG nova.compute.manager [req-0edeef4f-e831-42e3-ab98-3eea4b9eb729 req-5452119b-cbb2-4972-bb14-058ab2aff1ff service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Received event network-vif-plugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:23:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0edeef4f-e831-42e3-ab98-3eea4b9eb729 req-5452119b-cbb2-4972-bb14-058ab2aff1ff service nova] Acquiring lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:23:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0edeef4f-e831-42e3-ab98-3eea4b9eb729 req-5452119b-cbb2-4972-bb14-058ab2aff1ff service nova] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:23:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0edeef4f-e831-42e3-ab98-3eea4b9eb729 req-5452119b-cbb2-4972-bb14-058ab2aff1ff service nova] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:23:25 user nova-compute[75080]: DEBUG nova.compute.manager [req-0edeef4f-e831-42e3-ab98-3eea4b9eb729 req-5452119b-cbb2-4972-bb14-058ab2aff1ff service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] No waiting events found dispatching network-vif-plugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:23:25 user nova-compute[75080]: WARNING nova.compute.manager [req-0edeef4f-e831-42e3-ab98-3eea4b9eb729 req-5452119b-cbb2-4972-bb14-058ab2aff1ff service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Received unexpected event network-vif-plugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 for instance with vm_state building and task_state spawning.
Dec 05 15:23:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:25 user nova-compute[75080]: DEBUG nova.network.neutron [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Successfully updated port: 0250593a-4991-4e30-9e86-4f403f81bbe6 {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:23:25 user nova-compute[75080]: DEBUG nova.compute.manager [req-050d60a1-c016-4319-b043-e4156322ff24 req-9dd8efb6-bfb8-4e22-b233-1e8e912135dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-changed-0250593a-4991-4e30-9e86-4f403f81bbe6 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:23:25 user nova-compute[75080]: DEBUG nova.compute.manager [req-050d60a1-c016-4319-b043-e4156322ff24 req-9dd8efb6-bfb8-4e22-b233-1e8e912135dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Refreshing instance network info cache due to event network-changed-0250593a-4991-4e30-9e86-4f403f81bbe6. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:23:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-050d60a1-c016-4319-b043-e4156322ff24 req-9dd8efb6-bfb8-4e22-b233-1e8e912135dc service nova] Acquiring lock "refresh_cache-6bf0a828-329b-46cf-aa76-bf6c24f08212" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:23:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-050d60a1-c016-4319-b043-e4156322ff24 req-9dd8efb6-bfb8-4e22-b233-1e8e912135dc service nova] Acquired lock "refresh_cache-6bf0a828-329b-46cf-aa76-bf6c24f08212" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:23:25 user nova-compute[75080]: DEBUG nova.network.neutron [req-050d60a1-c016-4319-b043-e4156322ff24 req-9dd8efb6-bfb8-4e22-b233-1e8e912135dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Refreshing network info cache for port 0250593a-4991-4e30-9e86-4f403f81bbe6 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:23:26 user nova-compute[75080]: DEBUG nova.network.neutron [req-050d60a1-c016-4319-b043-e4156322ff24 req-9dd8efb6-bfb8-4e22-b233-1e8e912135dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:23:26 user nova-compute[75080]: DEBUG nova.network.neutron [req-050d60a1-c016-4319-b043-e4156322ff24 req-9dd8efb6-bfb8-4e22-b233-1e8e912135dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:23:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-050d60a1-c016-4319-b043-e4156322ff24 req-9dd8efb6-bfb8-4e22-b233-1e8e912135dc service nova] Releasing lock "refresh_cache-6bf0a828-329b-46cf-aa76-bf6c24f08212" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:23:26 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:23:26 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:23:26 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:23:26 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Rebuilding the list of instances to heal {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 15:23:26 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Skipping network cache update for instance because it is Building. {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Dec 05 15:23:26 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Skipping network cache update for instance because it is Building. {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Dec 05 15:23:26 user nova-compute[75080]: DEBUG nova.network.neutron [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Successfully updated port: 70683181-d134-4a6c-9bc4-9dcf7b019162 {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:23:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-bd75375a-8b70-4bc2-a72b-14213ebaa4e9" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:23:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-bd75375a-8b70-4bc2-a72b-14213ebaa4e9" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:23:26 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 15:23:26 user nova-compute[75080]: DEBUG nova.objects.instance [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lazy-loading 'info_cache' on Instance uuid bd75375a-8b70-4bc2-a72b-14213ebaa4e9 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:23:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:27 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Updating instance_info_cache with network_info: [{"id": "06f46569-efd3-4978-b954-cdbb51b09e30", "address": "fa:16:3e:8e:cb:88", "network": {"id": "05b09885-a021-44b4-b8d6-1504a4c2dfeb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1903039338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e73fbf2c414f32bcdeef4bae598b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f46569-ef", "ovs_interfaceid": "06f46569-efd3-4978-b954-cdbb51b09e30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:23:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-bd75375a-8b70-4bc2-a72b-14213ebaa4e9" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:23:27 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 15:23:27 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:23:27 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:23:27 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:23:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:23:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:23:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:23:27 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:23:27 user nova-compute[75080]: DEBUG nova.compute.manager [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:23:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:23:27 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Instance spawned successfully.
Dec 05 15:23:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:23:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:23:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:23:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:23:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:23:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:23:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:23:27 user nova-compute[75080]: DEBUG nova.compute.manager [req-2264bdbd-6db8-47a5-82fa-c1cf6bd5df6c req-ad3d72f4-2811-4595-a1f7-5d9c63056978 service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Received event network-vif-plugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:23:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2264bdbd-6db8-47a5-82fa-c1cf6bd5df6c req-ad3d72f4-2811-4595-a1f7-5d9c63056978 service nova] Acquiring lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:23:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2264bdbd-6db8-47a5-82fa-c1cf6bd5df6c req-ad3d72f4-2811-4595-a1f7-5d9c63056978 service nova] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:23:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2264bdbd-6db8-47a5-82fa-c1cf6bd5df6c req-ad3d72f4-2811-4595-a1f7-5d9c63056978 service nova] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:23:27 user nova-compute[75080]: DEBUG nova.compute.manager [req-2264bdbd-6db8-47a5-82fa-c1cf6bd5df6c req-ad3d72f4-2811-4595-a1f7-5d9c63056978 service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] No waiting events found dispatching network-vif-plugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:23:27 user nova-compute[75080]: WARNING nova.compute.manager [req-2264bdbd-6db8-47a5-82fa-c1cf6bd5df6c req-ad3d72f4-2811-4595-a1f7-5d9c63056978 service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Received unexpected event network-vif-plugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 for instance with vm_state building and task_state spawning.
Dec 05 15:23:27 user nova-compute[75080]: INFO nova.compute.manager [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Took 5.97 seconds to spawn the instance on the hypervisor.
Dec 05 15:23:27 user nova-compute[75080]: DEBUG nova.compute.manager [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:23:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:27 user nova-compute[75080]: DEBUG nova.network.neutron [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Successfully updated port: 58b3e25c-cbd6-4bdd-83e8-775a0708df4e {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:23:27 user nova-compute[75080]: INFO nova.compute.manager [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Took 6.93 seconds to build instance.
Dec 05 15:23:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3a01efff-fc97-4fc1-9a60-321cb2d29c48 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.032s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:23:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:27 user nova-compute[75080]: DEBUG nova.network.neutron [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Successfully updated port: 7a891d10-f2c1-4a8e-b404-67372485e9a5 {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:23:27 user nova-compute[75080]: DEBUG nova.compute.manager [req-20017862-05ec-469b-8891-fed2363afbdf req-16f6cc55-e422-490a-a262-497782011667 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-changed-70683181-d134-4a6c-9bc4-9dcf7b019162 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:23:27 user nova-compute[75080]: DEBUG nova.compute.manager [req-20017862-05ec-469b-8891-fed2363afbdf req-16f6cc55-e422-490a-a262-497782011667 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Refreshing instance network info cache due to event network-changed-70683181-d134-4a6c-9bc4-9dcf7b019162. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:23:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-20017862-05ec-469b-8891-fed2363afbdf req-16f6cc55-e422-490a-a262-497782011667 service nova] Acquiring lock "refresh_cache-6bf0a828-329b-46cf-aa76-bf6c24f08212" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:23:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-20017862-05ec-469b-8891-fed2363afbdf req-16f6cc55-e422-490a-a262-497782011667 service nova] Acquired lock "refresh_cache-6bf0a828-329b-46cf-aa76-bf6c24f08212" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:23:27 user nova-compute[75080]: DEBUG nova.network.neutron [req-20017862-05ec-469b-8891-fed2363afbdf req-16f6cc55-e422-490a-a262-497782011667 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Refreshing network info cache for port 70683181-d134-4a6c-9bc4-9dcf7b019162 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:23:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:28 user nova-compute[75080]: DEBUG nova.network.neutron [req-20017862-05ec-469b-8891-fed2363afbdf req-16f6cc55-e422-490a-a262-497782011667 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:23:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:28 user nova-compute[75080]: DEBUG nova.network.neutron [req-20017862-05ec-469b-8891-fed2363afbdf req-16f6cc55-e422-490a-a262-497782011667 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:23:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-20017862-05ec-469b-8891-fed2363afbdf req-16f6cc55-e422-490a-a262-497782011667 service nova] Releasing lock "refresh_cache-6bf0a828-329b-46cf-aa76-bf6c24f08212" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:23:28 user nova-compute[75080]: DEBUG nova.network.neutron [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Successfully updated port: 362dc737-7651-44c0-a618-ed6a1bcbee5c {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:23:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:29 user nova-compute[75080]: DEBUG nova.compute.manager [req-98c0d5f3-458c-43b0-8e4b-77748fc8b09c req-327b8f59-fd13-4ce6-b98b-a82088116507 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-changed-58b3e25c-cbd6-4bdd-83e8-775a0708df4e {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:23:29 user nova-compute[75080]: DEBUG nova.compute.manager [req-98c0d5f3-458c-43b0-8e4b-77748fc8b09c req-327b8f59-fd13-4ce6-b98b-a82088116507 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Refreshing instance network info cache due to event network-changed-58b3e25c-cbd6-4bdd-83e8-775a0708df4e. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:23:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-98c0d5f3-458c-43b0-8e4b-77748fc8b09c req-327b8f59-fd13-4ce6-b98b-a82088116507 service nova] Acquiring lock "refresh_cache-6bf0a828-329b-46cf-aa76-bf6c24f08212" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:23:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-98c0d5f3-458c-43b0-8e4b-77748fc8b09c req-327b8f59-fd13-4ce6-b98b-a82088116507 service nova] Acquired lock "refresh_cache-6bf0a828-329b-46cf-aa76-bf6c24f08212" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:23:29 user nova-compute[75080]: DEBUG nova.network.neutron [req-98c0d5f3-458c-43b0-8e4b-77748fc8b09c req-327b8f59-fd13-4ce6-b98b-a82088116507 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Refreshing network info cache for port 58b3e25c-cbd6-4bdd-83e8-775a0708df4e {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:23:29 user nova-compute[75080]: DEBUG nova.network.neutron [req-98c0d5f3-458c-43b0-8e4b-77748fc8b09c req-327b8f59-fd13-4ce6-b98b-a82088116507 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:23:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:29 user nova-compute[75080]: DEBUG nova.network.neutron [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Successfully updated port: eb4d8798-73e9-4b84-91f1-8a6578f22ac1 {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:23:29 user nova-compute[75080]: DEBUG nova.network.neutron [req-98c0d5f3-458c-43b0-8e4b-77748fc8b09c req-327b8f59-fd13-4ce6-b98b-a82088116507 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:23:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-98c0d5f3-458c-43b0-8e4b-77748fc8b09c req-327b8f59-fd13-4ce6-b98b-a82088116507 service nova] Releasing lock "refresh_cache-6bf0a828-329b-46cf-aa76-bf6c24f08212" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:23:29 user nova-compute[75080]: DEBUG nova.compute.manager [req-98c0d5f3-458c-43b0-8e4b-77748fc8b09c req-327b8f59-fd13-4ce6-b98b-a82088116507 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-changed-7a891d10-f2c1-4a8e-b404-67372485e9a5 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:23:29 user nova-compute[75080]: DEBUG nova.compute.manager [req-98c0d5f3-458c-43b0-8e4b-77748fc8b09c req-327b8f59-fd13-4ce6-b98b-a82088116507 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Refreshing instance network info cache due to event network-changed-7a891d10-f2c1-4a8e-b404-67372485e9a5. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:23:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-98c0d5f3-458c-43b0-8e4b-77748fc8b09c req-327b8f59-fd13-4ce6-b98b-a82088116507 service nova] Acquiring lock "refresh_cache-6bf0a828-329b-46cf-aa76-bf6c24f08212" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:23:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-98c0d5f3-458c-43b0-8e4b-77748fc8b09c req-327b8f59-fd13-4ce6-b98b-a82088116507 service nova] Acquired lock "refresh_cache-6bf0a828-329b-46cf-aa76-bf6c24f08212" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:23:29 user nova-compute[75080]: DEBUG nova.network.neutron [req-98c0d5f3-458c-43b0-8e4b-77748fc8b09c req-327b8f59-fd13-4ce6-b98b-a82088116507 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Refreshing network info cache for port 7a891d10-f2c1-4a8e-b404-67372485e9a5 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:23:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:29 user nova-compute[75080]: DEBUG nova.network.neutron [req-98c0d5f3-458c-43b0-8e4b-77748fc8b09c req-327b8f59-fd13-4ce6-b98b-a82088116507 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:23:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:23:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:29 user nova-compute[75080]: DEBUG nova.network.neutron [req-98c0d5f3-458c-43b0-8e4b-77748fc8b09c req-327b8f59-fd13-4ce6-b98b-a82088116507 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:23:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-98c0d5f3-458c-43b0-8e4b-77748fc8b09c req-327b8f59-fd13-4ce6-b98b-a82088116507 service nova] Releasing lock "refresh_cache-6bf0a828-329b-46cf-aa76-bf6c24f08212" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:23:29 user nova-compute[75080]: DEBUG nova.compute.manager [req-98c0d5f3-458c-43b0-8e4b-77748fc8b09c req-327b8f59-fd13-4ce6-b98b-a82088116507 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-changed-362dc737-7651-44c0-a618-ed6a1bcbee5c {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:23:29 user nova-compute[75080]: DEBUG nova.compute.manager [req-98c0d5f3-458c-43b0-8e4b-77748fc8b09c req-327b8f59-fd13-4ce6-b98b-a82088116507 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Refreshing instance network info cache due to event network-changed-362dc737-7651-44c0-a618-ed6a1bcbee5c. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:23:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-98c0d5f3-458c-43b0-8e4b-77748fc8b09c req-327b8f59-fd13-4ce6-b98b-a82088116507 service nova] Acquiring lock "refresh_cache-6bf0a828-329b-46cf-aa76-bf6c24f08212" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:23:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-98c0d5f3-458c-43b0-8e4b-77748fc8b09c req-327b8f59-fd13-4ce6-b98b-a82088116507 service nova] Acquired lock "refresh_cache-6bf0a828-329b-46cf-aa76-bf6c24f08212" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:23:29 user nova-compute[75080]: DEBUG nova.network.neutron [req-98c0d5f3-458c-43b0-8e4b-77748fc8b09c req-327b8f59-fd13-4ce6-b98b-a82088116507 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Refreshing network info cache for port 362dc737-7651-44c0-a618-ed6a1bcbee5c {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:23:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:30 user nova-compute[75080]: DEBUG nova.network.neutron [req-98c0d5f3-458c-43b0-8e4b-77748fc8b09c req-327b8f59-fd13-4ce6-b98b-a82088116507 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:23:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:30 user nova-compute[75080]: DEBUG nova.network.neutron [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Successfully updated port: 510c5cfb-99de-4b45-aa65-a1c7a53969ea {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:23:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Acquiring lock "refresh_cache-6bf0a828-329b-46cf-aa76-bf6c24f08212" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:23:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:30 user nova-compute[75080]: DEBUG nova.network.neutron [req-98c0d5f3-458c-43b0-8e4b-77748fc8b09c req-327b8f59-fd13-4ce6-b98b-a82088116507 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:23:30 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:23:30 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:23:30 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=7712MB free_disk=25.459491729736328GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:23:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:23:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:23:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-98c0d5f3-458c-43b0-8e4b-77748fc8b09c req-327b8f59-fd13-4ce6-b98b-a82088116507 service nova] Releasing lock "refresh_cache-6bf0a828-329b-46cf-aa76-bf6c24f08212" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:23:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Acquired lock "refresh_cache-6bf0a828-329b-46cf-aa76-bf6c24f08212" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:23:30 user nova-compute[75080]: DEBUG nova.network.neutron [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:23:30 user nova-compute[75080]: DEBUG nova.network.neutron [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:23:31 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance bd75375a-8b70-4bc2-a72b-14213ebaa4e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:23:31 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance eedd1529-4feb-4f85-8625-0c20d8e0359d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:23:31 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:23:31 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 5e29bda9-f1d6-4951-9343-f189934a8a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:23:31 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 607acee2-b585-43d2-a897-eca4983d62db actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:23:31 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 412e1e40-082a-429e-9d35-013b72322761 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:23:31 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 07b025ff-4a9d-48a2-b950-b8f2d165f33c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:23:31 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:23:31 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 6bf0a828-329b-46cf-aa76-bf6c24f08212 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:23:31 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:23:31 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:23:31 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing inventories for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 05 15:23:31 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Updating ProviderTree inventory for provider 21b770fa-b774-46c9-9415-db26064ccd0f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 05 15:23:31 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Updating inventory in ProviderTree for provider 21b770fa-b774-46c9-9415-db26064ccd0f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 15:23:31 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing aggregate associations for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f, aggregates: None {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 05 15:23:31 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing trait associations for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f, traits: COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 05 15:23:31 user nova-compute[75080]: DEBUG nova.compute.manager [req-91a42fb3-0c5f-43b2-83b3-289dfb8203ac req-b9e87637-35d1-4989-826a-5e1035d1ebc6 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-changed-eb4d8798-73e9-4b84-91f1-8a6578f22ac1 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:23:31 user nova-compute[75080]: DEBUG nova.compute.manager [req-91a42fb3-0c5f-43b2-83b3-289dfb8203ac req-b9e87637-35d1-4989-826a-5e1035d1ebc6 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Refreshing instance network info cache due to event network-changed-eb4d8798-73e9-4b84-91f1-8a6578f22ac1. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:23:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-91a42fb3-0c5f-43b2-83b3-289dfb8203ac req-b9e87637-35d1-4989-826a-5e1035d1ebc6 service nova] Acquiring lock "refresh_cache-6bf0a828-329b-46cf-aa76-bf6c24f08212" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:23:31 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:23:31 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:23:31 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:23:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.842s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:23:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:32 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:23:32 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:23:32 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:23:33 user nova-compute[75080]: DEBUG nova.network.neutron [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Updating instance_info_cache with network_info: [{"id": "0250593a-4991-4e30-9e86-4f403f81bbe6", "address": "fa:16:3e:64:7a:bd", "network": {"id": "0e5b22b3-949b-4958-8500-8730f46ffb1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2105495982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0250593a-49", "ovs_interfaceid": "0250593a-4991-4e30-9e86-4f403f81bbe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "70683181-d134-4a6c-9bc4-9dcf7b019162", "address": "fa:16:3e:d6:c5:60", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70683181-d1", "ovs_interfaceid": "70683181-d134-4a6c-9bc4-9dcf7b019162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "58b3e25c-cbd6-4bdd-83e8-775a0708df4e", "address": "fa:16:3e:40:ba:74", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b3e25c-cb", "ovs_interfaceid": "58b3e25c-cbd6-4bdd-83e8-775a0708df4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7a891d10-f2c1-4a8e-b404-67372485e9a5", "address": "fa:16:3e:4d:4a:cf", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a891d10-f2", "ovs_interfaceid": "7a891d10-f2c1-4a8e-b404-67372485e9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "362dc737-7651-44c0-a618-ed6a1bcbee5c", "address": "fa:16:3e:da:3e:bf", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap362dc737-76", "ovs_interfaceid": "362dc737-7651-44c0-a618-ed6a1bcbee5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb4d8798-73e9-4b84-91f1-8a6578f22ac1", "address": "fa:16:3e:da:66:49", "network": {"id": "af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-211886922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4d8798-73", "ovs_interfaceid": "eb4d8798-73e9-4b84-91f1-8a6578f22ac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "510c5cfb-99de-4b45-aa65-a1c7a53969ea", "address": "fa:16:3e:34:62:97", "network": {"id": "af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-211886922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap510c5cfb-99", "ovs_interfaceid": "510c5cfb-99de-4b45-aa65-a1c7a53969ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:23:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Releasing lock "refresh_cache-6bf0a828-329b-46cf-aa76-bf6c24f08212" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:23:33 user nova-compute[75080]: DEBUG nova.compute.manager [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Instance network_info: |[{"id": "0250593a-4991-4e30-9e86-4f403f81bbe6", "address": "fa:16:3e:64:7a:bd", "network": {"id": "0e5b22b3-949b-4958-8500-8730f46ffb1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2105495982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0250593a-49", "ovs_interfaceid": "0250593a-4991-4e30-9e86-4f403f81bbe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "70683181-d134-4a6c-9bc4-9dcf7b019162", "address": "fa:16:3e:d6:c5:60", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70683181-d1", "ovs_interfaceid": "70683181-d134-4a6c-9bc4-9dcf7b019162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "58b3e25c-cbd6-4bdd-83e8-775a0708df4e", "address": "fa:16:3e:40:ba:74", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b3e25c-cb", "ovs_interfaceid": "58b3e25c-cbd6-4bdd-83e8-775a0708df4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7a891d10-f2c1-4a8e-b404-67372485e9a5", "address": "fa:16:3e:4d:4a:cf", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a891d10-f2", "ovs_interfaceid": "7a891d10-f2c1-4a8e-b404-67372485e9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "362dc737-7651-44c0-a618-ed6a1bcbee5c", "address": "fa:16:3e:da:3e:bf", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap362dc737-76", "ovs_interfaceid": "362dc737-7651-44c0-a618-ed6a1bcbee5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb4d8798-73e9-4b84-91f1-8a6578f22ac1", "address": "fa:16:3e:da:66:49", "network": {"id": "af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-211886922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4d8798-73", "ovs_interfaceid": "eb4d8798-73e9-4b84-91f1-8a6578f22ac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "510c5cfb-99de-4b45-aa65-a1c7a53969ea", "address": "fa:16:3e:34:62:97", "network": {"id": "af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-211886922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap510c5cfb-99", "ovs_interfaceid": "510c5cfb-99de-4b45-aa65-a1c7a53969ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:23:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-91a42fb3-0c5f-43b2-83b3-289dfb8203ac req-b9e87637-35d1-4989-826a-5e1035d1ebc6 service nova] Acquired lock "refresh_cache-6bf0a828-329b-46cf-aa76-bf6c24f08212" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:23:33 user nova-compute[75080]: DEBUG nova.network.neutron [req-91a42fb3-0c5f-43b2-83b3-289dfb8203ac req-b9e87637-35d1-4989-826a-5e1035d1ebc6 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Refreshing network info cache for port eb4d8798-73e9-4b84-91f1-8a6578f22ac1 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:23:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:33 user nova-compute[75080]: DEBUG nova.network.neutron [req-91a42fb3-0c5f-43b2-83b3-289dfb8203ac req-b9e87637-35d1-4989-826a-5e1035d1ebc6 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Updated VIF entry in instance network info cache for port eb4d8798-73e9-4b84-91f1-8a6578f22ac1. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:23:33 user nova-compute[75080]: DEBUG nova.network.neutron [req-91a42fb3-0c5f-43b2-83b3-289dfb8203ac req-b9e87637-35d1-4989-826a-5e1035d1ebc6 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Updating instance_info_cache with network_info: [{"id": "0250593a-4991-4e30-9e86-4f403f81bbe6", "address": "fa:16:3e:64:7a:bd", "network": {"id": "0e5b22b3-949b-4958-8500-8730f46ffb1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2105495982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0250593a-49", "ovs_interfaceid": "0250593a-4991-4e30-9e86-4f403f81bbe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "70683181-d134-4a6c-9bc4-9dcf7b019162", "address": "fa:16:3e:d6:c5:60", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70683181-d1", "ovs_interfaceid": "70683181-d134-4a6c-9bc4-9dcf7b019162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "58b3e25c-cbd6-4bdd-83e8-775a0708df4e", "address": "fa:16:3e:40:ba:74", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b3e25c-cb", "ovs_interfaceid": "58b3e25c-cbd6-4bdd-83e8-775a0708df4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7a891d10-f2c1-4a8e-b404-67372485e9a5", "address": "fa:16:3e:4d:4a:cf", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a891d10-f2", "ovs_interfaceid": "7a891d10-f2c1-4a8e-b404-67372485e9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "362dc737-7651-44c0-a618-ed6a1bcbee5c", "address": "fa:16:3e:da:3e:bf", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap362dc737-76", "ovs_interfaceid": "362dc737-7651-44c0-a618-ed6a1bcbee5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb4d8798-73e9-4b84-91f1-8a6578f22ac1", "address": "fa:16:3e:da:66:49", "network": {"id": "af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-211886922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4d8798-73", "ovs_interfaceid": "eb4d8798-73e9-4b84-91f1-8a6578f22ac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "510c5cfb-99de-4b45-aa65-a1c7a53969ea", "address": "fa:16:3e:34:62:97", "network": {"id": "af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-211886922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap510c5cfb-99", "ovs_interfaceid": "510c5cfb-99de-4b45-aa65-a1c7a53969ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:23:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-91a42fb3-0c5f-43b2-83b3-289dfb8203ac req-b9e87637-35d1-4989-826a-5e1035d1ebc6 service nova] Releasing lock "refresh_cache-6bf0a828-329b-46cf-aa76-bf6c24f08212" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:23:33 user nova-compute[75080]: DEBUG nova.compute.manager [req-91a42fb3-0c5f-43b2-83b3-289dfb8203ac req-b9e87637-35d1-4989-826a-5e1035d1ebc6 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-changed-510c5cfb-99de-4b45-aa65-a1c7a53969ea {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:23:33 user nova-compute[75080]: DEBUG nova.compute.manager [req-91a42fb3-0c5f-43b2-83b3-289dfb8203ac req-b9e87637-35d1-4989-826a-5e1035d1ebc6 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Refreshing instance network info cache due to event network-changed-510c5cfb-99de-4b45-aa65-a1c7a53969ea. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:23:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-91a42fb3-0c5f-43b2-83b3-289dfb8203ac req-b9e87637-35d1-4989-826a-5e1035d1ebc6 service nova] Acquiring lock "refresh_cache-6bf0a828-329b-46cf-aa76-bf6c24f08212" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:23:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-91a42fb3-0c5f-43b2-83b3-289dfb8203ac req-b9e87637-35d1-4989-826a-5e1035d1ebc6 service nova] Acquired lock "refresh_cache-6bf0a828-329b-46cf-aa76-bf6c24f08212" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:23:33 user nova-compute[75080]: DEBUG nova.network.neutron [req-91a42fb3-0c5f-43b2-83b3-289dfb8203ac req-b9e87637-35d1-4989-826a-5e1035d1ebc6 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Refreshing network info cache for port 510c5cfb-99de-4b45-aa65-a1c7a53969ea {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:23:34 user nova-compute[75080]: DEBUG nova.network.neutron [req-91a42fb3-0c5f-43b2-83b3-289dfb8203ac req-b9e87637-35d1-4989-826a-5e1035d1ebc6 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Updated VIF entry in instance network info cache for port 510c5cfb-99de-4b45-aa65-a1c7a53969ea. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:23:34 user nova-compute[75080]: DEBUG nova.network.neutron [req-91a42fb3-0c5f-43b2-83b3-289dfb8203ac req-b9e87637-35d1-4989-826a-5e1035d1ebc6 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Updating instance_info_cache with network_info: [{"id": "0250593a-4991-4e30-9e86-4f403f81bbe6", "address": "fa:16:3e:64:7a:bd", "network": {"id": "0e5b22b3-949b-4958-8500-8730f46ffb1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2105495982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0250593a-49", "ovs_interfaceid": "0250593a-4991-4e30-9e86-4f403f81bbe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "70683181-d134-4a6c-9bc4-9dcf7b019162", "address": "fa:16:3e:d6:c5:60", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70683181-d1", "ovs_interfaceid": "70683181-d134-4a6c-9bc4-9dcf7b019162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "58b3e25c-cbd6-4bdd-83e8-775a0708df4e", "address": "fa:16:3e:40:ba:74", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b3e25c-cb", "ovs_interfaceid": "58b3e25c-cbd6-4bdd-83e8-775a0708df4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7a891d10-f2c1-4a8e-b404-67372485e9a5", "address": "fa:16:3e:4d:4a:cf", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a891d10-f2", "ovs_interfaceid": "7a891d10-f2c1-4a8e-b404-67372485e9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "362dc737-7651-44c0-a618-ed6a1bcbee5c", "address": "fa:16:3e:da:3e:bf", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap362dc737-76", "ovs_interfaceid": "362dc737-7651-44c0-a618-ed6a1bcbee5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb4d8798-73e9-4b84-91f1-8a6578f22ac1", "address": "fa:16:3e:da:66:49", "network": {"id": "af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-211886922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4d8798-73", "ovs_interfaceid": "eb4d8798-73e9-4b84-91f1-8a6578f22ac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "510c5cfb-99de-4b45-aa65-a1c7a53969ea", "address": "fa:16:3e:34:62:97", "network": {"id": "af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-211886922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap510c5cfb-99", "ovs_interfaceid": "510c5cfb-99de-4b45-aa65-a1c7a53969ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:23:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-91a42fb3-0c5f-43b2-83b3-289dfb8203ac req-b9e87637-35d1-4989-826a-5e1035d1ebc6 service nova] Releasing lock "refresh_cache-6bf0a828-329b-46cf-aa76-bf6c24f08212" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:23:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:23:37 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ybmzpMJh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:23:37 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:23:37 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:23:37 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:23:37 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:23:37 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:23:37 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:23:37 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:23:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:37 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad119f67-1d91-41b7-915d-dd114f3f2c36]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:37 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:23:37 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:23:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d4c8a2-7fa5-49f7-b7be-35b2471d4098]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989] added
Dec 05 15:23:38 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc630e4-8b46-4102-92ac-c7bed443f0a7]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4e0fe2-0a37-4bab-8255-473b1e818f23]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ybmzpMJh {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ybmzpMJh" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b2beb6-7f78-4dc9-89cf-a323fbac0e1e]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ybmzpMJh'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0adc0989-768c-44cf-890c-094ee015df33]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:38 user nova-compute[75080]: INFO nova.virt.block_device [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Booting with volume 6f1398ce-f855-4e97-9099-e4d050c59067 at /dev/vdb
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4966dbb0-bec9-4b3f-b692-552a3a341c57]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:23:38 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:23:38 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG os_brick.utils [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1669f1d5-9e68-4dcb-b15a-3d9b5838ff65]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989, portal: 172.16.0.220,3260]
Dec 05 15:23:38 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989, portal: 172.16.0.220,3260] successful.
Dec 05 15:23:38 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7e5b1f-8591-45ce-8356-3e175be26aa6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bd3601-ee8f-4e71-9e59-069e93972794]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30c736a-8259-4131-b657-5be6f681adca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2d0271-ff04-4430-ae1a-faddcb714bb5]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ded7d13-4152-4f4b-9bf6-8a4c1c45df82]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:23:38 user nova-compute[75080]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:23:38 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:23:38 user nova-compute[75080]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:23:38 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8133011e-6884-4c04-abbf-e8cfaa009eb1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ef8423-f09f-4346-b1a3-5fb4353a1cfc]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ybmzpMJh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:23:38 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:23:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d7e556-7d56-47e4-a865-42bdcd9034b6]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG os_brick.utils [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Updating existing volume attachment record: 649c59a4-90b1-42e9-b137-583b30af9ebb {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:23:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:23:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '26233616539356239', 'path': '/dev/sdc'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:23:39 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233616539356239', 'path': '/dev/sdc'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:23:39 user nova-compute[75080]: DEBUG nova.objects.instance [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lazy-loading 'flavor' on Instance uuid 5e29bda9-f1d6-4951-9343-f189934a8a23 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:23:39 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 15:23:39 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:23:39 user nova-compute[75080]:   <source dev="/dev/sdc"/>
Dec 05 15:23:39 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:23:39 user nova-compute[75080]:   <serial>fd29efe7-d1b9-4460-86f2-9eb719695989</serial>
Dec 05 15:23:39 user nova-compute[75080]: </disk>
Dec 05 15:23:39 user nova-compute[75080]:  {{(pid=75080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 15:23:39 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:23:39 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:23:39 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] No VIF found with MAC fa:16:3e:4b:c9:8b, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:23:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e921d549-7c41-4f60-b681-69fb0bf7f854 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "5e29bda9-f1d6-4951-9343-f189934a8a23" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.834s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:23:40 user nova-compute[75080]: INFO nova.compute.manager [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Rebuilding instance
Dec 05 15:23:40 user nova-compute[75080]: DEBUG nova.compute.manager [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:23:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:41 user nova-compute[75080]: DEBUG nova.compute.manager [req-4036aef8-50a7-4320-81e0-43750e60d5e4 req-fd78e7f6-f579-43e4-a5be-563726df3380 service nova] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Received event network-vif-unplugged-fb2619ea-ffe7-4d82-9b44-984ee393620c {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:23:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4036aef8-50a7-4320-81e0-43750e60d5e4 req-fd78e7f6-f579-43e4-a5be-563726df3380 service nova] Acquiring lock "5e29bda9-f1d6-4951-9343-f189934a8a23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:23:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4036aef8-50a7-4320-81e0-43750e60d5e4 req-fd78e7f6-f579-43e4-a5be-563726df3380 service nova] Lock "5e29bda9-f1d6-4951-9343-f189934a8a23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:23:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4036aef8-50a7-4320-81e0-43750e60d5e4 req-fd78e7f6-f579-43e4-a5be-563726df3380 service nova] Lock "5e29bda9-f1d6-4951-9343-f189934a8a23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:23:41 user nova-compute[75080]: DEBUG nova.compute.manager [req-4036aef8-50a7-4320-81e0-43750e60d5e4 req-fd78e7f6-f579-43e4-a5be-563726df3380 service nova] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] No waiting events found dispatching network-vif-unplugged-fb2619ea-ffe7-4d82-9b44-984ee393620c {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:23:41 user nova-compute[75080]: WARNING nova.compute.manager [req-4036aef8-50a7-4320-81e0-43750e60d5e4 req-fd78e7f6-f579-43e4-a5be-563726df3380 service nova] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Received unexpected event network-vif-unplugged-fb2619ea-ffe7-4d82-9b44-984ee393620c for instance with vm_state active and task_state rebuilding.
Dec 05 15:23:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:41 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Instance destroyed successfully.
Dec 05 15:23:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:41 user nova-compute[75080]: INFO nova.compute.manager [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Detaching volume fd29efe7-d1b9-4460-86f2-9eb719695989
Dec 05 15:23:41 user nova-compute[75080]: INFO nova.virt.block_device [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Attempting to driver detach volume fd29efe7-d1b9-4460-86f2-9eb719695989 from mountpoint /dev/vdb
Dec 05 15:23:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Attempting to detach device vdb from instance 5e29bda9-f1d6-4951-9343-f189934a8a23 from the persistent domain config. {{(pid=75080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 15:23:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:23:41 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:23:41 user nova-compute[75080]:   <source dev="/dev/sdc"/>
Dec 05 15:23:41 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:23:41 user nova-compute[75080]:   <serial>fd29efe7-d1b9-4460-86f2-9eb719695989</serial>
Dec 05 15:23:41 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 15:23:41 user nova-compute[75080]: </disk>
Dec 05 15:23:41 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:23:41 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Successfully detached device vdb from instance 5e29bda9-f1d6-4951-9343-f189934a8a23 from the persistent domain config.
Dec 05 15:23:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:23:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ybmzpMJh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:23:41 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 05 15:23:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fe7321-16de-4419-9ddd-510fdcd202fa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:23:42 user nova-compute[75080]: No targets found.
Dec 05 15:23:42 user nova-compute[75080]: iSNS:
Dec 05 15:23:42 user nova-compute[75080]: No targets found.
Dec 05 15:23:42 user nova-compute[75080]: STATIC:
Dec 05 15:23:42 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598
Dec 05 15:23:42 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:23:42 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:23:42 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989
Dec 05 15:23:42 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:23:42 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:23:42 user nova-compute[75080]: FIRMWARE:
Dec 05 15:23:42 user nova-compute[75080]: No targets found.
Dec 05 15:23:42 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:23:42 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:23:42 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70ef63f-d7d8-4250-8c52-31c56721b4e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[557329fb-b43a-4ec1-b0f4-82719d0ed6aa]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:23:42 user nova-compute[75080]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:23:42 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:23:42 user nova-compute[75080]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:23:42 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6638523250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989'): ({'sdc'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Removing single pathed devices sdc {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[df358f89-1088-4ebd-8d71-83574ef77609]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c4e0ea-7591-4f3c-a306-469f76e8afa0]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Flushing IO for device /dev/sdc {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e6c815-df81-4ae3-b5dd-8d4b5478ed38]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0286600f-ecb6-44bb-880e-d25fc3d8af47]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] SCSI volumes sdc have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a2aacc-71b4-4cdf-8b52-f373332c1f80]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e033ad-7d39-4df4-b9a9-dc4d44407f71]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989, portal: 172.16.0.220,3260]
Dec 05 15:23:42 user nova-compute[75080]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989, portal: 172.16.0.220,3260] successful.
Dec 05 15:23:42 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfd98bb-f2de-4607-950b-06dc3a72393f]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] <== disconnect_volume: return (289ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:23:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:23:43 user nova-compute[75080]: DEBUG nova.compute.manager [req-0839b187-02e8-4807-9943-120c6fd435c5 req-82b03900-8198-44da-b806-2cdeaec46dba service nova] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Received event network-vif-plugged-fb2619ea-ffe7-4d82-9b44-984ee393620c {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:23:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0839b187-02e8-4807-9943-120c6fd435c5 req-82b03900-8198-44da-b806-2cdeaec46dba service nova] Acquiring lock "5e29bda9-f1d6-4951-9343-f189934a8a23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:23:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0839b187-02e8-4807-9943-120c6fd435c5 req-82b03900-8198-44da-b806-2cdeaec46dba service nova] Lock "5e29bda9-f1d6-4951-9343-f189934a8a23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:23:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0839b187-02e8-4807-9943-120c6fd435c5 req-82b03900-8198-44da-b806-2cdeaec46dba service nova] Lock "5e29bda9-f1d6-4951-9343-f189934a8a23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:23:43 user nova-compute[75080]: DEBUG nova.compute.manager [req-0839b187-02e8-4807-9943-120c6fd435c5 req-82b03900-8198-44da-b806-2cdeaec46dba service nova] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] No waiting events found dispatching network-vif-plugged-fb2619ea-ffe7-4d82-9b44-984ee393620c {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:23:43 user nova-compute[75080]: WARNING nova.compute.manager [req-0839b187-02e8-4807-9943-120c6fd435c5 req-82b03900-8198-44da-b806-2cdeaec46dba service nova] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Received unexpected event network-vif-plugged-fb2619ea-ffe7-4d82-9b44-984ee393620c for instance with vm_state active and task_state rebuilding.
Dec 05 15:23:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:48 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Instance destroyed successfully.
Dec 05 15:23:48 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:21:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1999463025',display_name='tempest-ServerActionsTestOtherA-server-1633226047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1999463025',id=14,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvWGadIJzQhPYzEMGopP5ED52Y6Gi9xcl1Gk9R/9FWs4vsKHHKulX+a7vugCHkAURz4pQ6pvg505Y+Ts3LLi3NJ3+G0dMmP1DiJTl+hCPVyGkJWdfTJyUNAnDxFiveANg==',key_name='tempest-keypair-1591259108',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:21:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='50f49255d5b74f448dc941027afbf84a',ramdisk_id='',reservation_id='r-qiq2etb6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-393209338',owner_user_name='tempest-ServerActionsTestOtherA-393209338-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:23:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e99cb2f1c4541fd9a656e038f4afac3',uuid=5e29bda9-f1d6-4951-9343-f189934a8a23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb2619ea-ffe7-4d82-9b44-984ee393620c", "address": "fa:16:3e:4b:c9:8b", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb2619ea-ff", "ovs_interfaceid": "fb2619ea-ffe7-4d82-9b44-984ee393620c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:23:48 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Converting VIF {"id": "fb2619ea-ffe7-4d82-9b44-984ee393620c", "address": "fa:16:3e:4b:c9:8b", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb2619ea-ff", "ovs_interfaceid": "fb2619ea-ffe7-4d82-9b44-984ee393620c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:23:48 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:c9:8b,bridge_name='br-int',has_traffic_filtering=True,id=fb2619ea-ffe7-4d82-9b44-984ee393620c,network=Network(efba4a7e-3a56-41d2-8af7-4c064ba641fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb2619ea-ff') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:23:48 user nova-compute[75080]: DEBUG os_vif [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:c9:8b,bridge_name='br-int',has_traffic_filtering=True,id=fb2619ea-ffe7-4d82-9b44-984ee393620c,network=Network(efba4a7e-3a56-41d2-8af7-4c064ba641fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb2619ea-ff') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:23:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb2619ea-ff, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:23:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=063bb14f-c0c0-4038-9e4e-d07b94a6809d) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:23:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:48 user nova-compute[75080]: INFO os_vif [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:c9:8b,bridge_name='br-int',has_traffic_filtering=True,id=fb2619ea-ffe7-4d82-9b44-984ee393620c,network=Network(efba4a7e-3a56-41d2-8af7-4c064ba641fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb2619ea-ff')
Dec 05 15:23:48 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:23:48 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ybmzpMJh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:23:48 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 05 15:23:48 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:23:48 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:23:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:48 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ab90ff-f397-4302-9d0c-dc6a30b8df4f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:48 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:23:48 user nova-compute[75080]: No targets found.
Dec 05 15:23:48 user nova-compute[75080]: iSNS:
Dec 05 15:23:48 user nova-compute[75080]: No targets found.
Dec 05 15:23:48 user nova-compute[75080]: STATIC:
Dec 05 15:23:48 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598
Dec 05 15:23:48 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:23:48 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:23:48 user nova-compute[75080]: FIRMWARE:
Dec 05 15:23:48 user nova-compute[75080]: No targets found.
Dec 05 15:23:48 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:23:48 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:23:48 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:23:48 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:23:48 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:23:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:48 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[91451254-b4be-4b15-8d98-c0fcadeafc17]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:48 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1f14f6-242a-4cbe-a461-bf79a8aace8b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:23:49 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:23:49 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f66384a4700>, {}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Disconnecting from: [] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.074s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] <== disconnect_volume: return (75ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:23:49 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Deleting instance files /opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23_del
Dec 05 15:23:49 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Deletion of /opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23_del complete
Dec 05 15:23:49 user nova-compute[75080]: INFO nova.virt.block_device [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Booting with volume 44a13dc1-2688-4c91-a77f-8b79f94d6b0c at /dev/vdc
Dec 05 15:23:49 user nova-compute[75080]: INFO nova.virt.block_device [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Booting with volume fd29efe7-d1b9-4460-86f2-9eb719695989 at /dev/vdb
Dec 05 15:23:49 user nova-compute[75080]: DEBUG os_brick.utils [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa69a43-4493-4b3f-b752-6cf7896dd40b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG os_brick.utils [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cf1708-a0c0-4533-a786-8e3d68dd6b06]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a243bf55-8451-4b49-b93b-5965900d6de8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2500d8-c924-4ac2-bc70-c27550bd7a73]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[30af53af-599a-4685-9689-d55f5af76eea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d955c506-44ca-4da0-b393-0bc5e4bafed9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:23:49 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:23:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[00146117-f093-44d2-8e1b-d57821ca6070]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bdb7ed-70bb-403a-b322-ab395fb7d8e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG os_brick.utils [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Updating existing volume attachment record: e4fc0519-72e8-477f-8e27-e03ea6975dcf {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[335526da-cbe8-4284-821c-47f788bf0ea6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:23:49 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:23:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21f31ea-fa6f-42aa-a1a3-4ff6dfa0c27e]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG os_brick.utils [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:23:49 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Updating existing volume attachment record: 50a9d928-807e-417f-b2e7-b1b992dd722a {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:23:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:23:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-931fcb71-5d2c-4d39-8160-d8003833c03f tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Acquiring lock "a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-931fcb71-5d2c-4d39-8160-d8003833c03f tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-931fcb71-5d2c-4d39-8160-d8003833c03f tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Acquiring lock "a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-931fcb71-5d2c-4d39-8160-d8003833c03f tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-931fcb71-5d2c-4d39-8160-d8003833c03f tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:03 user nova-compute[75080]: INFO nova.compute.manager [None req-931fcb71-5d2c-4d39-8160-d8003833c03f tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Terminating instance
Dec 05 15:24:03 user nova-compute[75080]: DEBUG nova.compute.manager [None req-931fcb71-5d2c-4d39-8160-d8003833c03f tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:24:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:04 user nova-compute[75080]: DEBUG nova.compute.manager [req-85b20c78-5259-4a2f-8fc7-df763500a6ac req-5c25ac0e-05cd-4e9d-9b9f-d2ad3571e54b service nova] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Received event network-vif-unplugged-74eb53ef-5ba7-4bd5-81af-d6adede99fad {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:24:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-85b20c78-5259-4a2f-8fc7-df763500a6ac req-5c25ac0e-05cd-4e9d-9b9f-d2ad3571e54b service nova] Acquiring lock "a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-85b20c78-5259-4a2f-8fc7-df763500a6ac req-5c25ac0e-05cd-4e9d-9b9f-d2ad3571e54b service nova] Lock "a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-85b20c78-5259-4a2f-8fc7-df763500a6ac req-5c25ac0e-05cd-4e9d-9b9f-d2ad3571e54b service nova] Lock "a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:04 user nova-compute[75080]: DEBUG nova.compute.manager [req-85b20c78-5259-4a2f-8fc7-df763500a6ac req-5c25ac0e-05cd-4e9d-9b9f-d2ad3571e54b service nova] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] No waiting events found dispatching network-vif-unplugged-74eb53ef-5ba7-4bd5-81af-d6adede99fad {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:24:04 user nova-compute[75080]: DEBUG nova.compute.manager [req-85b20c78-5259-4a2f-8fc7-df763500a6ac req-5c25ac0e-05cd-4e9d-9b9f-d2ad3571e54b service nova] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Received event network-vif-unplugged-74eb53ef-5ba7-4bd5-81af-d6adede99fad for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:24:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:04 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Instance destroyed successfully.
Dec 05 15:24:04 user nova-compute[75080]: DEBUG nova.objects.instance [None req-931fcb71-5d2c-4d39-8160-d8003833c03f tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lazy-loading 'resources' on Instance uuid a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:24:04 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-931fcb71-5d2c-4d39-8160-d8003833c03f tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:17:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1667564362',display_name='tempest-VolumesAdminNegativeTest-server-1667564362',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1667564362',id=3,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP84ajR7JlPz0n3dSjpDcYFR2MUC+ZKxgUqnM0aZwdALi+CuKwd54BTsH8/Lu4DU7cLK9cttGC5uWVIKI1z8hDZYzxM2qL58dSjkFlQVbwNxmgZpcyFJxlDypWxpl/z1Lg==',key_name='tempest-keypair-1497616147',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:18:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b74a9586932440678d59170e174336a1',ramdisk_id='',reservation_id='r-uc2i7fuy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-98453510',owner_user_name='tempest-VolumesAdminNegativeTest-98453510-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:18:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5fa6ef27452432c8c1b6d57906b9de2',uuid=a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74eb53ef-5ba7-4bd5-81af-d6adede99fad", "address": "fa:16:3e:91:12:8c", "network": {"id": "ecbc1165-663e-47ca-87c7-ecda194bb3cc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-140281562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b74a9586932440678d59170e174336a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74eb53ef-5b", "ovs_interfaceid": "74eb53ef-5ba7-4bd5-81af-d6adede99fad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:24:04 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-931fcb71-5d2c-4d39-8160-d8003833c03f tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Converting VIF {"id": "74eb53ef-5ba7-4bd5-81af-d6adede99fad", "address": "fa:16:3e:91:12:8c", "network": {"id": "ecbc1165-663e-47ca-87c7-ecda194bb3cc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-140281562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b74a9586932440678d59170e174336a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74eb53ef-5b", "ovs_interfaceid": "74eb53ef-5ba7-4bd5-81af-d6adede99fad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:24:04 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-931fcb71-5d2c-4d39-8160-d8003833c03f tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:12:8c,bridge_name='br-int',has_traffic_filtering=True,id=74eb53ef-5ba7-4bd5-81af-d6adede99fad,network=Network(ecbc1165-663e-47ca-87c7-ecda194bb3cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74eb53ef-5b') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:24:04 user nova-compute[75080]: DEBUG os_vif [None req-931fcb71-5d2c-4d39-8160-d8003833c03f tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:12:8c,bridge_name='br-int',has_traffic_filtering=True,id=74eb53ef-5ba7-4bd5-81af-d6adede99fad,network=Network(ecbc1165-663e-47ca-87c7-ecda194bb3cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74eb53ef-5b') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:24:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74eb53ef-5b, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:24:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7df76fe1-e4a6-4746-bca1-8b55668fd874) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:04 user nova-compute[75080]: INFO os_vif [None req-931fcb71-5d2c-4d39-8160-d8003833c03f tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:12:8c,bridge_name='br-int',has_traffic_filtering=True,id=74eb53ef-5ba7-4bd5-81af-d6adede99fad,network=Network(ecbc1165-663e-47ca-87c7-ecda194bb3cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74eb53ef-5b')
Dec 05 15:24:04 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-931fcb71-5d2c-4d39-8160-d8003833c03f tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Deleting instance files /opt/stack/data/nova/instances/a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1_del
Dec 05 15:24:04 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-931fcb71-5d2c-4d39-8160-d8003833c03f tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Deletion of /opt/stack/data/nova/instances/a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1_del complete
Dec 05 15:24:04 user nova-compute[75080]: INFO nova.compute.manager [None req-931fcb71-5d2c-4d39-8160-d8003833c03f tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Took 1.03 seconds to destroy the instance on the hypervisor.
Dec 05 15:24:04 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-931fcb71-5d2c-4d39-8160-d8003833c03f tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:24:04 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:24:04 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:24:05 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:24:05 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Took 1.07 seconds to deallocate network for instance.
Dec 05 15:24:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-931fcb71-5d2c-4d39-8160-d8003833c03f tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-931fcb71-5d2c-4d39-8160-d8003833c03f tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:06 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:06 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-931fcb71-5d2c-4d39-8160-d8003833c03f tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:24:06 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-931fcb71-5d2c-4d39-8160-d8003833c03f tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:24:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-931fcb71-5d2c-4d39-8160-d8003833c03f tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:06 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-931fcb71-5d2c-4d39-8160-d8003833c03f tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Deleted allocations for instance a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1
Dec 05 15:24:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-931fcb71-5d2c-4d39-8160-d8003833c03f tempest-VolumesAdminNegativeTest-98453510 tempest-VolumesAdminNegativeTest-98453510-project-member] Lock "a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.671s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:06 user nova-compute[75080]: DEBUG nova.compute.manager [req-16be8b1f-f6c9-40dc-9844-7d004cef92b4 req-ce17eea6-7f02-4b10-a879-5260d8f03a69 service nova] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Received event network-vif-plugged-74eb53ef-5ba7-4bd5-81af-d6adede99fad {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:24:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-16be8b1f-f6c9-40dc-9844-7d004cef92b4 req-ce17eea6-7f02-4b10-a879-5260d8f03a69 service nova] Acquiring lock "a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-16be8b1f-f6c9-40dc-9844-7d004cef92b4 req-ce17eea6-7f02-4b10-a879-5260d8f03a69 service nova] Lock "a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-16be8b1f-f6c9-40dc-9844-7d004cef92b4 req-ce17eea6-7f02-4b10-a879-5260d8f03a69 service nova] Lock "a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:06 user nova-compute[75080]: DEBUG nova.compute.manager [req-16be8b1f-f6c9-40dc-9844-7d004cef92b4 req-ce17eea6-7f02-4b10-a879-5260d8f03a69 service nova] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] No waiting events found dispatching network-vif-plugged-74eb53ef-5ba7-4bd5-81af-d6adede99fad {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:24:06 user nova-compute[75080]: WARNING nova.compute.manager [req-16be8b1f-f6c9-40dc-9844-7d004cef92b4 req-ce17eea6-7f02-4b10-a879-5260d8f03a69 service nova] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Received unexpected event network-vif-plugged-74eb53ef-5ba7-4bd5-81af-d6adede99fad for instance with vm_state deleted and task_state None.
Dec 05 15:24:06 user nova-compute[75080]: DEBUG nova.compute.manager [req-16be8b1f-f6c9-40dc-9844-7d004cef92b4 req-ce17eea6-7f02-4b10-a879-5260d8f03a69 service nova] [instance: a8cb6b4c-f1fe-4d4f-9863-9d87cebedfa1] Received event network-vif-deleted-74eb53ef-5ba7-4bd5-81af-d6adede99fad {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:24:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG nova.compute.manager [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:24:10 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Creating image(s)
Dec 05 15:24:10 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Did not create local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Ensure instance console log exists: /opt/stack/data/nova/instances/6bf0a828-329b-46cf-aa76-bf6c24f08212/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Start _get_guest_xml network_info=[{"id": "0250593a-4991-4e30-9e86-4f403f81bbe6", "address": "fa:16:3e:64:7a:bd", "network": {"id": "0e5b22b3-949b-4958-8500-8730f46ffb1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2105495982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0250593a-49", "ovs_interfaceid": "0250593a-4991-4e30-9e86-4f403f81bbe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "70683181-d134-4a6c-9bc4-9dcf7b019162", "address": "fa:16:3e:d6:c5:60", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70683181-d1", "ovs_interfaceid": "70683181-d134-4a6c-9bc4-9dcf7b019162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "58b3e25c-cbd6-4bdd-83e8-775a0708df4e", "address": "fa:16:3e:40:ba:74", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b3e25c-cb", "ovs_interfaceid": "58b3e25c-cbd6-4bdd-83e8-775a0708df4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7a891d10-f2c1-4a8e-b404-67372485e9a5", "address": "fa:16:3e:4d:4a:cf", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a891d10-f2", "ovs_interfaceid": "7a891d10-f2c1-4a8e-b404-67372485e9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "362dc737-7651-44c0-a618-ed6a1bcbee5c", "address": "fa:16:3e:da:3e:bf", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap362dc737-76", "ovs_interfaceid": "362dc737-7651-44c0-a618-ed6a1bcbee5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb4d8798-73e9-4b84-91f1-8a6578f22ac1", "address": "fa:16:3e:da:66:49", "network": {"id": "af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-211886922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4d8798-73", "ovs_interfaceid": "eb4d8798-73e9-4b84-91f1-8a6578f22ac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "510c5cfb-99de-4b45-aa65-a1c7a53969ea", "address": "fa:16:3e:34:62:97", "network": {"id": "af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-211886922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap510c5cfb-99", "ovs_interfaceid": "510c5cfb-99de-4b45-aa65-a1c7a53969ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oirgbPSx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6bf0a828-329b-46cf-aa76-bf6c24f08212', 'attached_at': '', 'detached_at': '', 'volume_id': 'd0d9ab59-291a-4fec-9c4c-f11d6f37a6fb', 'serial': 'd0d9ab59-291a-4fec-9c4c-f11d6f37a6fb'}, 'device_type': 'disk', 'attachment_id': '12f9146b-5c45-4bf7-b00a-e517038546b3', 'disk_bus': 'virtio', 'volume_type': None}, {'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': 1, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BiaLEflD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6bf0a828-329b-46cf-aa76-bf6c24f08212', 'attached_at': '', 'detached_at': '', 'volume_id': '6f1398ce-f855-4e97-9099-e4d050c59067', 'serial': '6f1398ce-f855-4e97-9099-e4d050c59067'}, 'device_type': 'disk', 'attachment_id': '649c59a4-90b1-42e9-b137-583b30af9ebb', 'disk_bus': 'virtio', 'volume_type': None}, {'mount_device': '/dev/vdc', 'guest_format': None, 'boot_index': 2, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yPfSVKjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6bf0a828-329b-46cf-aa76-bf6c24f08212', 'attached_at': '', 'detached_at': '', 'volume_id': '44a13dc1-2688-4c91-a77f-8b79f94d6b0c', 'serial': '44a13dc1-2688-4c91-a77f-8b79f94d6b0c'}, 'device_type': 'disk', 'attachment_id': 'e4fc0519-72e8-477f-8e27-e03ea6975dcf', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:24:10 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Creating image(s)
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "/opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "/opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:10 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:24:10 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:24:10 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oirgbPSx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:24:10 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:24:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:24:10 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:24:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:24:10 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4bfb73-3ecd-4a2d-b342-d5e1f1cfa420]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:24:10 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabf1724-23b3-4c3f-8334-dff72bd078ad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb] added
Dec 05 15:24:10 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c2291f-6a4d-4f6f-a7d2-b91216137fb0]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62ce367-6a72-48ba-b763-434406a20c37]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.221s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oirgbPSx {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oirgbPSx" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[dace981a-6770-45f8-b26c-d8d4537a06ff]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oirgbPSx'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[127ed90e-e842-4c4a-a8fd-7d81bafef313]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa45433-db3b-4638-ae5e-a34081406e2e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:24:10 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:24:10 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a3324f-5603-4bf4-beed-86bfc49e8997]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb, portal: 172.16.0.220,3260]
Dec 05 15:24:10 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb, portal: 172.16.0.220,3260] successful.
Dec 05 15:24:10 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb11f9c-9cd9-4342-b448-2e2b65009ecf]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.225s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae498d9a-7122-4677-ab20-c757ccce6a38]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:24:10 user nova-compute[75080]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb (non-flash)
Dec 05 15:24:10 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:24:10 user nova-compute[75080]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb (non-flash)
Dec 05 15:24:10 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.399s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk 1073741824" returned: 0 in 0.064s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4996b7fa-148b-41b5-96a4-b9ac41316bf5]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:24:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oirgbPSx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.239s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Cannot resize image /opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Ensure instance console log exists: /opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Start _get_guest_xml network_info=[{"id": "fb2619ea-ffe7-4d82-9b44-984ee393620c", "address": "fa:16:3e:4b:c9:8b", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb2619ea-ff", "ovs_interfaceid": "fb2619ea-ffe7-4d82-9b44-984ee393620c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ybmzpMJh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5e29bda9-f1d6-4951-9343-f189934a8a23', 'attached_at': '', 'detached_at': '', 'volume_id': 'fd29efe7-d1b9-4460-86f2-9eb719695989', 'serial': 'fd29efe7-d1b9-4460-86f2-9eb719695989'}, 'device_type': 'disk', 'attachment_id': '50a9d928-807e-417f-b2e7-b1b992dd722a', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:24:11 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Dec 05 15:24:11 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Dec 05 15:24:11 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG nova.objects.instance [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5e29bda9-f1d6-4951-9343-f189934a8a23 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ybmzpMJh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:24:11 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 05 15:24:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.462s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] <== connect_volume: return (1463ms) {'type': 'block', 'scsi_wwn': '26664363338376663', 'path': '/dev/sdc'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664363338376663', 'path': '/dev/sdc'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.502s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:24:11 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 05 15:24:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:24:11 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:24:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1f4d61-0db3-45d7-817b-f3d21cc5e877]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:24:11 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BiaLEflD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:24:11 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:24:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a542191-1012-46ca-ae15-631069b211cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989] added
Dec 05 15:24:11 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5a3b0e-8703-4056-b5ca-4656cd479d05]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c77f0cd-cb63-4180-b71e-f032d60d9fee]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ybmzpMJh {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG nova.compute.manager [req-8350c4c8-d36f-4d9c-8b98-7fc841e8033d req-3162efff-dbfa-44e1-833e-7c1e68d233c7 service nova] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Received event network-changed-5979a08d-6941-4e54-9f0f-a6aa1af07de8 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG nova.compute.manager [req-8350c4c8-d36f-4d9c-8b98-7fc841e8033d req-3162efff-dbfa-44e1-833e-7c1e68d233c7 service nova] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Refreshing instance network info cache due to event network-changed-5979a08d-6941-4e54-9f0f-a6aa1af07de8. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8350c4c8-d36f-4d9c-8b98-7fc841e8033d req-3162efff-dbfa-44e1-833e-7c1e68d233c7 service nova] Acquiring lock "refresh_cache-607acee2-b585-43d2-a897-eca4983d62db" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8350c4c8-d36f-4d9c-8b98-7fc841e8033d req-3162efff-dbfa-44e1-833e-7c1e68d233c7 service nova] Acquired lock "refresh_cache-607acee2-b585-43d2-a897-eca4983d62db" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG nova.network.neutron [req-8350c4c8-d36f-4d9c-8b98-7fc841e8033d req-3162efff-dbfa-44e1-833e-7c1e68d233c7 service nova] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Refreshing network info cache for port 5979a08d-6941-4e54-9f0f-a6aa1af07de8 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ybmzpMJh" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[396b45e7-9586-4958-a265-f8c68f8c78b4]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ybmzpMJh'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[24961853-304f-40ac-9acc-328582b39f63]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1692a18c-1d5c-4489-a894-657f9a6567da]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:24:12 user nova-compute[75080]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb (non-flash)
Dec 05 15:24:12 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:24:12 user nova-compute[75080]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb (non-flash)
Dec 05 15:24:12 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f84b7e-103d-4602-ac82-667e8f765097]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989, portal: 172.16.0.220,3260]
Dec 05 15:24:12 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989, portal: 172.16.0.220,3260] successful.
Dec 05 15:24:12 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e17aaa-f771-47c0-8770-197a0095bbd0]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2df62d7-f703-4b32-8c9e-29b3a2939e63]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:24:12 user nova-compute[75080]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb (non-flash)
Dec 05 15:24:12 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:24:12 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:24:12 user nova-compute[75080]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb (non-flash)
Dec 05 15:24:12 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:24:12 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc883305-ef49-44d6-b55e-8f9fdacf20e1]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ybmzpMJh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG nova.network.neutron [req-8350c4c8-d36f-4d9c-8b98-7fc841e8033d req-3162efff-dbfa-44e1-833e-7c1e68d233c7 service nova] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Updated VIF entry in instance network info cache for port 5979a08d-6941-4e54-9f0f-a6aa1af07de8. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG nova.network.neutron [req-8350c4c8-d36f-4d9c-8b98-7fc841e8033d req-3162efff-dbfa-44e1-833e-7c1e68d233c7 service nova] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Updating instance_info_cache with network_info: [{"id": "5979a08d-6941-4e54-9f0f-a6aa1af07de8", "address": "fa:16:3e:94:6b:4c", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5979a08d-69", "ovs_interfaceid": "5979a08d-6941-4e54-9f0f-a6aa1af07de8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8350c4c8-d36f-4d9c-8b98-7fc841e8033d req-3162efff-dbfa-44e1-833e-7c1e68d233c7 service nova] Releasing lock "refresh_cache-607acee2-b585-43d2-a897-eca4983d62db" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:24:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] <== connect_volume: return (1852ms) {'type': 'block', 'scsi_wwn': '26233616539356239', 'path': '/dev/sdd'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233616539356239', 'path': '/dev/sdd'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.318s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:24:13 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:24:13 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:24:13 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:24:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1d4d20-1617-46ed-a790-472a44131823]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:24:13 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T15:21:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1999463025',display_name='tempest-ServerActionsTestOtherA-server-1633226047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1999463025',id=14,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvWGadIJzQhPYzEMGopP5ED52Y6Gi9xcl1Gk9R/9FWs4vsKHHKulX+a7vugCHkAURz4pQ6pvg505Y+Ts3LLi3NJ3+G0dMmP1DiJTl+hCPVyGkJWdfTJyUNAnDxFiveANg==',key_name='tempest-keypair-1591259108',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:21:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='50f49255d5b74f448dc941027afbf84a',ramdisk_id='',reservation_id='r-qiq2etb6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-393209338',owner_user_name='tempest-ServerActionsTestOtherA-393209338-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:23:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e99cb2f1c4541fd9a656e038f4afac3',uuid=5e29bda9-f1d6-4951-9343-f189934a8a23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb2619ea-ffe7-4d82-9b44-984ee393620c", "address": "fa:16:3e:4b:c9:8b", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb2619ea-ff", "ovs_interfaceid": "fb2619ea-ffe7-4d82-9b44-984ee393620c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Converting VIF {"id": "fb2619ea-ffe7-4d82-9b44-984ee393620c", "address": "fa:16:3e:4b:c9:8b", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb2619ea-ff", "ovs_interfaceid": "fb2619ea-ffe7-4d82-9b44-984ee393620c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:c9:8b,bridge_name='br-int',has_traffic_filtering=True,id=fb2619ea-ffe7-4d82-9b44-984ee393620c,network=Network(efba4a7e-3a56-41d2-8af7-4c064ba641fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb2619ea-ff') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:24:13 user nova-compute[75080]:   <uuid>5e29bda9-f1d6-4951-9343-f189934a8a23</uuid>
Dec 05 15:24:13 user nova-compute[75080]:   <name>instance-0000000e</name>
Dec 05 15:24:13 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:24:13 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:24:13 user nova-compute[75080]:   <metadata>
Dec 05 15:24:13 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:24:13 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:24:13 user nova-compute[75080]:       <nova:name>tempest-ServerActionsTestOtherA-server-1633226047</nova:name>
Dec 05 15:24:13 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:24:11</nova:creationTime>
Dec 05 15:24:13 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:24:13 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:24:13 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:24:13 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:24:13 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:24:13 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:24:13 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:24:13 user nova-compute[75080]:       <nova:owner>
Dec 05 15:24:13 user nova-compute[75080]:         <nova:user uuid="8e99cb2f1c4541fd9a656e038f4afac3">tempest-ServerActionsTestOtherA-393209338-project-member</nova:user>
Dec 05 15:24:13 user nova-compute[75080]:         <nova:project uuid="50f49255d5b74f448dc941027afbf84a">tempest-ServerActionsTestOtherA-393209338</nova:project>
Dec 05 15:24:13 user nova-compute[75080]:       </nova:owner>
Dec 05 15:24:13 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:24:13 user nova-compute[75080]:       <nova:ports>
Dec 05 15:24:13 user nova-compute[75080]:         <nova:port uuid="fb2619ea-ffe7-4d82-9b44-984ee393620c">
Dec 05 15:24:13 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 05 15:24:13 user nova-compute[75080]:         </nova:port>
Dec 05 15:24:13 user nova-compute[75080]:       </nova:ports>
Dec 05 15:24:13 user nova-compute[75080]:     </nova:instance>
Dec 05 15:24:13 user nova-compute[75080]:   </metadata>
Dec 05 15:24:13 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:24:13 user nova-compute[75080]:     <system>
Dec 05 15:24:13 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:24:13 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:24:13 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:24:13 user nova-compute[75080]:       <entry name="serial">5e29bda9-f1d6-4951-9343-f189934a8a23</entry>
Dec 05 15:24:13 user nova-compute[75080]:       <entry name="uuid">5e29bda9-f1d6-4951-9343-f189934a8a23</entry>
Dec 05 15:24:13 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:24:13 user nova-compute[75080]:     </system>
Dec 05 15:24:13 user nova-compute[75080]:   </sysinfo>
Dec 05 15:24:13 user nova-compute[75080]:   <os>
Dec 05 15:24:13 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:24:13 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:24:13 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:24:13 user nova-compute[75080]:   </os>
Dec 05 15:24:13 user nova-compute[75080]:   <features>
Dec 05 15:24:13 user nova-compute[75080]:     <acpi/>
Dec 05 15:24:13 user nova-compute[75080]:     <apic/>
Dec 05 15:24:13 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:24:13 user nova-compute[75080]:   </features>
Dec 05 15:24:13 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:24:13 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:24:13 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:24:13 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:24:13 user nova-compute[75080]:   </clock>
Dec 05 15:24:13 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:24:13 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:24:13 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:24:13 user nova-compute[75080]:   </cpu>
Dec 05 15:24:13 user nova-compute[75080]:   <devices>
Dec 05 15:24:13 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:24:13 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:24:13 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk"/>
Dec 05 15:24:13 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:24:13 user nova-compute[75080]:     </disk>
Dec 05 15:24:13 user nova-compute[75080]:     <disk type="block" device="disk">
Dec 05 15:24:13 user nova-compute[75080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:24:13 user nova-compute[75080]:       <source dev="/dev/sdd"/>
Dec 05 15:24:13 user nova-compute[75080]:       <target dev="vdb" bus="virtio"/>
Dec 05 15:24:13 user nova-compute[75080]:       <serial>fd29efe7-d1b9-4460-86f2-9eb719695989</serial>
Dec 05 15:24:13 user nova-compute[75080]:     </disk>
Dec 05 15:24:13 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:24:13 user nova-compute[75080]:       <mac address="fa:16:3e:4b:c9:8b"/>
Dec 05 15:24:13 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:24:13 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:24:13 user nova-compute[75080]:       <target dev="tapfb2619ea-ff"/>
Dec 05 15:24:13 user nova-compute[75080]:     </interface>
Dec 05 15:24:13 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:24:13 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/console.log" append="off"/>
Dec 05 15:24:13 user nova-compute[75080]:     </serial>
Dec 05 15:24:13 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:24:13 user nova-compute[75080]:     <video>
Dec 05 15:24:13 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:24:13 user nova-compute[75080]:     </video>
Dec 05 15:24:13 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:24:13 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:24:13 user nova-compute[75080]:     </rng>
Dec 05 15:24:13 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:24:13 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:24:13 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:24:13 user nova-compute[75080]:     </memballoon>
Dec 05 15:24:13 user nova-compute[75080]:   </devices>
Dec 05 15:24:13 user nova-compute[75080]: </domain>
Dec 05 15:24:13 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T15:21:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1999463025',display_name='tempest-ServerActionsTestOtherA-server-1633226047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1999463025',id=14,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvWGadIJzQhPYzEMGopP5ED52Y6Gi9xcl1Gk9R/9FWs4vsKHHKulX+a7vugCHkAURz4pQ6pvg505Y+Ts3LLi3NJ3+G0dMmP1DiJTl+hCPVyGkJWdfTJyUNAnDxFiveANg==',key_name='tempest-keypair-1591259108',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:21:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='50f49255d5b74f448dc941027afbf84a',ramdisk_id='',reservation_id='r-qiq2etb6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-393209338',owner_user_name='tempest-ServerActionsTestOtherA-393209338-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:23:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e99cb2f1c4541fd9a656e038f4afac3',uuid=5e29bda9-f1d6-4951-9343-f189934a8a23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb2619ea-ffe7-4d82-9b44-984ee393620c", "address": "fa:16:3e:4b:c9:8b", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb2619ea-ff", "ovs_interfaceid": "fb2619ea-ffe7-4d82-9b44-984ee393620c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Converting VIF {"id": "fb2619ea-ffe7-4d82-9b44-984ee393620c", "address": "fa:16:3e:4b:c9:8b", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb2619ea-ff", "ovs_interfaceid": "fb2619ea-ffe7-4d82-9b44-984ee393620c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:c9:8b,bridge_name='br-int',has_traffic_filtering=True,id=fb2619ea-ffe7-4d82-9b44-984ee393620c,network=Network(efba4a7e-3a56-41d2-8af7-4c064ba641fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb2619ea-ff') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG os_vif [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:c9:8b,bridge_name='br-int',has_traffic_filtering=True,id=fb2619ea-ffe7-4d82-9b44-984ee393620c,network=Network(efba4a7e-3a56-41d2-8af7-4c064ba641fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb2619ea-ff') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c9c1860c-6003-528f-98b6-1cbeb08fc0cf', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd0bdca-253f-4922-bac9-76e2de142bec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067] added
Dec 05 15:24:13 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb2619ea-ff, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb2619ea-ff, col_values=(('qos', UUID('1f2c9181-2313-487b-bd2f-93e9fdad9449')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb2619ea-ff, col_values=(('external_ids', {'iface-id': 'fb2619ea-ffe7-4d82-9b44-984ee393620c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:c9:8b', 'vm-uuid': '5e29bda9-f1d6-4951-9343-f189934a8a23'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:13 user nova-compute[75080]: INFO os_vif [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:c9:8b,bridge_name='br-int',has_traffic_filtering=True,id=fb2619ea-ffe7-4d82-9b44-984ee393620c,network=Network(efba4a7e-3a56-41d2-8af7-4c064ba641fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb2619ea-ff')
Dec 05 15:24:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a335081-56f4-422b-b821-4624d78f9f4e]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b02f9cf-c295-448a-a96b-674e51e0ba53]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BiaLEflD {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BiaLEflD" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c0e4d3-00f8-445b-a41f-ac19bec66b2d]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BiaLEflD'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] No VIF found with MAC fa:16:3e:4b:c9:8b, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9350ae3f-ad39-4a23-81e3-3bf6ce358e48]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[33066090-6e3d-48d9-bcf8-7397b4b4d6c9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:24:13 user nova-compute[75080]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb (non-flash)
Dec 05 15:24:13 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:24:13 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:24:13 user nova-compute[75080]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb (non-flash)
Dec 05 15:24:13 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:24:13 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd2a44d-3cbf-409d-a836-8b1bb19d994d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067, portal: 172.16.0.220,3260]
Dec 05 15:24:13 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067, portal: 172.16.0.220,3260] successful.
Dec 05 15:24:13 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[99947dd8-98d3-49e9-ae70-4f73f4cc4d27]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[579ad899-646f-4431-90fd-5af6ea044284]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:24:13 user nova-compute[75080]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb (non-flash)
Dec 05 15:24:13 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:24:13 user nova-compute[75080]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 (non-flash)
Dec 05 15:24:13 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:24:13 user nova-compute[75080]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb (non-flash)
Dec 05 15:24:13 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:24:13 user nova-compute[75080]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 (non-flash)
Dec 05 15:24:13 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] HCTL ('36', '-', '-', 0) found on session 20 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d514a5-7808-4511-8c6f-73258c56f73a]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:24:13 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BiaLEflD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] <== connect_volume: return (2716ms) {'type': 'block', 'scsi_wwn': '23634653236386431', 'path': '/dev/sde'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634653236386431', 'path': '/dev/sde'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yPfSVKjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:24:14 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:24:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:24:14 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:24:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:24:14 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:24:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1239990a-c497-4e87-8104-15b916164584]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:24:14 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a59d0e-a436-4cec-a553-ce65d7e8cc54]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c] added
Dec 05 15:24:14 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[03829b02-9a1a-4e0e-8b24-9ab8be7f74cb]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04e454d-8145-4abc-9c81-04eab1b4ef69]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yPfSVKjc {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yPfSVKjc" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9114158a-8b04-4ebf-a986-f17fd33cbbfc]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yPfSVKjc'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba98ef3e-786b-47c8-b630-411dbd352d7f]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abef8df-eeca-4916-bcfc-239df09075ad]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:24:14 user nova-compute[75080]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb (non-flash)
Dec 05 15:24:14 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:24:14 user nova-compute[75080]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 (non-flash)
Dec 05 15:24:14 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:24:14 user nova-compute[75080]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb (non-flash)
Dec 05 15:24:14 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:24:14 user nova-compute[75080]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 (non-flash)
Dec 05 15:24:14 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:14 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c -p 172.16.0.220:3260 --login" returned: 0 in 0.114s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:15 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bfdb9d-3218-4f53-a938-418756ae7600]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:15 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c, portal: 172.16.0.220,3260]
Dec 05 15:24:15 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c, portal: 172.16.0.220,3260] successful.
Dec 05 15:24:15 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:15 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca23dd9-8159-4bd4-8297-f0ceff5715fc]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:15 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:15 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b5940d-becd-4961-b071-1921f4eac918]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:15 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:24:15 user nova-compute[75080]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb (non-flash)
Dec 05 15:24:15 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:24:15 user nova-compute[75080]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 (non-flash)
Dec 05 15:24:15 user nova-compute[75080]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c (non-flash)
Dec 05 15:24:15 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:24:15 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:24:15 user nova-compute[75080]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb (non-flash)
Dec 05 15:24:15 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:24:15 user nova-compute[75080]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 (non-flash)
Dec 05 15:24:15 user nova-compute[75080]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c (non-flash)
Dec 05 15:24:15 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:24:15 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.390s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:24:15 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:24:15 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] HCTL ('37', '-', '-', 0) found on session 21 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:24:15 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:24:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:15 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[954d7be7-6779-4af9-abd5-1f8e5b406db1]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:15 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Searching for a device in session 21 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:24:15 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yPfSVKjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:24:15 user nova-compute[75080]: DEBUG nova.compute.manager [req-2b11ad71-f9ed-407a-9a17-247cbee0146f req-aa407b5f-80f9-4879-9e2e-90f34f715a4d service nova] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Received event network-vif-plugged-fb2619ea-ffe7-4d82-9b44-984ee393620c {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:24:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2b11ad71-f9ed-407a-9a17-247cbee0146f req-aa407b5f-80f9-4879-9e2e-90f34f715a4d service nova] Acquiring lock "5e29bda9-f1d6-4951-9343-f189934a8a23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2b11ad71-f9ed-407a-9a17-247cbee0146f req-aa407b5f-80f9-4879-9e2e-90f34f715a4d service nova] Lock "5e29bda9-f1d6-4951-9343-f189934a8a23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2b11ad71-f9ed-407a-9a17-247cbee0146f req-aa407b5f-80f9-4879-9e2e-90f34f715a4d service nova] Lock "5e29bda9-f1d6-4951-9343-f189934a8a23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:15 user nova-compute[75080]: DEBUG nova.compute.manager [req-2b11ad71-f9ed-407a-9a17-247cbee0146f req-aa407b5f-80f9-4879-9e2e-90f34f715a4d service nova] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] No waiting events found dispatching network-vif-plugged-fb2619ea-ffe7-4d82-9b44-984ee393620c {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:24:15 user nova-compute[75080]: WARNING nova.compute.manager [req-2b11ad71-f9ed-407a-9a17-247cbee0146f req-aa407b5f-80f9-4879-9e2e-90f34f715a4d service nova] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Received unexpected event network-vif-plugged-fb2619ea-ffe7-4d82-9b44-984ee393620c for instance with vm_state active and task_state rebuild_spawning.
Dec 05 15:24:15 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.440s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] <== connect_volume: return (1444ms) {'type': 'block', 'scsi_wwn': '23033383465616533', 'path': '/dev/sdf'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033383465616533', 'path': '/dev/sdf'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1515147318',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1515147318',id=20,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLABp92B+QoSjO3Nxzym0L9AU1hs81rZrESUgnXLnvRsbfhOgXiJY51Pu/5sRkfV5DsnzijnsLpzT1f3eDANWTNGJryO8rMim4GO2hLFZkVjWYfIyLmQ5BqB2NrgQeAsMw==',key_name='tempest-keypair-755591069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='318ca7ad8bc84749ab0d0fb1e8aa34e6',ramdisk_id='',reservation_id='r-woffnt4p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-310720617',owner_user_name='tempest-TaggedBootDevicesTest_v242-310720617-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:23:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c369909d6cb47cfaad8670df22f4e67',uuid=6bf0a828-329b-46cf-aa76-bf6c24f08212,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0250593a-4991-4e30-9e86-4f403f81bbe6", "address": "fa:16:3e:64:7a:bd", "network": {"id": "0e5b22b3-949b-4958-8500-8730f46ffb1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2105495982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0250593a-49", "ovs_interfaceid": "0250593a-4991-4e30-9e86-4f403f81bbe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converting VIF {"id": "0250593a-4991-4e30-9e86-4f403f81bbe6", "address": "fa:16:3e:64:7a:bd", "network": {"id": "0e5b22b3-949b-4958-8500-8730f46ffb1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2105495982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0250593a-49", "ovs_interfaceid": "0250593a-4991-4e30-9e86-4f403f81bbe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:7a:bd,bridge_name='br-int',has_traffic_filtering=True,id=0250593a-4991-4e30-9e86-4f403f81bbe6,network=Network(0e5b22b3-949b-4958-8500-8730f46ffb1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0250593a-49') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1515147318',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1515147318',id=20,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLABp92B+QoSjO3Nxzym0L9AU1hs81rZrESUgnXLnvRsbfhOgXiJY51Pu/5sRkfV5DsnzijnsLpzT1f3eDANWTNGJryO8rMim4GO2hLFZkVjWYfIyLmQ5BqB2NrgQeAsMw==',key_name='tempest-keypair-755591069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='318ca7ad8bc84749ab0d0fb1e8aa34e6',ramdisk_id='',reservation_id='r-woffnt4p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-310720617',owner_user_name='tempest-TaggedBootDevicesTest_v242-310720617-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:23:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c369909d6cb47cfaad8670df22f4e67',uuid=6bf0a828-329b-46cf-aa76-bf6c24f08212,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70683181-d134-4a6c-9bc4-9dcf7b019162", "address": "fa:16:3e:d6:c5:60", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70683181-d1", "ovs_interfaceid": "70683181-d134-4a6c-9bc4-9dcf7b019162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converting VIF {"id": "70683181-d134-4a6c-9bc4-9dcf7b019162", "address": "fa:16:3e:d6:c5:60", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70683181-d1", "ovs_interfaceid": "70683181-d134-4a6c-9bc4-9dcf7b019162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:c5:60,bridge_name='br-int',has_traffic_filtering=True,id=70683181-d134-4a6c-9bc4-9dcf7b019162,network=Network(bf07d779-8fb7-4791-aee6-823fcbba0098),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap70683181-d1') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1515147318',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1515147318',id=20,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLABp92B+QoSjO3Nxzym0L9AU1hs81rZrESUgnXLnvRsbfhOgXiJY51Pu/5sRkfV5DsnzijnsLpzT1f3eDANWTNGJryO8rMim4GO2hLFZkVjWYfIyLmQ5BqB2NrgQeAsMw==',key_name='tempest-keypair-755591069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='318ca7ad8bc84749ab0d0fb1e8aa34e6',ramdisk_id='',reservation_id='r-woffnt4p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-310720617',owner_user_name='tempest-TaggedBootDevicesTest_v242-310720617-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:23:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c369909d6cb47cfaad8670df22f4e67',uuid=6bf0a828-329b-46cf-aa76-bf6c24f08212,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58b3e25c-cbd6-4bdd-83e8-775a0708df4e", "address": "fa:16:3e:40:ba:74", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b3e25c-cb", "ovs_interfaceid": "58b3e25c-cbd6-4bdd-83e8-775a0708df4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converting VIF {"id": "58b3e25c-cbd6-4bdd-83e8-775a0708df4e", "address": "fa:16:3e:40:ba:74", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b3e25c-cb", "ovs_interfaceid": "58b3e25c-cbd6-4bdd-83e8-775a0708df4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:ba:74,bridge_name='br-int',has_traffic_filtering=True,id=58b3e25c-cbd6-4bdd-83e8-775a0708df4e,network=Network(bf07d779-8fb7-4791-aee6-823fcbba0098),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap58b3e25c-cb') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1515147318',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1515147318',id=20,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLABp92B+QoSjO3Nxzym0L9AU1hs81rZrESUgnXLnvRsbfhOgXiJY51Pu/5sRkfV5DsnzijnsLpzT1f3eDANWTNGJryO8rMim4GO2hLFZkVjWYfIyLmQ5BqB2NrgQeAsMw==',key_name='tempest-keypair-755591069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='318ca7ad8bc84749ab0d0fb1e8aa34e6',ramdisk_id='',reservation_id='r-woffnt4p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-310720617',owner_user_name='tempest-TaggedBootDevicesTest_v242-310720617-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:23:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c369909d6cb47cfaad8670df22f4e67',uuid=6bf0a828-329b-46cf-aa76-bf6c24f08212,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a891d10-f2c1-4a8e-b404-67372485e9a5", "address": "fa:16:3e:4d:4a:cf", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a891d10-f2", "ovs_interfaceid": "7a891d10-f2c1-4a8e-b404-67372485e9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converting VIF {"id": "7a891d10-f2c1-4a8e-b404-67372485e9a5", "address": "fa:16:3e:4d:4a:cf", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a891d10-f2", "ovs_interfaceid": "7a891d10-f2c1-4a8e-b404-67372485e9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:4a:cf,bridge_name='br-int',has_traffic_filtering=True,id=7a891d10-f2c1-4a8e-b404-67372485e9a5,network=Network(bf07d779-8fb7-4791-aee6-823fcbba0098),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a891d10-f2') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1515147318',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1515147318',id=20,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLABp92B+QoSjO3Nxzym0L9AU1hs81rZrESUgnXLnvRsbfhOgXiJY51Pu/5sRkfV5DsnzijnsLpzT1f3eDANWTNGJryO8rMim4GO2hLFZkVjWYfIyLmQ5BqB2NrgQeAsMw==',key_name='tempest-keypair-755591069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='318ca7ad8bc84749ab0d0fb1e8aa34e6',ramdisk_id='',reservation_id='r-woffnt4p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-310720617',owner_user_name='tempest-TaggedBootDevicesTest_v242-310720617-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:23:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c369909d6cb47cfaad8670df22f4e67',uuid=6bf0a828-329b-46cf-aa76-bf6c24f08212,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "362dc737-7651-44c0-a618-ed6a1bcbee5c", "address": "fa:16:3e:da:3e:bf", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap362dc737-76", "ovs_interfaceid": "362dc737-7651-44c0-a618-ed6a1bcbee5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converting VIF {"id": "362dc737-7651-44c0-a618-ed6a1bcbee5c", "address": "fa:16:3e:da:3e:bf", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap362dc737-76", "ovs_interfaceid": "362dc737-7651-44c0-a618-ed6a1bcbee5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:3e:bf,bridge_name='br-int',has_traffic_filtering=True,id=362dc737-7651-44c0-a618-ed6a1bcbee5c,network=Network(bf07d779-8fb7-4791-aee6-823fcbba0098),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap362dc737-76') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1515147318',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1515147318',id=20,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLABp92B+QoSjO3Nxzym0L9AU1hs81rZrESUgnXLnvRsbfhOgXiJY51Pu/5sRkfV5DsnzijnsLpzT1f3eDANWTNGJryO8rMim4GO2hLFZkVjWYfIyLmQ5BqB2NrgQeAsMw==',key_name='tempest-keypair-755591069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='318ca7ad8bc84749ab0d0fb1e8aa34e6',ramdisk_id='',reservation_id='r-woffnt4p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-310720617',owner_user_name='tempest-TaggedBootDevicesTest_v242-310720617-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:23:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c369909d6cb47cfaad8670df22f4e67',uuid=6bf0a828-329b-46cf-aa76-bf6c24f08212,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb4d8798-73e9-4b84-91f1-8a6578f22ac1", "address": "fa:16:3e:da:66:49", "network": {"id": "af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-211886922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4d8798-73", "ovs_interfaceid": "eb4d8798-73e9-4b84-91f1-8a6578f22ac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converting VIF {"id": "eb4d8798-73e9-4b84-91f1-8a6578f22ac1", "address": "fa:16:3e:da:66:49", "network": {"id": "af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-211886922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4d8798-73", "ovs_interfaceid": "eb4d8798-73e9-4b84-91f1-8a6578f22ac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:66:49,bridge_name='br-int',has_traffic_filtering=True,id=eb4d8798-73e9-4b84-91f1-8a6578f22ac1,network=Network(af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb4d8798-73') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1515147318',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1515147318',id=20,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLABp92B+QoSjO3Nxzym0L9AU1hs81rZrESUgnXLnvRsbfhOgXiJY51Pu/5sRkfV5DsnzijnsLpzT1f3eDANWTNGJryO8rMim4GO2hLFZkVjWYfIyLmQ5BqB2NrgQeAsMw==',key_name='tempest-keypair-755591069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='318ca7ad8bc84749ab0d0fb1e8aa34e6',ramdisk_id='',reservation_id='r-woffnt4p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-310720617',owner_user_name='tempest-TaggedBootDevicesTest_v242-310720617-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:23:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c369909d6cb47cfaad8670df22f4e67',uuid=6bf0a828-329b-46cf-aa76-bf6c24f08212,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "510c5cfb-99de-4b45-aa65-a1c7a53969ea", "address": "fa:16:3e:34:62:97", "network": {"id": "af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-211886922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap510c5cfb-99", "ovs_interfaceid": "510c5cfb-99de-4b45-aa65-a1c7a53969ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converting VIF {"id": "510c5cfb-99de-4b45-aa65-a1c7a53969ea", "address": "fa:16:3e:34:62:97", "network": {"id": "af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-211886922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap510c5cfb-99", "ovs_interfaceid": "510c5cfb-99de-4b45-aa65-a1c7a53969ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:62:97,bridge_name='br-int',has_traffic_filtering=True,id=510c5cfb-99de-4b45-aa65-a1c7a53969ea,network=Network(af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap510c5cfb-99') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.objects.instance [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Lazy-loading 'pci_devices' on Instance uuid 6bf0a828-329b-46cf-aa76-bf6c24f08212 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:24:16 user nova-compute[75080]:   <uuid>6bf0a828-329b-46cf-aa76-bf6c24f08212</uuid>
Dec 05 15:24:16 user nova-compute[75080]:   <name>instance-00000014</name>
Dec 05 15:24:16 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:24:16 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:24:16 user nova-compute[75080]:   <metadata>
Dec 05 15:24:16 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:24:16 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:24:16 user nova-compute[75080]:       <nova:name>tempest-device-tagging-server-1515147318</nova:name>
Dec 05 15:24:16 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:24:10</nova:creationTime>
Dec 05 15:24:16 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:24:16 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:24:16 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:24:16 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:24:16 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:24:16 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:24:16 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:24:16 user nova-compute[75080]:       <nova:owner>
Dec 05 15:24:16 user nova-compute[75080]:         <nova:user uuid="4c369909d6cb47cfaad8670df22f4e67">tempest-TaggedBootDevicesTest_v242-310720617-project-member</nova:user>
Dec 05 15:24:16 user nova-compute[75080]:         <nova:project uuid="318ca7ad8bc84749ab0d0fb1e8aa34e6">tempest-TaggedBootDevicesTest_v242-310720617</nova:project>
Dec 05 15:24:16 user nova-compute[75080]:       </nova:owner>
Dec 05 15:24:16 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:24:16 user nova-compute[75080]:       <nova:ports>
Dec 05 15:24:16 user nova-compute[75080]:         <nova:port uuid="0250593a-4991-4e30-9e86-4f403f81bbe6">
Dec 05 15:24:16 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 05 15:24:16 user nova-compute[75080]:         </nova:port>
Dec 05 15:24:16 user nova-compute[75080]:         <nova:port uuid="70683181-d134-4a6c-9bc4-9dcf7b019162">
Dec 05 15:24:16 user nova-compute[75080]:           <nova:ip type="fixed" address="10.1.1.248" ipVersion="4"/>
Dec 05 15:24:16 user nova-compute[75080]:         </nova:port>
Dec 05 15:24:16 user nova-compute[75080]:         <nova:port uuid="58b3e25c-cbd6-4bdd-83e8-775a0708df4e">
Dec 05 15:24:16 user nova-compute[75080]:           <nova:ip type="fixed" address="10.1.1.76" ipVersion="4"/>
Dec 05 15:24:16 user nova-compute[75080]:         </nova:port>
Dec 05 15:24:16 user nova-compute[75080]:         <nova:port uuid="7a891d10-f2c1-4a8e-b404-67372485e9a5">
Dec 05 15:24:16 user nova-compute[75080]:           <nova:ip type="fixed" address="10.1.1.44" ipVersion="4"/>
Dec 05 15:24:16 user nova-compute[75080]:         </nova:port>
Dec 05 15:24:16 user nova-compute[75080]:         <nova:port uuid="362dc737-7651-44c0-a618-ed6a1bcbee5c">
Dec 05 15:24:16 user nova-compute[75080]:           <nova:ip type="fixed" address="10.1.1.69" ipVersion="4"/>
Dec 05 15:24:16 user nova-compute[75080]:         </nova:port>
Dec 05 15:24:16 user nova-compute[75080]:         <nova:port uuid="eb4d8798-73e9-4b84-91f1-8a6578f22ac1">
Dec 05 15:24:16 user nova-compute[75080]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Dec 05 15:24:16 user nova-compute[75080]:         </nova:port>
Dec 05 15:24:16 user nova-compute[75080]:         <nova:port uuid="510c5cfb-99de-4b45-aa65-a1c7a53969ea">
Dec 05 15:24:16 user nova-compute[75080]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Dec 05 15:24:16 user nova-compute[75080]:         </nova:port>
Dec 05 15:24:16 user nova-compute[75080]:       </nova:ports>
Dec 05 15:24:16 user nova-compute[75080]:     </nova:instance>
Dec 05 15:24:16 user nova-compute[75080]:   </metadata>
Dec 05 15:24:16 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:24:16 user nova-compute[75080]:     <system>
Dec 05 15:24:16 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:24:16 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:24:16 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:24:16 user nova-compute[75080]:       <entry name="serial">6bf0a828-329b-46cf-aa76-bf6c24f08212</entry>
Dec 05 15:24:16 user nova-compute[75080]:       <entry name="uuid">6bf0a828-329b-46cf-aa76-bf6c24f08212</entry>
Dec 05 15:24:16 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:24:16 user nova-compute[75080]:     </system>
Dec 05 15:24:16 user nova-compute[75080]:   </sysinfo>
Dec 05 15:24:16 user nova-compute[75080]:   <os>
Dec 05 15:24:16 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:24:16 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:24:16 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:24:16 user nova-compute[75080]:   </os>
Dec 05 15:24:16 user nova-compute[75080]:   <features>
Dec 05 15:24:16 user nova-compute[75080]:     <acpi/>
Dec 05 15:24:16 user nova-compute[75080]:     <apic/>
Dec 05 15:24:16 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:24:16 user nova-compute[75080]:   </features>
Dec 05 15:24:16 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:24:16 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:24:16 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:24:16 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:24:16 user nova-compute[75080]:   </clock>
Dec 05 15:24:16 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:24:16 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:24:16 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:24:16 user nova-compute[75080]:   </cpu>
Dec 05 15:24:16 user nova-compute[75080]:   <devices>
Dec 05 15:24:16 user nova-compute[75080]:     <disk type="file" device="cdrom">
Dec 05 15:24:16 user nova-compute[75080]:       <driver name="qemu" type="raw" cache="none"/>
Dec 05 15:24:16 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/6bf0a828-329b-46cf-aa76-bf6c24f08212/disk.config"/>
Dec 05 15:24:16 user nova-compute[75080]:       <target dev="hda" bus="ide"/>
Dec 05 15:24:16 user nova-compute[75080]:     </disk>
Dec 05 15:24:16 user nova-compute[75080]:     <disk type="block" device="disk">
Dec 05 15:24:16 user nova-compute[75080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:24:16 user nova-compute[75080]:       <source dev="/dev/sdc"/>
Dec 05 15:24:16 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:24:16 user nova-compute[75080]:       <serial>d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb</serial>
Dec 05 15:24:16 user nova-compute[75080]:     </disk>
Dec 05 15:24:16 user nova-compute[75080]:     <disk type="block" device="disk">
Dec 05 15:24:16 user nova-compute[75080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:24:16 user nova-compute[75080]:       <source dev="/dev/sde"/>
Dec 05 15:24:16 user nova-compute[75080]:       <target dev="vdb" bus="virtio"/>
Dec 05 15:24:16 user nova-compute[75080]:       <serial>6f1398ce-f855-4e97-9099-e4d050c59067</serial>
Dec 05 15:24:16 user nova-compute[75080]:     </disk>
Dec 05 15:24:16 user nova-compute[75080]:     <disk type="block" device="disk">
Dec 05 15:24:16 user nova-compute[75080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:24:16 user nova-compute[75080]:       <source dev="/dev/sdf"/>
Dec 05 15:24:16 user nova-compute[75080]:       <target dev="vdc" bus="virtio"/>
Dec 05 15:24:16 user nova-compute[75080]:       <serial>44a13dc1-2688-4c91-a77f-8b79f94d6b0c</serial>
Dec 05 15:24:16 user nova-compute[75080]:     </disk>
Dec 05 15:24:16 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:24:16 user nova-compute[75080]:       <mac address="fa:16:3e:64:7a:bd"/>
Dec 05 15:24:16 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:24:16 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:24:16 user nova-compute[75080]:       <target dev="tap0250593a-49"/>
Dec 05 15:24:16 user nova-compute[75080]:     </interface>
Dec 05 15:24:16 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:24:16 user nova-compute[75080]:       <mac address="fa:16:3e:d6:c5:60"/>
Dec 05 15:24:16 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:24:16 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:24:16 user nova-compute[75080]:       <target dev="tap70683181-d1"/>
Dec 05 15:24:16 user nova-compute[75080]:     </interface>
Dec 05 15:24:16 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:24:16 user nova-compute[75080]:       <mac address="fa:16:3e:40:ba:74"/>
Dec 05 15:24:16 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:24:16 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:24:16 user nova-compute[75080]:       <target dev="tap58b3e25c-cb"/>
Dec 05 15:24:16 user nova-compute[75080]:     </interface>
Dec 05 15:24:16 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:24:16 user nova-compute[75080]:       <mac address="fa:16:3e:4d:4a:cf"/>
Dec 05 15:24:16 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:24:16 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:24:16 user nova-compute[75080]:       <target dev="tap7a891d10-f2"/>
Dec 05 15:24:16 user nova-compute[75080]:     </interface>
Dec 05 15:24:16 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:24:16 user nova-compute[75080]:       <mac address="fa:16:3e:da:3e:bf"/>
Dec 05 15:24:16 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:24:16 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:24:16 user nova-compute[75080]:       <target dev="tap362dc737-76"/>
Dec 05 15:24:16 user nova-compute[75080]:     </interface>
Dec 05 15:24:16 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:24:16 user nova-compute[75080]:       <mac address="fa:16:3e:da:66:49"/>
Dec 05 15:24:16 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:24:16 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:24:16 user nova-compute[75080]:       <target dev="tapeb4d8798-73"/>
Dec 05 15:24:16 user nova-compute[75080]:     </interface>
Dec 05 15:24:16 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:24:16 user nova-compute[75080]:       <mac address="fa:16:3e:34:62:97"/>
Dec 05 15:24:16 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:24:16 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:24:16 user nova-compute[75080]:       <target dev="tap510c5cfb-99"/>
Dec 05 15:24:16 user nova-compute[75080]:     </interface>
Dec 05 15:24:16 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:24:16 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/6bf0a828-329b-46cf-aa76-bf6c24f08212/console.log" append="off"/>
Dec 05 15:24:16 user nova-compute[75080]:     </serial>
Dec 05 15:24:16 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:24:16 user nova-compute[75080]:     <video>
Dec 05 15:24:16 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:24:16 user nova-compute[75080]:     </video>
Dec 05 15:24:16 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:24:16 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:24:16 user nova-compute[75080]:     </rng>
Dec 05 15:24:16 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:24:16 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:24:16 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:24:16 user nova-compute[75080]:     </memballoon>
Dec 05 15:24:16 user nova-compute[75080]:   </devices>
Dec 05 15:24:16 user nova-compute[75080]: </domain>
Dec 05 15:24:16 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1515147318',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1515147318',id=20,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLABp92B+QoSjO3Nxzym0L9AU1hs81rZrESUgnXLnvRsbfhOgXiJY51Pu/5sRkfV5DsnzijnsLpzT1f3eDANWTNGJryO8rMim4GO2hLFZkVjWYfIyLmQ5BqB2NrgQeAsMw==',key_name='tempest-keypair-755591069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='318ca7ad8bc84749ab0d0fb1e8aa34e6',ramdisk_id='',reservation_id='r-woffnt4p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-310720617',owner_user_name='tempest-TaggedBootDevicesTest_v242-310720617-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:23:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c369909d6cb47cfaad8670df22f4e67',uuid=6bf0a828-329b-46cf-aa76-bf6c24f08212,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0250593a-4991-4e30-9e86-4f403f81bbe6", "address": "fa:16:3e:64:7a:bd", "network": {"id": "0e5b22b3-949b-4958-8500-8730f46ffb1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2105495982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0250593a-49", "ovs_interfaceid": "0250593a-4991-4e30-9e86-4f403f81bbe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converting VIF {"id": "0250593a-4991-4e30-9e86-4f403f81bbe6", "address": "fa:16:3e:64:7a:bd", "network": {"id": "0e5b22b3-949b-4958-8500-8730f46ffb1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2105495982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0250593a-49", "ovs_interfaceid": "0250593a-4991-4e30-9e86-4f403f81bbe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:7a:bd,bridge_name='br-int',has_traffic_filtering=True,id=0250593a-4991-4e30-9e86-4f403f81bbe6,network=Network(0e5b22b3-949b-4958-8500-8730f46ffb1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0250593a-49') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG os_vif [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:7a:bd,bridge_name='br-int',has_traffic_filtering=True,id=0250593a-4991-4e30-9e86-4f403f81bbe6,network=Network(0e5b22b3-949b-4958-8500-8730f46ffb1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0250593a-49') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a81e8e74-9656-50bf-8dd2-bca412f7a1c6', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0250593a-49, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0250593a-49, col_values=(('qos', UUID('43cd7de4-c2cb-49b5-948b-4ea7c276a12c')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0250593a-49, col_values=(('external_ids', {'iface-id': '0250593a-4991-4e30-9e86-4f403f81bbe6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:7a:bd', 'vm-uuid': '6bf0a828-329b-46cf-aa76-bf6c24f08212'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: INFO os_vif [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:7a:bd,bridge_name='br-int',has_traffic_filtering=True,id=0250593a-4991-4e30-9e86-4f403f81bbe6,network=Network(0e5b22b3-949b-4958-8500-8730f46ffb1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0250593a-49')
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1515147318',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1515147318',id=20,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLABp92B+QoSjO3Nxzym0L9AU1hs81rZrESUgnXLnvRsbfhOgXiJY51Pu/5sRkfV5DsnzijnsLpzT1f3eDANWTNGJryO8rMim4GO2hLFZkVjWYfIyLmQ5BqB2NrgQeAsMw==',key_name='tempest-keypair-755591069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='318ca7ad8bc84749ab0d0fb1e8aa34e6',ramdisk_id='',reservation_id='r-woffnt4p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-310720617',owner_user_name='tempest-TaggedBootDevicesTest_v242-310720617-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:23:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c369909d6cb47cfaad8670df22f4e67',uuid=6bf0a828-329b-46cf-aa76-bf6c24f08212,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70683181-d134-4a6c-9bc4-9dcf7b019162", "address": "fa:16:3e:d6:c5:60", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70683181-d1", "ovs_interfaceid": "70683181-d134-4a6c-9bc4-9dcf7b019162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converting VIF {"id": "70683181-d134-4a6c-9bc4-9dcf7b019162", "address": "fa:16:3e:d6:c5:60", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70683181-d1", "ovs_interfaceid": "70683181-d134-4a6c-9bc4-9dcf7b019162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:c5:60,bridge_name='br-int',has_traffic_filtering=True,id=70683181-d134-4a6c-9bc4-9dcf7b019162,network=Network(bf07d779-8fb7-4791-aee6-823fcbba0098),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap70683181-d1') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG os_vif [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:c5:60,bridge_name='br-int',has_traffic_filtering=True,id=70683181-d134-4a6c-9bc4-9dcf7b019162,network=Network(bf07d779-8fb7-4791-aee6-823fcbba0098),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap70683181-d1') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f1046a58-5da9-519f-8c8f-d2774d80aeee', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70683181-d1, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap70683181-d1, col_values=(('qos', UUID('8ff1e1e0-8a52-4013-add8-0509bf8deadf')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap70683181-d1, col_values=(('external_ids', {'iface-id': '70683181-d134-4a6c-9bc4-9dcf7b019162', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:c5:60', 'vm-uuid': '6bf0a828-329b-46cf-aa76-bf6c24f08212'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: INFO os_vif [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:c5:60,bridge_name='br-int',has_traffic_filtering=True,id=70683181-d134-4a6c-9bc4-9dcf7b019162,network=Network(bf07d779-8fb7-4791-aee6-823fcbba0098),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap70683181-d1')
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1515147318',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1515147318',id=20,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLABp92B+QoSjO3Nxzym0L9AU1hs81rZrESUgnXLnvRsbfhOgXiJY51Pu/5sRkfV5DsnzijnsLpzT1f3eDANWTNGJryO8rMim4GO2hLFZkVjWYfIyLmQ5BqB2NrgQeAsMw==',key_name='tempest-keypair-755591069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='318ca7ad8bc84749ab0d0fb1e8aa34e6',ramdisk_id='',reservation_id='r-woffnt4p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-310720617',owner_user_name='tempest-TaggedBootDevicesTest_v242-310720617-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:23:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c369909d6cb47cfaad8670df22f4e67',uuid=6bf0a828-329b-46cf-aa76-bf6c24f08212,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58b3e25c-cbd6-4bdd-83e8-775a0708df4e", "address": "fa:16:3e:40:ba:74", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b3e25c-cb", "ovs_interfaceid": "58b3e25c-cbd6-4bdd-83e8-775a0708df4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converting VIF {"id": "58b3e25c-cbd6-4bdd-83e8-775a0708df4e", "address": "fa:16:3e:40:ba:74", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b3e25c-cb", "ovs_interfaceid": "58b3e25c-cbd6-4bdd-83e8-775a0708df4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:ba:74,bridge_name='br-int',has_traffic_filtering=True,id=58b3e25c-cbd6-4bdd-83e8-775a0708df4e,network=Network(bf07d779-8fb7-4791-aee6-823fcbba0098),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap58b3e25c-cb') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG os_vif [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:ba:74,bridge_name='br-int',has_traffic_filtering=True,id=58b3e25c-cbd6-4bdd-83e8-775a0708df4e,network=Network(bf07d779-8fb7-4791-aee6-823fcbba0098),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap58b3e25c-cb') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9b3309e7-9fd9-504a-8830-2508eb6e0763', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58b3e25c-cb, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap58b3e25c-cb, col_values=(('qos', UUID('d4366a32-3e32-419a-bf74-987e0e70d2a6')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap58b3e25c-cb, col_values=(('external_ids', {'iface-id': '58b3e25c-cbd6-4bdd-83e8-775a0708df4e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:ba:74', 'vm-uuid': '6bf0a828-329b-46cf-aa76-bf6c24f08212'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: INFO os_vif [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:ba:74,bridge_name='br-int',has_traffic_filtering=True,id=58b3e25c-cbd6-4bdd-83e8-775a0708df4e,network=Network(bf07d779-8fb7-4791-aee6-823fcbba0098),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap58b3e25c-cb')
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1515147318',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1515147318',id=20,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLABp92B+QoSjO3Nxzym0L9AU1hs81rZrESUgnXLnvRsbfhOgXiJY51Pu/5sRkfV5DsnzijnsLpzT1f3eDANWTNGJryO8rMim4GO2hLFZkVjWYfIyLmQ5BqB2NrgQeAsMw==',key_name='tempest-keypair-755591069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='318ca7ad8bc84749ab0d0fb1e8aa34e6',ramdisk_id='',reservation_id='r-woffnt4p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-310720617',owner_user_name='tempest-TaggedBootDevicesTest_v242-310720617-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:23:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c369909d6cb47cfaad8670df22f4e67',uuid=6bf0a828-329b-46cf-aa76-bf6c24f08212,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a891d10-f2c1-4a8e-b404-67372485e9a5", "address": "fa:16:3e:4d:4a:cf", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a891d10-f2", "ovs_interfaceid": "7a891d10-f2c1-4a8e-b404-67372485e9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converting VIF {"id": "7a891d10-f2c1-4a8e-b404-67372485e9a5", "address": "fa:16:3e:4d:4a:cf", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a891d10-f2", "ovs_interfaceid": "7a891d10-f2c1-4a8e-b404-67372485e9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:4a:cf,bridge_name='br-int',has_traffic_filtering=True,id=7a891d10-f2c1-4a8e-b404-67372485e9a5,network=Network(bf07d779-8fb7-4791-aee6-823fcbba0098),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a891d10-f2') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG os_vif [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:4a:cf,bridge_name='br-int',has_traffic_filtering=True,id=7a891d10-f2c1-4a8e-b404-67372485e9a5,network=Network(bf07d779-8fb7-4791-aee6-823fcbba0098),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a891d10-f2') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ed0df2b1-9c02-5a55-a684-172f81e84e49', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a891d10-f2, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a891d10-f2, col_values=(('qos', UUID('0ab4cadd-3757-469b-a253-5a730392f9ec')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a891d10-f2, col_values=(('external_ids', {'iface-id': '7a891d10-f2c1-4a8e-b404-67372485e9a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:4a:cf', 'vm-uuid': '6bf0a828-329b-46cf-aa76-bf6c24f08212'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: INFO os_vif [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:4a:cf,bridge_name='br-int',has_traffic_filtering=True,id=7a891d10-f2c1-4a8e-b404-67372485e9a5,network=Network(bf07d779-8fb7-4791-aee6-823fcbba0098),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a891d10-f2')
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1515147318',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1515147318',id=20,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLABp92B+QoSjO3Nxzym0L9AU1hs81rZrESUgnXLnvRsbfhOgXiJY51Pu/5sRkfV5DsnzijnsLpzT1f3eDANWTNGJryO8rMim4GO2hLFZkVjWYfIyLmQ5BqB2NrgQeAsMw==',key_name='tempest-keypair-755591069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='318ca7ad8bc84749ab0d0fb1e8aa34e6',ramdisk_id='',reservation_id='r-woffnt4p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-310720617',owner_user_name='tempest-TaggedBootDevicesTest_v242-310720617-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:23:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c369909d6cb47cfaad8670df22f4e67',uuid=6bf0a828-329b-46cf-aa76-bf6c24f08212,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "362dc737-7651-44c0-a618-ed6a1bcbee5c", "address": "fa:16:3e:da:3e:bf", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap362dc737-76", "ovs_interfaceid": "362dc737-7651-44c0-a618-ed6a1bcbee5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converting VIF {"id": "362dc737-7651-44c0-a618-ed6a1bcbee5c", "address": "fa:16:3e:da:3e:bf", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap362dc737-76", "ovs_interfaceid": "362dc737-7651-44c0-a618-ed6a1bcbee5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:3e:bf,bridge_name='br-int',has_traffic_filtering=True,id=362dc737-7651-44c0-a618-ed6a1bcbee5c,network=Network(bf07d779-8fb7-4791-aee6-823fcbba0098),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap362dc737-76') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG os_vif [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:3e:bf,bridge_name='br-int',has_traffic_filtering=True,id=362dc737-7651-44c0-a618-ed6a1bcbee5c,network=Network(bf07d779-8fb7-4791-aee6-823fcbba0098),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap362dc737-76') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'df004919-be80-56ae-ae52-caee6d642375', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap362dc737-76, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap362dc737-76, col_values=(('qos', UUID('ecf26110-c107-4ac1-aebb-67145ed4c496')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap362dc737-76, col_values=(('external_ids', {'iface-id': '362dc737-7651-44c0-a618-ed6a1bcbee5c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:3e:bf', 'vm-uuid': '6bf0a828-329b-46cf-aa76-bf6c24f08212'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: INFO os_vif [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:3e:bf,bridge_name='br-int',has_traffic_filtering=True,id=362dc737-7651-44c0-a618-ed6a1bcbee5c,network=Network(bf07d779-8fb7-4791-aee6-823fcbba0098),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap362dc737-76')
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1515147318',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1515147318',id=20,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLABp92B+QoSjO3Nxzym0L9AU1hs81rZrESUgnXLnvRsbfhOgXiJY51Pu/5sRkfV5DsnzijnsLpzT1f3eDANWTNGJryO8rMim4GO2hLFZkVjWYfIyLmQ5BqB2NrgQeAsMw==',key_name='tempest-keypair-755591069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='318ca7ad8bc84749ab0d0fb1e8aa34e6',ramdisk_id='',reservation_id='r-woffnt4p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-310720617',owner_user_name='tempest-TaggedBootDevicesTest_v242-310720617-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:23:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c369909d6cb47cfaad8670df22f4e67',uuid=6bf0a828-329b-46cf-aa76-bf6c24f08212,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb4d8798-73e9-4b84-91f1-8a6578f22ac1", "address": "fa:16:3e:da:66:49", "network": {"id": "af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-211886922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4d8798-73", "ovs_interfaceid": "eb4d8798-73e9-4b84-91f1-8a6578f22ac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converting VIF {"id": "eb4d8798-73e9-4b84-91f1-8a6578f22ac1", "address": "fa:16:3e:da:66:49", "network": {"id": "af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-211886922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4d8798-73", "ovs_interfaceid": "eb4d8798-73e9-4b84-91f1-8a6578f22ac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:66:49,bridge_name='br-int',has_traffic_filtering=True,id=eb4d8798-73e9-4b84-91f1-8a6578f22ac1,network=Network(af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb4d8798-73') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG os_vif [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:66:49,bridge_name='br-int',has_traffic_filtering=True,id=eb4d8798-73e9-4b84-91f1-8a6578f22ac1,network=Network(af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb4d8798-73') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a776fded-5142-549d-b9a6-7dd0fd0ba30e', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb4d8798-73, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb4d8798-73, col_values=(('qos', UUID('52518e8d-2fe8-4640-8e68-2a81857e4878')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb4d8798-73, col_values=(('external_ids', {'iface-id': 'eb4d8798-73e9-4b84-91f1-8a6578f22ac1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:66:49', 'vm-uuid': '6bf0a828-329b-46cf-aa76-bf6c24f08212'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: INFO os_vif [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:66:49,bridge_name='br-int',has_traffic_filtering=True,id=eb4d8798-73e9-4b84-91f1-8a6578f22ac1,network=Network(af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb4d8798-73')
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1515147318',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1515147318',id=20,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLABp92B+QoSjO3Nxzym0L9AU1hs81rZrESUgnXLnvRsbfhOgXiJY51Pu/5sRkfV5DsnzijnsLpzT1f3eDANWTNGJryO8rMim4GO2hLFZkVjWYfIyLmQ5BqB2NrgQeAsMw==',key_name='tempest-keypair-755591069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='318ca7ad8bc84749ab0d0fb1e8aa34e6',ramdisk_id='',reservation_id='r-woffnt4p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-310720617',owner_user_name='tempest-TaggedBootDevicesTest_v242-310720617-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:23:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c369909d6cb47cfaad8670df22f4e67',uuid=6bf0a828-329b-46cf-aa76-bf6c24f08212,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "510c5cfb-99de-4b45-aa65-a1c7a53969ea", "address": "fa:16:3e:34:62:97", "network": {"id": "af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-211886922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap510c5cfb-99", "ovs_interfaceid": "510c5cfb-99de-4b45-aa65-a1c7a53969ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converting VIF {"id": "510c5cfb-99de-4b45-aa65-a1c7a53969ea", "address": "fa:16:3e:34:62:97", "network": {"id": "af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-211886922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap510c5cfb-99", "ovs_interfaceid": "510c5cfb-99de-4b45-aa65-a1c7a53969ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:62:97,bridge_name='br-int',has_traffic_filtering=True,id=510c5cfb-99de-4b45-aa65-a1c7a53969ea,network=Network(af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap510c5cfb-99') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG os_vif [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:62:97,bridge_name='br-int',has_traffic_filtering=True,id=510c5cfb-99de-4b45-aa65-a1c7a53969ea,network=Network(af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap510c5cfb-99') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8a0c4b61-330c-511d-ad11-e5e95c22c5ca', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap510c5cfb-99, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap510c5cfb-99, col_values=(('qos', UUID('0049a98f-45c0-4d39-aabe-36c29a8d225c')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap510c5cfb-99, col_values=(('external_ids', {'iface-id': '510c5cfb-99de-4b45-aa65-a1c7a53969ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:62:97', 'vm-uuid': '6bf0a828-329b-46cf-aa76-bf6c24f08212'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:24:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:16 user nova-compute[75080]: INFO os_vif [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:62:97,bridge_name='br-int',has_traffic_filtering=True,id=510c5cfb-99de-4b45-aa65-a1c7a53969ea,network=Network(af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap510c5cfb-99')
Dec 05 15:24:17 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] No BDM found with device name hda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:24:17 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:24:17 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] No VIF found with MAC fa:16:3e:64:7a:bd, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:24:17 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] No VIF found with MAC fa:16:3e:da:3e:bf, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:24:17 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Using config drive
Dec 05 15:24:17 user nova-compute[75080]: DEBUG nova.compute.manager [req-bcdaebda-d5ba-43ca-8ce1-3da8b50eb348 req-7c1649b8-8fc2-4794-8bd5-adb6ee0f93c9 service nova] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Received event network-vif-plugged-fb2619ea-ffe7-4d82-9b44-984ee393620c {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:24:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-bcdaebda-d5ba-43ca-8ce1-3da8b50eb348 req-7c1649b8-8fc2-4794-8bd5-adb6ee0f93c9 service nova] Acquiring lock "5e29bda9-f1d6-4951-9343-f189934a8a23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-bcdaebda-d5ba-43ca-8ce1-3da8b50eb348 req-7c1649b8-8fc2-4794-8bd5-adb6ee0f93c9 service nova] Lock "5e29bda9-f1d6-4951-9343-f189934a8a23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-bcdaebda-d5ba-43ca-8ce1-3da8b50eb348 req-7c1649b8-8fc2-4794-8bd5-adb6ee0f93c9 service nova] Lock "5e29bda9-f1d6-4951-9343-f189934a8a23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:17 user nova-compute[75080]: DEBUG nova.compute.manager [req-bcdaebda-d5ba-43ca-8ce1-3da8b50eb348 req-7c1649b8-8fc2-4794-8bd5-adb6ee0f93c9 service nova] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] No waiting events found dispatching network-vif-plugged-fb2619ea-ffe7-4d82-9b44-984ee393620c {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:24:17 user nova-compute[75080]: WARNING nova.compute.manager [req-bcdaebda-d5ba-43ca-8ce1-3da8b50eb348 req-7c1649b8-8fc2-4794-8bd5-adb6ee0f93c9 service nova] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Received unexpected event network-vif-plugged-fb2619ea-ffe7-4d82-9b44-984ee393620c for instance with vm_state active and task_state rebuild_spawning.
Dec 05 15:24:17 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Creating config drive at /opt/stack/data/nova/instances/6bf0a828-329b-46cf-aa76-bf6c24f08212/disk.config
Dec 05 15:24:17 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6bf0a828-329b-46cf-aa76-bf6c24f08212/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8_mxjgcq {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:17 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6bf0a828-329b-46cf-aa76-bf6c24f08212/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8_mxjgcq" returned: 0 in 0.061s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:17 user nova-compute[75080]: DEBUG nova.compute.manager [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:24:17 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:24:17 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Instance spawned successfully.
Dec 05 15:24:17 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:24:17 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:24:17 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:24:17 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:24:17 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:24:17 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:24:17 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:24:17 user nova-compute[75080]: DEBUG nova.compute.manager [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:24:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:17 user nova-compute[75080]: DEBUG nova.objects.instance [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75080) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Dec 05 15:24:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-de91c369-b86d-42ec-9e04-6b0e42b572c7 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.071s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:19 user nova-compute[75080]: DEBUG nova.compute.manager [req-60e36f7b-d64f-4c1a-811d-157641bbed72 req-6eaa7a93-5443-41bd-b81a-ffc6268325b8 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-plugged-0250593a-4991-4e30-9e86-4f403f81bbe6 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:24:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-60e36f7b-d64f-4c1a-811d-157641bbed72 req-6eaa7a93-5443-41bd-b81a-ffc6268325b8 service nova] Acquiring lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-60e36f7b-d64f-4c1a-811d-157641bbed72 req-6eaa7a93-5443-41bd-b81a-ffc6268325b8 service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-60e36f7b-d64f-4c1a-811d-157641bbed72 req-6eaa7a93-5443-41bd-b81a-ffc6268325b8 service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:19 user nova-compute[75080]: DEBUG nova.compute.manager [req-60e36f7b-d64f-4c1a-811d-157641bbed72 req-6eaa7a93-5443-41bd-b81a-ffc6268325b8 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] No waiting events found dispatching network-vif-plugged-0250593a-4991-4e30-9e86-4f403f81bbe6 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:24:19 user nova-compute[75080]: WARNING nova.compute.manager [req-60e36f7b-d64f-4c1a-811d-157641bbed72 req-6eaa7a93-5443-41bd-b81a-ffc6268325b8 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received unexpected event network-vif-plugged-0250593a-4991-4e30-9e86-4f403f81bbe6 for instance with vm_state building and task_state spawning.
Dec 05 15:24:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:20 user nova-compute[75080]: DEBUG nova.compute.manager [req-bfd735b9-4929-40b0-881a-5506c281bdac req-75c8fb1c-c80f-4211-ac30-462b94a537eb service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-plugged-58b3e25c-cbd6-4bdd-83e8-775a0708df4e {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:24:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-bfd735b9-4929-40b0-881a-5506c281bdac req-75c8fb1c-c80f-4211-ac30-462b94a537eb service nova] Acquiring lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-bfd735b9-4929-40b0-881a-5506c281bdac req-75c8fb1c-c80f-4211-ac30-462b94a537eb service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-bfd735b9-4929-40b0-881a-5506c281bdac req-75c8fb1c-c80f-4211-ac30-462b94a537eb service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:20 user nova-compute[75080]: DEBUG nova.compute.manager [req-bfd735b9-4929-40b0-881a-5506c281bdac req-75c8fb1c-c80f-4211-ac30-462b94a537eb service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] No waiting events found dispatching network-vif-plugged-58b3e25c-cbd6-4bdd-83e8-775a0708df4e {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:24:20 user nova-compute[75080]: WARNING nova.compute.manager [req-bfd735b9-4929-40b0-881a-5506c281bdac req-75c8fb1c-c80f-4211-ac30-462b94a537eb service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received unexpected event network-vif-plugged-58b3e25c-cbd6-4bdd-83e8-775a0708df4e for instance with vm_state building and task_state spawning.
Dec 05 15:24:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:21 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:21 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:21 user nova-compute[75080]: DEBUG nova.compute.manager [req-11b98100-4d0f-4d94-a424-e0cf06369ee4 req-c4d73e24-605e-4dc0-94e7-b11a183346bc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-plugged-0250593a-4991-4e30-9e86-4f403f81bbe6 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:24:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-11b98100-4d0f-4d94-a424-e0cf06369ee4 req-c4d73e24-605e-4dc0-94e7-b11a183346bc service nova] Acquiring lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-11b98100-4d0f-4d94-a424-e0cf06369ee4 req-c4d73e24-605e-4dc0-94e7-b11a183346bc service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-11b98100-4d0f-4d94-a424-e0cf06369ee4 req-c4d73e24-605e-4dc0-94e7-b11a183346bc service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:21 user nova-compute[75080]: DEBUG nova.compute.manager [req-11b98100-4d0f-4d94-a424-e0cf06369ee4 req-c4d73e24-605e-4dc0-94e7-b11a183346bc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] No waiting events found dispatching network-vif-plugged-0250593a-4991-4e30-9e86-4f403f81bbe6 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:24:21 user nova-compute[75080]: WARNING nova.compute.manager [req-11b98100-4d0f-4d94-a424-e0cf06369ee4 req-c4d73e24-605e-4dc0-94e7-b11a183346bc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received unexpected event network-vif-plugged-0250593a-4991-4e30-9e86-4f403f81bbe6 for instance with vm_state building and task_state spawning.
Dec 05 15:24:21 user nova-compute[75080]: DEBUG nova.compute.manager [req-11b98100-4d0f-4d94-a424-e0cf06369ee4 req-c4d73e24-605e-4dc0-94e7-b11a183346bc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-plugged-70683181-d134-4a6c-9bc4-9dcf7b019162 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:24:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-11b98100-4d0f-4d94-a424-e0cf06369ee4 req-c4d73e24-605e-4dc0-94e7-b11a183346bc service nova] Acquiring lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-11b98100-4d0f-4d94-a424-e0cf06369ee4 req-c4d73e24-605e-4dc0-94e7-b11a183346bc service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-11b98100-4d0f-4d94-a424-e0cf06369ee4 req-c4d73e24-605e-4dc0-94e7-b11a183346bc service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:21 user nova-compute[75080]: DEBUG nova.compute.manager [req-11b98100-4d0f-4d94-a424-e0cf06369ee4 req-c4d73e24-605e-4dc0-94e7-b11a183346bc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] No waiting events found dispatching network-vif-plugged-70683181-d134-4a6c-9bc4-9dcf7b019162 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:24:21 user nova-compute[75080]: WARNING nova.compute.manager [req-11b98100-4d0f-4d94-a424-e0cf06369ee4 req-c4d73e24-605e-4dc0-94e7-b11a183346bc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received unexpected event network-vif-plugged-70683181-d134-4a6c-9bc4-9dcf7b019162 for instance with vm_state building and task_state spawning.
Dec 05 15:24:21 user nova-compute[75080]: DEBUG nova.compute.manager [req-11b98100-4d0f-4d94-a424-e0cf06369ee4 req-c4d73e24-605e-4dc0-94e7-b11a183346bc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-plugged-70683181-d134-4a6c-9bc4-9dcf7b019162 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:24:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-11b98100-4d0f-4d94-a424-e0cf06369ee4 req-c4d73e24-605e-4dc0-94e7-b11a183346bc service nova] Acquiring lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-11b98100-4d0f-4d94-a424-e0cf06369ee4 req-c4d73e24-605e-4dc0-94e7-b11a183346bc service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-11b98100-4d0f-4d94-a424-e0cf06369ee4 req-c4d73e24-605e-4dc0-94e7-b11a183346bc service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:21 user nova-compute[75080]: DEBUG nova.compute.manager [req-11b98100-4d0f-4d94-a424-e0cf06369ee4 req-c4d73e24-605e-4dc0-94e7-b11a183346bc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] No waiting events found dispatching network-vif-plugged-70683181-d134-4a6c-9bc4-9dcf7b019162 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:24:21 user nova-compute[75080]: WARNING nova.compute.manager [req-11b98100-4d0f-4d94-a424-e0cf06369ee4 req-c4d73e24-605e-4dc0-94e7-b11a183346bc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received unexpected event network-vif-plugged-70683181-d134-4a6c-9bc4-9dcf7b019162 for instance with vm_state building and task_state spawning.
Dec 05 15:24:21 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:21 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:21 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:21 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:21 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:21 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "f425241c-0a1d-44fa-affc-9e40974b290d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "f425241c-0a1d-44fa-affc-9e40974b290d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG nova.compute.manager [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-plugged-58b3e25c-cbd6-4bdd-83e8-775a0708df4e {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] Acquiring lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG nova.compute.manager [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] No waiting events found dispatching network-vif-plugged-58b3e25c-cbd6-4bdd-83e8-775a0708df4e {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:24:22 user nova-compute[75080]: WARNING nova.compute.manager [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received unexpected event network-vif-plugged-58b3e25c-cbd6-4bdd-83e8-775a0708df4e for instance with vm_state building and task_state spawning.
Dec 05 15:24:22 user nova-compute[75080]: DEBUG nova.compute.manager [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-plugged-7a891d10-f2c1-4a8e-b404-67372485e9a5 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] Acquiring lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG nova.compute.manager [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] No waiting events found dispatching network-vif-plugged-7a891d10-f2c1-4a8e-b404-67372485e9a5 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:24:22 user nova-compute[75080]: WARNING nova.compute.manager [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received unexpected event network-vif-plugged-7a891d10-f2c1-4a8e-b404-67372485e9a5 for instance with vm_state building and task_state spawning.
Dec 05 15:24:22 user nova-compute[75080]: DEBUG nova.compute.manager [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-plugged-7a891d10-f2c1-4a8e-b404-67372485e9a5 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] Acquiring lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG nova.compute.manager [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] No waiting events found dispatching network-vif-plugged-7a891d10-f2c1-4a8e-b404-67372485e9a5 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:24:22 user nova-compute[75080]: WARNING nova.compute.manager [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received unexpected event network-vif-plugged-7a891d10-f2c1-4a8e-b404-67372485e9a5 for instance with vm_state building and task_state spawning.
Dec 05 15:24:22 user nova-compute[75080]: DEBUG nova.compute.manager [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-plugged-362dc737-7651-44c0-a618-ed6a1bcbee5c {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] Acquiring lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.010s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG nova.compute.manager [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] No waiting events found dispatching network-vif-plugged-362dc737-7651-44c0-a618-ed6a1bcbee5c {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:24:22 user nova-compute[75080]: WARNING nova.compute.manager [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received unexpected event network-vif-plugged-362dc737-7651-44c0-a618-ed6a1bcbee5c for instance with vm_state building and task_state spawning.
Dec 05 15:24:22 user nova-compute[75080]: DEBUG nova.compute.manager [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-plugged-362dc737-7651-44c0-a618-ed6a1bcbee5c {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] Acquiring lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG nova.compute.manager [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] No waiting events found dispatching network-vif-plugged-362dc737-7651-44c0-a618-ed6a1bcbee5c {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:24:22 user nova-compute[75080]: WARNING nova.compute.manager [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received unexpected event network-vif-plugged-362dc737-7651-44c0-a618-ed6a1bcbee5c for instance with vm_state building and task_state spawning.
Dec 05 15:24:22 user nova-compute[75080]: DEBUG nova.compute.manager [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-plugged-eb4d8798-73e9-4b84-91f1-8a6578f22ac1 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] Acquiring lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG nova.compute.manager [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] No waiting events found dispatching network-vif-plugged-eb4d8798-73e9-4b84-91f1-8a6578f22ac1 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:24:22 user nova-compute[75080]: WARNING nova.compute.manager [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received unexpected event network-vif-plugged-eb4d8798-73e9-4b84-91f1-8a6578f22ac1 for instance with vm_state building and task_state spawning.
Dec 05 15:24:22 user nova-compute[75080]: DEBUG nova.compute.manager [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-plugged-eb4d8798-73e9-4b84-91f1-8a6578f22ac1 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] Acquiring lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG nova.compute.manager [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] No waiting events found dispatching network-vif-plugged-eb4d8798-73e9-4b84-91f1-8a6578f22ac1 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:24:22 user nova-compute[75080]: WARNING nova.compute.manager [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received unexpected event network-vif-plugged-eb4d8798-73e9-4b84-91f1-8a6578f22ac1 for instance with vm_state building and task_state spawning.
Dec 05 15:24:22 user nova-compute[75080]: DEBUG nova.compute.manager [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-plugged-510c5cfb-99de-4b45-aa65-a1c7a53969ea {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] Acquiring lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG nova.compute.manager [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] No waiting events found dispatching network-vif-plugged-510c5cfb-99de-4b45-aa65-a1c7a53969ea {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:24:22 user nova-compute[75080]: WARNING nova.compute.manager [req-086918c2-e999-4a50-b603-dffee26cab93 req-06a4dd91-dba2-4605-9cc3-684e63435394 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received unexpected event network-vif-plugged-510c5cfb-99de-4b45-aa65-a1c7a53969ea for instance with vm_state building and task_state spawning.
Dec 05 15:24:22 user nova-compute[75080]: DEBUG nova.compute.manager [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:24:22 user nova-compute[75080]: INFO nova.compute.claims [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Claim successful on node user
Dec 05 15:24:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:24:22 user nova-compute[75080]: WARNING nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] While synchronizing instance power states, found 9 instances in the database and 8 instances on the hypervisor.
Dec 05 15:24:22 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Triggering sync for uuid bd75375a-8b70-4bc2-a72b-14213ebaa4e9 {{(pid=75080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Triggering sync for uuid eedd1529-4feb-4f85-8625-0c20d8e0359d {{(pid=75080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Triggering sync for uuid 607acee2-b585-43d2-a897-eca4983d62db {{(pid=75080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Triggering sync for uuid 412e1e40-082a-429e-9d35-013b72322761 {{(pid=75080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Triggering sync for uuid 07b025ff-4a9d-48a2-b950-b8f2d165f33c {{(pid=75080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Triggering sync for uuid 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7 {{(pid=75080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Triggering sync for uuid 6bf0a828-329b-46cf-aa76-bf6c24f08212 {{(pid=75080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Triggering sync for uuid f425241c-0a1d-44fa-affc-9e40974b290d {{(pid=75080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Triggering sync for uuid 5e29bda9-f1d6-4951-9343-f189934a8a23 {{(pid=75080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "bd75375a-8b70-4bc2-a72b-14213ebaa4e9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "bd75375a-8b70-4bc2-a72b-14213ebaa4e9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "eedd1529-4feb-4f85-8625-0c20d8e0359d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "eedd1529-4feb-4f85-8625-0c20d8e0359d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "607acee2-b585-43d2-a897-eca4983d62db" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "607acee2-b585-43d2-a897-eca4983d62db" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "412e1e40-082a-429e-9d35-013b72322761" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "412e1e40-082a-429e-9d35-013b72322761" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "07b025ff-4a9d-48a2-b950-b8f2d165f33c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "07b025ff-4a9d-48a2-b950-b8f2d165f33c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "6bf0a828-329b-46cf-aa76-bf6c24f08212" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "f425241c-0a1d-44fa-affc-9e40974b290d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "5e29bda9-f1d6-4951-9343-f189934a8a23" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "5e29bda9-f1d6-4951-9343-f189934a8a23" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "bd75375a-8b70-4bc2-a72b-14213ebaa4e9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "412e1e40-082a-429e-9d35-013b72322761" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "eedd1529-4feb-4f85-8625-0c20d8e0359d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "607acee2-b585-43d2-a897-eca4983d62db" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.109s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.119s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "5e29bda9-f1d6-4951-9343-f189934a8a23" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.119s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "07b025ff-4a9d-48a2-b950-b8f2d165f33c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.122s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.584s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:22 user nova-compute[75080]: DEBUG nova.compute.manager [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:24:23 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:24:23 user nova-compute[75080]: DEBUG nova.compute.manager [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:24:23 user nova-compute[75080]: DEBUG nova.network.neutron [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:24:23 user nova-compute[75080]: DEBUG nova.compute.manager [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:24:23 user nova-compute[75080]: INFO nova.virt.block_device [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Booting with volume snapshot c7ceaafd-15cf-4e66-8b1c-4fe1815bbec4 at /dev/vda
Dec 05 15:24:23 user nova-compute[75080]: DEBUG nova.policy [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '15be5b54cc8346bb86683e4ed2fbba9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11227acd507347ae9c5a3bc710707f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:24:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:23 user nova-compute[75080]: DEBUG nova.compute.manager [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:24:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:24:23 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Instance spawned successfully.
Dec 05 15:24:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:24:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:24:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:24:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:24:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:24:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:24:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:24:23 user nova-compute[75080]: INFO nova.compute.manager [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Took 13.30 seconds to spawn the instance on the hypervisor.
Dec 05 15:24:23 user nova-compute[75080]: DEBUG nova.compute.manager [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:24:23 user nova-compute[75080]: INFO nova.compute.manager [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Took 62.72 seconds to build instance.
Dec 05 15:24:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c9101de6-89af-4c32-acc3-90aa33cfa9d7 tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 62.840s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.116s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:23 user nova-compute[75080]: INFO nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] During sync_power_state the instance has a pending task (spawning). Skip.
Dec 05 15:24:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:24 user nova-compute[75080]: DEBUG nova.network.neutron [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Successfully created port: d41ca18b-b2d5-46dc-a5f4-410b315986b6 {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:24:24 user nova-compute[75080]: DEBUG nova.compute.manager [req-1374a4fc-6213-47b8-afde-a810f821e003 req-2f2d8ac9-9ea5-4fc7-ae26-57400a3b6dd0 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-plugged-510c5cfb-99de-4b45-aa65-a1c7a53969ea {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:24:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-1374a4fc-6213-47b8-afde-a810f821e003 req-2f2d8ac9-9ea5-4fc7-ae26-57400a3b6dd0 service nova] Acquiring lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-1374a4fc-6213-47b8-afde-a810f821e003 req-2f2d8ac9-9ea5-4fc7-ae26-57400a3b6dd0 service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-1374a4fc-6213-47b8-afde-a810f821e003 req-2f2d8ac9-9ea5-4fc7-ae26-57400a3b6dd0 service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:24 user nova-compute[75080]: DEBUG nova.compute.manager [req-1374a4fc-6213-47b8-afde-a810f821e003 req-2f2d8ac9-9ea5-4fc7-ae26-57400a3b6dd0 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] No waiting events found dispatching network-vif-plugged-510c5cfb-99de-4b45-aa65-a1c7a53969ea {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:24:24 user nova-compute[75080]: WARNING nova.compute.manager [req-1374a4fc-6213-47b8-afde-a810f821e003 req-2f2d8ac9-9ea5-4fc7-ae26-57400a3b6dd0 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received unexpected event network-vif-plugged-510c5cfb-99de-4b45-aa65-a1c7a53969ea for instance with vm_state active and task_state None.
Dec 05 15:24:24 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:24:24 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:24:24 user nova-compute[75080]: DEBUG nova.network.neutron [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Successfully updated port: d41ca18b-b2d5-46dc-a5f4-410b315986b6 {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:24:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "refresh_cache-f425241c-0a1d-44fa-affc-9e40974b290d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:24:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquired lock "refresh_cache-f425241c-0a1d-44fa-affc-9e40974b290d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:24:24 user nova-compute[75080]: DEBUG nova.network.neutron [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:24:25 user nova-compute[75080]: DEBUG nova.compute.manager [req-7b792bb3-7870-4e31-b73b-bc0c758a1458 req-580944b2-efda-48b2-8f3e-72359498e6cd service nova] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Received event network-changed-d41ca18b-b2d5-46dc-a5f4-410b315986b6 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:24:25 user nova-compute[75080]: DEBUG nova.compute.manager [req-7b792bb3-7870-4e31-b73b-bc0c758a1458 req-580944b2-efda-48b2-8f3e-72359498e6cd service nova] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Refreshing instance network info cache due to event network-changed-d41ca18b-b2d5-46dc-a5f4-410b315986b6. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:24:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7b792bb3-7870-4e31-b73b-bc0c758a1458 req-580944b2-efda-48b2-8f3e-72359498e6cd service nova] Acquiring lock "refresh_cache-f425241c-0a1d-44fa-affc-9e40974b290d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:24:25 user nova-compute[75080]: DEBUG nova.network.neutron [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:24:25 user nova-compute[75080]: DEBUG nova.network.neutron [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Updating instance_info_cache with network_info: [{"id": "d41ca18b-b2d5-46dc-a5f4-410b315986b6", "address": "fa:16:3e:93:e2:a8", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd41ca18b-b2", "ovs_interfaceid": "d41ca18b-b2d5-46dc-a5f4-410b315986b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:24:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Releasing lock "refresh_cache-f425241c-0a1d-44fa-affc-9e40974b290d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:24:25 user nova-compute[75080]: DEBUG nova.compute.manager [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Instance network_info: |[{"id": "d41ca18b-b2d5-46dc-a5f4-410b315986b6", "address": "fa:16:3e:93:e2:a8", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd41ca18b-b2", "ovs_interfaceid": "d41ca18b-b2d5-46dc-a5f4-410b315986b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:24:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7b792bb3-7870-4e31-b73b-bc0c758a1458 req-580944b2-efda-48b2-8f3e-72359498e6cd service nova] Acquired lock "refresh_cache-f425241c-0a1d-44fa-affc-9e40974b290d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:24:25 user nova-compute[75080]: DEBUG nova.network.neutron [req-7b792bb3-7870-4e31-b73b-bc0c758a1458 req-580944b2-efda-48b2-8f3e-72359498e6cd service nova] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Refreshing network info cache for port d41ca18b-b2d5-46dc-a5f4-410b315986b6 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:24:25 user nova-compute[75080]: DEBUG nova.network.neutron [req-7b792bb3-7870-4e31-b73b-bc0c758a1458 req-580944b2-efda-48b2-8f3e-72359498e6cd service nova] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Updated VIF entry in instance network info cache for port d41ca18b-b2d5-46dc-a5f4-410b315986b6. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:24:25 user nova-compute[75080]: DEBUG nova.network.neutron [req-7b792bb3-7870-4e31-b73b-bc0c758a1458 req-580944b2-efda-48b2-8f3e-72359498e6cd service nova] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Updating instance_info_cache with network_info: [{"id": "d41ca18b-b2d5-46dc-a5f4-410b315986b6", "address": "fa:16:3e:93:e2:a8", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd41ca18b-b2", "ovs_interfaceid": "d41ca18b-b2d5-46dc-a5f4-410b315986b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:24:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7b792bb3-7870-4e31-b73b-bc0c758a1458 req-580944b2-efda-48b2-8f3e-72359498e6cd service nova] Releasing lock "refresh_cache-f425241c-0a1d-44fa-affc-9e40974b290d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:24:26 user nova-compute[75080]: DEBUG nova.compute.manager [req-ca2948cb-40aa-4429-a28f-1a0eca4cb81e req-26dc1f2a-15b4-4aaf-8335-c684f79f3d53 service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] Received event network-changed-78547a5f-e10d-4a62-8d35-5584ce87d2c5 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:24:26 user nova-compute[75080]: DEBUG nova.compute.manager [req-ca2948cb-40aa-4429-a28f-1a0eca4cb81e req-26dc1f2a-15b4-4aaf-8335-c684f79f3d53 service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] Refreshing instance network info cache due to event network-changed-78547a5f-e10d-4a62-8d35-5584ce87d2c5. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:24:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-ca2948cb-40aa-4429-a28f-1a0eca4cb81e req-26dc1f2a-15b4-4aaf-8335-c684f79f3d53 service nova] Acquiring lock "refresh_cache-412e1e40-082a-429e-9d35-013b72322761" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:24:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-ca2948cb-40aa-4429-a28f-1a0eca4cb81e req-26dc1f2a-15b4-4aaf-8335-c684f79f3d53 service nova] Acquired lock "refresh_cache-412e1e40-082a-429e-9d35-013b72322761" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:24:26 user nova-compute[75080]: DEBUG nova.network.neutron [req-ca2948cb-40aa-4429-a28f-1a0eca4cb81e req-26dc1f2a-15b4-4aaf-8335-c684f79f3d53 service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] Refreshing network info cache for port 78547a5f-e10d-4a62-8d35-5584ce87d2c5 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:24:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:27 user nova-compute[75080]: DEBUG nova.network.neutron [req-ca2948cb-40aa-4429-a28f-1a0eca4cb81e req-26dc1f2a-15b4-4aaf-8335-c684f79f3d53 service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] Updated VIF entry in instance network info cache for port 78547a5f-e10d-4a62-8d35-5584ce87d2c5. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:24:27 user nova-compute[75080]: DEBUG nova.network.neutron [req-ca2948cb-40aa-4429-a28f-1a0eca4cb81e req-26dc1f2a-15b4-4aaf-8335-c684f79f3d53 service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] Updating instance_info_cache with network_info: [{"id": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "address": "fa:16:3e:ab:04:37", "network": {"id": "3f7b7f16-6cc0-45b9-9f9c-efd112a71092", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-47517680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00d040579ca46338e01b8110a0ebc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78547a5f-e1", "ovs_interfaceid": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:24:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-ca2948cb-40aa-4429-a28f-1a0eca4cb81e req-26dc1f2a-15b4-4aaf-8335-c684f79f3d53 service nova] Releasing lock "refresh_cache-412e1e40-082a-429e-9d35-013b72322761" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:24:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Acquiring lock "c9836958-96d4-4b3e-a45c-fbb97846dbd4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "c9836958-96d4-4b3e-a45c-fbb97846dbd4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:27 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:24:27 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:24:27 user nova-compute[75080]: DEBUG nova.compute.manager [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:24:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:27 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:24:27 user nova-compute[75080]: INFO nova.compute.claims [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Claim successful on node user
Dec 05 15:24:28 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:24:28 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:24:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.745s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:28 user nova-compute[75080]: DEBUG nova.compute.manager [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:24:28 user nova-compute[75080]: DEBUG nova.compute.manager [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:24:28 user nova-compute[75080]: DEBUG nova.network.neutron [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:24:28 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:24:28 user nova-compute[75080]: DEBUG nova.compute.manager [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:24:28 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:24:28 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:24:28 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:24:28 user nova-compute[75080]: DEBUG nova.policy [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f34ec988b5943aeb8d3b5ae512cb417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc899a7995f64588957e55ca0129c812', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:24:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-eedd1529-4feb-4f85-8625-0c20d8e0359d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:24:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-eedd1529-4feb-4f85-8625-0c20d8e0359d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:24:28 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 15:24:28 user nova-compute[75080]: DEBUG nova.compute.manager [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:24:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:24:28 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Creating image(s)
Dec 05 15:24:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "/opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "/opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.206s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.204s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG os_brick.utils [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk 1073741824" returned: 0 in 0.067s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[73352aa8-6642-4bf7-9095-35cdf4ae4b3a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b348a7-1bb1-403c-878b-84966ec86442]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3476b9-9f44-4642-9aed-aa4429563258]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e3e714-5214-489b-9a0d-89108a6e0a5d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:24:29 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:24:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[27781258-161f-413f-987f-23745b1b0de2]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG os_brick.utils [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] <== get_connector_properties: return (215ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Updating existing volume attachment record: 0af58309-4893-4417-b968-968fbe1d8af5 {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.214s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Updating instance_info_cache with network_info: [{"id": "f0094ba7-45c2-445b-bd35-d5c7aedd68bd", "address": "fa:16:3e:f9:84:93", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0094ba7-45", "ovs_interfaceid": "f0094ba7-45c2-445b-bd35-d5c7aedd68bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-eedd1529-4feb-4f85-8625-0c20d8e0359d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG nova.network.neutron [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Successfully created port: 317f5115-d5c4-4bdd-8c6c-3c5900d15626 {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Cannot resize image /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Ensure instance console log exists: /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG nova.network.neutron [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Successfully updated port: 317f5115-d5c4-4bdd-8c6c-3c5900d15626 {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Acquiring lock "refresh_cache-c9836958-96d4-4b3e-a45c-fbb97846dbd4" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Acquired lock "refresh_cache-c9836958-96d4-4b3e-a45c-fbb97846dbd4" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG nova.network.neutron [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG nova.compute.manager [req-42f92348-84e5-4c1f-a0c5-c3ac3124315a req-ffeb09ff-a84d-4824-a094-27b80cf16ae3 service nova] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Received event network-changed-317f5115-d5c4-4bdd-8c6c-3c5900d15626 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG nova.compute.manager [req-42f92348-84e5-4c1f-a0c5-c3ac3124315a req-ffeb09ff-a84d-4824-a094-27b80cf16ae3 service nova] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Refreshing instance network info cache due to event network-changed-317f5115-d5c4-4bdd-8c6c-3c5900d15626. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-42f92348-84e5-4c1f-a0c5-c3ac3124315a req-ffeb09ff-a84d-4824-a094-27b80cf16ae3 service nova] Acquiring lock "refresh_cache-c9836958-96d4-4b3e-a45c-fbb97846dbd4" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG nova.network.neutron [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG nova.network.neutron [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Updating instance_info_cache with network_info: [{"id": "317f5115-d5c4-4bdd-8c6c-3c5900d15626", "address": "fa:16:3e:22:7d:71", "network": {"id": "60895755-a5e0-4195-ace1-7627829ca044", "bridge": "br-int", "label": "tempest-TestStampPattern-2093692741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc899a7995f64588957e55ca0129c812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap317f5115-d5", "ovs_interfaceid": "317f5115-d5c4-4bdd-8c6c-3c5900d15626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Releasing lock "refresh_cache-c9836958-96d4-4b3e-a45c-fbb97846dbd4" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG nova.compute.manager [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Instance network_info: |[{"id": "317f5115-d5c4-4bdd-8c6c-3c5900d15626", "address": "fa:16:3e:22:7d:71", "network": {"id": "60895755-a5e0-4195-ace1-7627829ca044", "bridge": "br-int", "label": "tempest-TestStampPattern-2093692741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc899a7995f64588957e55ca0129c812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap317f5115-d5", "ovs_interfaceid": "317f5115-d5c4-4bdd-8c6c-3c5900d15626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-42f92348-84e5-4c1f-a0c5-c3ac3124315a req-ffeb09ff-a84d-4824-a094-27b80cf16ae3 service nova] Acquired lock "refresh_cache-c9836958-96d4-4b3e-a45c-fbb97846dbd4" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG nova.network.neutron [req-42f92348-84e5-4c1f-a0c5-c3ac3124315a req-ffeb09ff-a84d-4824-a094-27b80cf16ae3 service nova] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Refreshing network info cache for port 317f5115-d5c4-4bdd-8c6c-3c5900d15626 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Start _get_guest_xml network_info=[{"id": "317f5115-d5c4-4bdd-8c6c-3c5900d15626", "address": "fa:16:3e:22:7d:71", "network": {"id": "60895755-a5e0-4195-ace1-7627829ca044", "bridge": "br-int", "label": "tempest-TestStampPattern-2093692741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc899a7995f64588957e55ca0129c812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap317f5115-d5", "ovs_interfaceid": "317f5115-d5c4-4bdd-8c6c-3c5900d15626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:24:30 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:24:30 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:24:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:24:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1137844497',display_name='tempest-TestStampPattern-server-1137844497',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1137844497',id=22,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHAMA1CXZez7MdPSph5S9i392ZBdQjLqQOb8hqMfYY669vYgo8ML8BR0YzkdsvotEWD0HqSrUCtIg33ZSIHfujV9PM0Cii8jO16lDVcp4/zZGFDnycYQV610lx2OhuUeWQ==',key_name='tempest-TestStampPattern-113655159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc899a7995f64588957e55ca0129c812',ramdisk_id='',reservation_id='r-stxf1p7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1734509700',owner_user_name='tempest-TestStampPattern-1734509700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:24:28Z,user_data=None,user_id='3f34ec988b5943aeb8d3b5ae512cb417',uuid=c9836958-96d4-4b3e-a45c-fbb97846dbd4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "317f5115-d5c4-4bdd-8c6c-3c5900d15626", "address": "fa:16:3e:22:7d:71", "network": {"id": "60895755-a5e0-4195-ace1-7627829ca044", "bridge": "br-int", "label": "tempest-TestStampPattern-2093692741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc899a7995f64588957e55ca0129c812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap317f5115-d5", "ovs_interfaceid": "317f5115-d5c4-4bdd-8c6c-3c5900d15626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Converting VIF {"id": "317f5115-d5c4-4bdd-8c6c-3c5900d15626", "address": "fa:16:3e:22:7d:71", "network": {"id": "60895755-a5e0-4195-ace1-7627829ca044", "bridge": "br-int", "label": "tempest-TestStampPattern-2093692741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc899a7995f64588957e55ca0129c812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap317f5115-d5", "ovs_interfaceid": "317f5115-d5c4-4bdd-8c6c-3c5900d15626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:7d:71,bridge_name='br-int',has_traffic_filtering=True,id=317f5115-d5c4-4bdd-8c6c-3c5900d15626,network=Network(60895755-a5e0-4195-ace1-7627829ca044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap317f5115-d5') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG nova.objects.instance [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lazy-loading 'pci_devices' on Instance uuid c9836958-96d4-4b3e-a45c-fbb97846dbd4 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:24:30 user nova-compute[75080]:   <uuid>c9836958-96d4-4b3e-a45c-fbb97846dbd4</uuid>
Dec 05 15:24:30 user nova-compute[75080]:   <name>instance-00000016</name>
Dec 05 15:24:30 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:24:30 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:24:30 user nova-compute[75080]:   <metadata>
Dec 05 15:24:30 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:24:30 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:24:30 user nova-compute[75080]:       <nova:name>tempest-TestStampPattern-server-1137844497</nova:name>
Dec 05 15:24:30 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:24:30</nova:creationTime>
Dec 05 15:24:30 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:24:30 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:24:30 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:24:30 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:24:30 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:24:30 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:24:30 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:24:30 user nova-compute[75080]:       <nova:owner>
Dec 05 15:24:30 user nova-compute[75080]:         <nova:user uuid="3f34ec988b5943aeb8d3b5ae512cb417">tempest-TestStampPattern-1734509700-project-member</nova:user>
Dec 05 15:24:30 user nova-compute[75080]:         <nova:project uuid="bc899a7995f64588957e55ca0129c812">tempest-TestStampPattern-1734509700</nova:project>
Dec 05 15:24:30 user nova-compute[75080]:       </nova:owner>
Dec 05 15:24:30 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:24:30 user nova-compute[75080]:       <nova:ports>
Dec 05 15:24:30 user nova-compute[75080]:         <nova:port uuid="317f5115-d5c4-4bdd-8c6c-3c5900d15626">
Dec 05 15:24:30 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 05 15:24:30 user nova-compute[75080]:         </nova:port>
Dec 05 15:24:30 user nova-compute[75080]:       </nova:ports>
Dec 05 15:24:30 user nova-compute[75080]:     </nova:instance>
Dec 05 15:24:30 user nova-compute[75080]:   </metadata>
Dec 05 15:24:30 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:24:30 user nova-compute[75080]:     <system>
Dec 05 15:24:30 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:24:30 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:24:30 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:24:30 user nova-compute[75080]:       <entry name="serial">c9836958-96d4-4b3e-a45c-fbb97846dbd4</entry>
Dec 05 15:24:30 user nova-compute[75080]:       <entry name="uuid">c9836958-96d4-4b3e-a45c-fbb97846dbd4</entry>
Dec 05 15:24:30 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:24:30 user nova-compute[75080]:     </system>
Dec 05 15:24:30 user nova-compute[75080]:   </sysinfo>
Dec 05 15:24:30 user nova-compute[75080]:   <os>
Dec 05 15:24:30 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:24:30 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:24:30 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:24:30 user nova-compute[75080]:   </os>
Dec 05 15:24:30 user nova-compute[75080]:   <features>
Dec 05 15:24:30 user nova-compute[75080]:     <acpi/>
Dec 05 15:24:30 user nova-compute[75080]:     <apic/>
Dec 05 15:24:30 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:24:30 user nova-compute[75080]:   </features>
Dec 05 15:24:30 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:24:30 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:24:30 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:24:30 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:24:30 user nova-compute[75080]:   </clock>
Dec 05 15:24:30 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:24:30 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:24:30 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:24:30 user nova-compute[75080]:   </cpu>
Dec 05 15:24:30 user nova-compute[75080]:   <devices>
Dec 05 15:24:30 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:24:30 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:24:30 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk"/>
Dec 05 15:24:30 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:24:30 user nova-compute[75080]:     </disk>
Dec 05 15:24:30 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:24:30 user nova-compute[75080]:       <mac address="fa:16:3e:22:7d:71"/>
Dec 05 15:24:30 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:24:30 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:24:30 user nova-compute[75080]:       <target dev="tap317f5115-d5"/>
Dec 05 15:24:30 user nova-compute[75080]:     </interface>
Dec 05 15:24:30 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:24:30 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/console.log" append="off"/>
Dec 05 15:24:30 user nova-compute[75080]:     </serial>
Dec 05 15:24:30 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:24:30 user nova-compute[75080]:     <video>
Dec 05 15:24:30 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:24:30 user nova-compute[75080]:     </video>
Dec 05 15:24:30 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:24:30 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:24:30 user nova-compute[75080]:     </rng>
Dec 05 15:24:30 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:24:30 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:24:30 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:24:30 user nova-compute[75080]:     </memballoon>
Dec 05 15:24:30 user nova-compute[75080]:   </devices>
Dec 05 15:24:30 user nova-compute[75080]: </domain>
Dec 05 15:24:30 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:24:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1137844497',display_name='tempest-TestStampPattern-server-1137844497',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1137844497',id=22,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHAMA1CXZez7MdPSph5S9i392ZBdQjLqQOb8hqMfYY669vYgo8ML8BR0YzkdsvotEWD0HqSrUCtIg33ZSIHfujV9PM0Cii8jO16lDVcp4/zZGFDnycYQV610lx2OhuUeWQ==',key_name='tempest-TestStampPattern-113655159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc899a7995f64588957e55ca0129c812',ramdisk_id='',reservation_id='r-stxf1p7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1734509700',owner_user_name='tempest-TestStampPattern-1734509700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:24:28Z,user_data=None,user_id='3f34ec988b5943aeb8d3b5ae512cb417',uuid=c9836958-96d4-4b3e-a45c-fbb97846dbd4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "317f5115-d5c4-4bdd-8c6c-3c5900d15626", "address": "fa:16:3e:22:7d:71", "network": {"id": "60895755-a5e0-4195-ace1-7627829ca044", "bridge": "br-int", "label": "tempest-TestStampPattern-2093692741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc899a7995f64588957e55ca0129c812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap317f5115-d5", "ovs_interfaceid": "317f5115-d5c4-4bdd-8c6c-3c5900d15626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Converting VIF {"id": "317f5115-d5c4-4bdd-8c6c-3c5900d15626", "address": "fa:16:3e:22:7d:71", "network": {"id": "60895755-a5e0-4195-ace1-7627829ca044", "bridge": "br-int", "label": "tempest-TestStampPattern-2093692741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc899a7995f64588957e55ca0129c812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap317f5115-d5", "ovs_interfaceid": "317f5115-d5c4-4bdd-8c6c-3c5900d15626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:7d:71,bridge_name='br-int',has_traffic_filtering=True,id=317f5115-d5c4-4bdd-8c6c-3c5900d15626,network=Network(60895755-a5e0-4195-ace1-7627829ca044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap317f5115-d5') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG os_vif [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:7d:71,bridge_name='br-int',has_traffic_filtering=True,id=317f5115-d5c4-4bdd-8c6c-3c5900d15626,network=Network(60895755-a5e0-4195-ace1-7627829ca044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap317f5115-d5') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e8a7d905-1ecc-5362-a192-9ca7c127965b', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap317f5115-d5, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap317f5115-d5, col_values=(('qos', UUID('b4f59343-cb72-4047-a3d2-e585ba85603f')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap317f5115-d5, col_values=(('external_ids', {'iface-id': '317f5115-d5c4-4bdd-8c6c-3c5900d15626', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:7d:71', 'vm-uuid': 'c9836958-96d4-4b3e-a45c-fbb97846dbd4'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:30 user nova-compute[75080]: INFO os_vif [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:7d:71,bridge_name='br-int',has_traffic_filtering=True,id=317f5115-d5c4-4bdd-8c6c-3c5900d15626,network=Network(60895755-a5e0-4195-ace1-7627829ca044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap317f5115-d5')
Dec 05 15:24:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:24:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] No VIF found with MAC fa:16:3e:22:7d:71, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:24:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:31 user nova-compute[75080]: DEBUG nova.network.neutron [req-42f92348-84e5-4c1f-a0c5-c3ac3124315a req-ffeb09ff-a84d-4824-a094-27b80cf16ae3 service nova] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Updated VIF entry in instance network info cache for port 317f5115-d5c4-4bdd-8c6c-3c5900d15626. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:24:31 user nova-compute[75080]: DEBUG nova.network.neutron [req-42f92348-84e5-4c1f-a0c5-c3ac3124315a req-ffeb09ff-a84d-4824-a094-27b80cf16ae3 service nova] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Updating instance_info_cache with network_info: [{"id": "317f5115-d5c4-4bdd-8c6c-3c5900d15626", "address": "fa:16:3e:22:7d:71", "network": {"id": "60895755-a5e0-4195-ace1-7627829ca044", "bridge": "br-int", "label": "tempest-TestStampPattern-2093692741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc899a7995f64588957e55ca0129c812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap317f5115-d5", "ovs_interfaceid": "317f5115-d5c4-4bdd-8c6c-3c5900d15626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:24:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-42f92348-84e5-4c1f-a0c5-c3ac3124315a req-ffeb09ff-a84d-4824-a094-27b80cf16ae3 service nova] Releasing lock "refresh_cache-c9836958-96d4-4b3e-a45c-fbb97846dbd4" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:24:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:24:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:24:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:24:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:24:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:24:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:36 user nova-compute[75080]: DEBUG nova.compute.manager [req-a6fc37f7-a555-4417-81a4-42f437a6b2ad req-9a4c0afd-95ec-4ce8-8ac3-4eeed5b05e1a service nova] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Received event network-vif-plugged-317f5115-d5c4-4bdd-8c6c-3c5900d15626 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:24:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a6fc37f7-a555-4417-81a4-42f437a6b2ad req-9a4c0afd-95ec-4ce8-8ac3-4eeed5b05e1a service nova] Acquiring lock "c9836958-96d4-4b3e-a45c-fbb97846dbd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a6fc37f7-a555-4417-81a4-42f437a6b2ad req-9a4c0afd-95ec-4ce8-8ac3-4eeed5b05e1a service nova] Lock "c9836958-96d4-4b3e-a45c-fbb97846dbd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a6fc37f7-a555-4417-81a4-42f437a6b2ad req-9a4c0afd-95ec-4ce8-8ac3-4eeed5b05e1a service nova] Lock "c9836958-96d4-4b3e-a45c-fbb97846dbd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:36 user nova-compute[75080]: DEBUG nova.compute.manager [req-a6fc37f7-a555-4417-81a4-42f437a6b2ad req-9a4c0afd-95ec-4ce8-8ac3-4eeed5b05e1a service nova] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] No waiting events found dispatching network-vif-plugged-317f5115-d5c4-4bdd-8c6c-3c5900d15626 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:24:36 user nova-compute[75080]: WARNING nova.compute.manager [req-a6fc37f7-a555-4417-81a4-42f437a6b2ad req-9a4c0afd-95ec-4ce8-8ac3-4eeed5b05e1a service nova] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Received unexpected event network-vif-plugged-317f5115-d5c4-4bdd-8c6c-3c5900d15626 for instance with vm_state building and task_state spawning.
Dec 05 15:24:36 user nova-compute[75080]: DEBUG nova.compute.manager [req-74c613ca-2ab6-41c3-807f-7c4cbb9b0d7e req-43ee8cee-7d20-4573-9d31-4a9c3e664efb service nova] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Received event network-vif-plugged-317f5115-d5c4-4bdd-8c6c-3c5900d15626 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:24:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-74c613ca-2ab6-41c3-807f-7c4cbb9b0d7e req-43ee8cee-7d20-4573-9d31-4a9c3e664efb service nova] Acquiring lock "c9836958-96d4-4b3e-a45c-fbb97846dbd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-74c613ca-2ab6-41c3-807f-7c4cbb9b0d7e req-43ee8cee-7d20-4573-9d31-4a9c3e664efb service nova] Lock "c9836958-96d4-4b3e-a45c-fbb97846dbd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-74c613ca-2ab6-41c3-807f-7c4cbb9b0d7e req-43ee8cee-7d20-4573-9d31-4a9c3e664efb service nova] Lock "c9836958-96d4-4b3e-a45c-fbb97846dbd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:36 user nova-compute[75080]: DEBUG nova.compute.manager [req-74c613ca-2ab6-41c3-807f-7c4cbb9b0d7e req-43ee8cee-7d20-4573-9d31-4a9c3e664efb service nova] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] No waiting events found dispatching network-vif-plugged-317f5115-d5c4-4bdd-8c6c-3c5900d15626 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:24:36 user nova-compute[75080]: WARNING nova.compute.manager [req-74c613ca-2ab6-41c3-807f-7c4cbb9b0d7e req-43ee8cee-7d20-4573-9d31-4a9c3e664efb service nova] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Received unexpected event network-vif-plugged-317f5115-d5c4-4bdd-8c6c-3c5900d15626 for instance with vm_state building and task_state spawning.
Dec 05 15:24:36 user nova-compute[75080]: DEBUG nova.compute.manager [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:24:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:24:36 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:24:36 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:24:36 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=7741MB free_disk=25.463001251220703GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:24:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:36 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Instance spawned successfully.
Dec 05 15:24:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:24:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:24:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:24:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:24:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:24:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:24:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:24:36 user nova-compute[75080]: INFO nova.compute.manager [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Took 7.76 seconds to spawn the instance on the hypervisor.
Dec 05 15:24:36 user nova-compute[75080]: DEBUG nova.compute.manager [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:24:36 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance bd75375a-8b70-4bc2-a72b-14213ebaa4e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:24:36 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance eedd1529-4feb-4f85-8625-0c20d8e0359d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:24:36 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 5e29bda9-f1d6-4951-9343-f189934a8a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:24:36 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 607acee2-b585-43d2-a897-eca4983d62db actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:24:36 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 412e1e40-082a-429e-9d35-013b72322761 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:24:36 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 07b025ff-4a9d-48a2-b950-b8f2d165f33c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:24:36 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:24:36 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 6bf0a828-329b-46cf-aa76-bf6c24f08212 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:24:36 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance f425241c-0a1d-44fa-affc-9e40974b290d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:24:36 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance c9836958-96d4-4b3e-a45c-fbb97846dbd4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:24:36 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:24:36 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:24:36 user nova-compute[75080]: INFO nova.compute.manager [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Took 8.92 seconds to build instance.
Dec 05 15:24:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2ef9428e-473e-41dd-b72d-30c0a6854397 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "c9836958-96d4-4b3e-a45c-fbb97846dbd4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.056s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:36 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:24:36 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:24:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:36 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:24:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.728s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:37 user nova-compute[75080]: DEBUG nova.compute.manager [None req-f712d3bd-e5ba-44a9-9317-9db31a5e378a tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:24:37 user nova-compute[75080]: INFO nova.compute.manager [None req-f712d3bd-e5ba-44a9-9317-9db31a5e378a tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] instance snapshotting
Dec 05 15:24:37 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-f712d3bd-e5ba-44a9-9317-9db31a5e378a tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Beginning live snapshot process
Dec 05 15:24:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-f712d3bd-e5ba-44a9-9317-9db31a5e378a tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json -f qcow2 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-f712d3bd-e5ba-44a9-9317-9db31a5e378a tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-f712d3bd-e5ba-44a9-9317-9db31a5e378a tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json -f qcow2 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:37 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:24:37 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:24:37 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:24:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-f712d3bd-e5ba-44a9-9317-9db31a5e378a tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json -f qcow2" returned: 0 in 0.212s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-f712d3bd-e5ba-44a9-9317-9db31a5e378a tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-f712d3bd-e5ba-44a9-9317-9db31a5e378a tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.205s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-f712d3bd-e5ba-44a9-9317-9db31a5e378a tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwed2_rpb/ea2cac566c974e6f8b65c1f653fc0ce3.delta 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-f712d3bd-e5ba-44a9-9317-9db31a5e378a tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwed2_rpb/ea2cac566c974e6f8b65c1f653fc0ce3.delta 1073741824" returned: 0 in 0.217s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:38 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-f712d3bd-e5ba-44a9-9317-9db31a5e378a tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Quiescing instance not available: QEMU guest agent is not enabled.
Dec 05 15:24:39 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-f712d3bd-e5ba-44a9-9317-9db31a5e378a tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 15:24:40 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-f712d3bd-e5ba-44a9-9317-9db31a5e378a tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 15:24:40 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-f712d3bd-e5ba-44a9-9317-9db31a5e378a tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 05 15:24:40 user nova-compute[75080]: DEBUG nova.privsep.utils [None req-f712d3bd-e5ba-44a9-9317-9db31a5e378a tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75080) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 15:24:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-f712d3bd-e5ba-44a9-9317-9db31a5e378a tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwed2_rpb/ea2cac566c974e6f8b65c1f653fc0ce3.delta /opt/stack/data/nova/instances/snapshots/tmpwed2_rpb/ea2cac566c974e6f8b65c1f653fc0ce3 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-f712d3bd-e5ba-44a9-9317-9db31a5e378a tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwed2_rpb/ea2cac566c974e6f8b65c1f653fc0ce3.delta /opt/stack/data/nova/instances/snapshots/tmpwed2_rpb/ea2cac566c974e6f8b65c1f653fc0ce3" returned: 0 in 0.474s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:40 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-f712d3bd-e5ba-44a9-9317-9db31a5e378a tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Snapshot extracted, beginning image upload
Dec 05 15:24:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:44 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-f712d3bd-e5ba-44a9-9317-9db31a5e378a tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Snapshot image upload complete
Dec 05 15:24:44 user nova-compute[75080]: INFO nova.compute.manager [None req-f712d3bd-e5ba-44a9-9317-9db31a5e378a tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Took 6.94 seconds to snapshot the instance on the hypervisor.
Dec 05 15:24:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG nova.compute.manager [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:24:47 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Creating image(s)
Dec 05 15:24:47 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Did not create local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Ensure instance console log exists: /opt/stack/data/nova/instances/f425241c-0a1d-44fa-affc-9e40974b290d/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Start _get_guest_xml network_info=[{"id": "d41ca18b-b2d5-46dc-a5f4-410b315986b6", "address": "fa:16:3e:93:e2:a8", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd41ca18b-b2", "ovs_interfaceid": "d41ca18b-b2d5-46dc-a5f4-410b315986b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-12-05T15:24:14Z,direct_url=<?>,disk_format='qcow2',id=352419aa-7d60-4170-a438-57a2e09d45b4,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1343566503',owner='11227acd507347ae9c5a3bc710707f84',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-12-05T15:24:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xpYNQakn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f425241c-0a1d-44fa-affc-9e40974b290d', 'attached_at': '', 'detached_at': '', 'volume_id': '0fa65be6-f658-43ad-9151-f2a5d3c9f4cc', 'serial': '0fa65be6-f658-43ad-9151-f2a5d3c9f4cc'}, 'device_type': 'disk', 'attachment_id': '0af58309-4893-4417-b968-968fbe1d8af5', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:24:47 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:24:47 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:24:47 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-12-05T15:24:14Z,direct_url=<?>,disk_format='qcow2',id=352419aa-7d60-4170-a438-57a2e09d45b4,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1343566503',owner='11227acd507347ae9c5a3bc710707f84',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-12-05T15:24:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xpYNQakn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:24:47 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:24:47 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:24:47 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:24:47 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:24:47 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:24:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc -p 172.16.0.220:3260" returned: 21 in 0.035s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bae3780-ba9b-4ccb-9859-2b67fae07885]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:24:47 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f351c57b-ec71-4cd2-a8e9-77e7e3d64d83]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc] added
Dec 05 15:24:47 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b316fd7-1af6-4c25-a6c4-575aea3644e8]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c9ec5a-b251-496e-80b5-fcc402bcdd7b]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xpYNQakn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xpYNQakn" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bc0814-4620-4239-a4bd-e4d928b88dbd]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xpYNQakn'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[582bf34e-c842-4bea-bbe0-bd438e552f57]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c1a5e1-0c8a-4c0d-a182-4b88e6f84ef9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bed23e-0ad5-4ef4-b7df-ba7794daa550 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:24:47 user nova-compute[75080]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb (non-flash)
Dec 05 15:24:47 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:24:47 user nova-compute[75080]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 (non-flash)
Dec 05 15:24:47 user nova-compute[75080]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c (non-flash)
Dec 05 15:24:47 user nova-compute[75080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bed23e-0ad5-4ef4-b7df-ba7794daa550 (non-flash)
Dec 05 15:24:47 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:24:47 user nova-compute[75080]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb (non-flash)
Dec 05 15:24:47 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:24:47 user nova-compute[75080]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 (non-flash)
Dec 05 15:24:47 user nova-compute[75080]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c (non-flash)
Dec 05 15:24:47 user nova-compute[75080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bed23e-0ad5-4ef4-b7df-ba7794daa550 (non-flash)
Dec 05 15:24:47 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e8a294-89f0-43e5-a6cc-445eb8bff05d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc, portal: 172.16.0.220,3260]
Dec 05 15:24:47 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc, portal: 172.16.0.220,3260] successful.
Dec 05 15:24:47 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c8ed43-7513-4e36-a648-f4ad8958d117]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2cf254-bebd-4774-a1d9-8041aea6fe27]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bed23e-0ad5-4ef4-b7df-ba7794daa550 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:24:47 user nova-compute[75080]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb (non-flash)
Dec 05 15:24:47 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:24:47 user nova-compute[75080]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 (non-flash)
Dec 05 15:24:47 user nova-compute[75080]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c (non-flash)
Dec 05 15:24:47 user nova-compute[75080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bed23e-0ad5-4ef4-b7df-ba7794daa550 (non-flash)
Dec 05 15:24:47 user nova-compute[75080]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc (non-flash)
Dec 05 15:24:47 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:24:47 user nova-compute[75080]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb (non-flash)
Dec 05 15:24:47 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:24:47 user nova-compute[75080]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 (non-flash)
Dec 05 15:24:47 user nova-compute[75080]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c (non-flash)
Dec 05 15:24:47 user nova-compute[75080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bed23e-0ad5-4ef4-b7df-ba7794daa550 (non-flash)
Dec 05 15:24:47 user nova-compute[75080]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc (non-flash)
Dec 05 15:24:47 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.402s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] HCTL ('39', '-', '-', 0) found on session 23 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80247fc-6de0-4977-b98e-d01c274cdcf9]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:24:47 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Searching for a device in session 23 and hctl ['39', '*', '*', 0] yield: None {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:24:48 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Searching for a device in session 23 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:24:48 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xpYNQakn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:24:48 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.431s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:24:48 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] <== connect_volume: return (1432ms) {'type': 'block', 'scsi_wwn': '23334653964313035', 'path': '/dev/sdh'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:24:48 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334653964313035', 'path': '/dev/sdh'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:24:48 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1738099649',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1738099649',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1738099649',id=21,image_ref='352419aa-7d60-4170-a438-57a2e09d45b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnnw3KdRZ1MpnVTdLA8PBdGCfDAg1hrSWPfsT0IWonkzIk1pszJEFKRdG6nOkzBtQenW85XFPRQTo69mVQBspktwmS0jXWSKCAdT6NmqrmqjQ8OIB6SQgJ0h/pb3JJP+w==',key_name='tempest-keypair-430281623',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11227acd507347ae9c5a3bc710707f84',ramdisk_id='',reservation_id='r-kgsdlqix',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-23416231',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-23416231-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-23416231',owner_user_name='tempest-TestVolumeBootPattern-23416231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:24:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15be5b54cc8346bb86683e4ed2fbba9e',uuid=f425241c-0a1d-44fa-affc-9e40974b290d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d41ca18b-b2d5-46dc-a5f4-410b315986b6", "address": "fa:16:3e:93:e2:a8", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd41ca18b-b2", "ovs_interfaceid": "d41ca18b-b2d5-46dc-a5f4-410b315986b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:24:48 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Converting VIF {"id": "d41ca18b-b2d5-46dc-a5f4-410b315986b6", "address": "fa:16:3e:93:e2:a8", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd41ca18b-b2", "ovs_interfaceid": "d41ca18b-b2d5-46dc-a5f4-410b315986b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:24:48 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:e2:a8,bridge_name='br-int',has_traffic_filtering=True,id=d41ca18b-b2d5-46dc-a5f4-410b315986b6,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd41ca18b-b2') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:24:48 user nova-compute[75080]: DEBUG nova.objects.instance [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lazy-loading 'pci_devices' on Instance uuid f425241c-0a1d-44fa-affc-9e40974b290d {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:24:48 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:24:48 user nova-compute[75080]:   <uuid>f425241c-0a1d-44fa-affc-9e40974b290d</uuid>
Dec 05 15:24:48 user nova-compute[75080]:   <name>instance-00000015</name>
Dec 05 15:24:48 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:24:48 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:24:48 user nova-compute[75080]:   <metadata>
Dec 05 15:24:48 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:24:48 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:24:48 user nova-compute[75080]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1738099649</nova:name>
Dec 05 15:24:48 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:24:47</nova:creationTime>
Dec 05 15:24:48 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:24:48 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:24:48 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:24:48 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:24:48 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:24:48 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:24:48 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:24:48 user nova-compute[75080]:       <nova:owner>
Dec 05 15:24:48 user nova-compute[75080]:         <nova:user uuid="15be5b54cc8346bb86683e4ed2fbba9e">tempest-TestVolumeBootPattern-23416231-project-member</nova:user>
Dec 05 15:24:48 user nova-compute[75080]:         <nova:project uuid="11227acd507347ae9c5a3bc710707f84">tempest-TestVolumeBootPattern-23416231</nova:project>
Dec 05 15:24:48 user nova-compute[75080]:       </nova:owner>
Dec 05 15:24:48 user nova-compute[75080]:       <nova:root type="image" uuid="352419aa-7d60-4170-a438-57a2e09d45b4"/>
Dec 05 15:24:48 user nova-compute[75080]:       <nova:ports>
Dec 05 15:24:48 user nova-compute[75080]:         <nova:port uuid="d41ca18b-b2d5-46dc-a5f4-410b315986b6">
Dec 05 15:24:48 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 05 15:24:48 user nova-compute[75080]:         </nova:port>
Dec 05 15:24:48 user nova-compute[75080]:       </nova:ports>
Dec 05 15:24:48 user nova-compute[75080]:     </nova:instance>
Dec 05 15:24:48 user nova-compute[75080]:   </metadata>
Dec 05 15:24:48 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:24:48 user nova-compute[75080]:     <system>
Dec 05 15:24:48 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:24:48 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:24:48 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:24:48 user nova-compute[75080]:       <entry name="serial">f425241c-0a1d-44fa-affc-9e40974b290d</entry>
Dec 05 15:24:48 user nova-compute[75080]:       <entry name="uuid">f425241c-0a1d-44fa-affc-9e40974b290d</entry>
Dec 05 15:24:48 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:24:48 user nova-compute[75080]:     </system>
Dec 05 15:24:48 user nova-compute[75080]:   </sysinfo>
Dec 05 15:24:48 user nova-compute[75080]:   <os>
Dec 05 15:24:48 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:24:48 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:24:48 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:24:48 user nova-compute[75080]:   </os>
Dec 05 15:24:48 user nova-compute[75080]:   <features>
Dec 05 15:24:48 user nova-compute[75080]:     <acpi/>
Dec 05 15:24:48 user nova-compute[75080]:     <apic/>
Dec 05 15:24:48 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:24:48 user nova-compute[75080]:   </features>
Dec 05 15:24:48 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:24:48 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:24:48 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:24:48 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:24:48 user nova-compute[75080]:   </clock>
Dec 05 15:24:48 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:24:48 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:24:48 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:24:48 user nova-compute[75080]:   </cpu>
Dec 05 15:24:48 user nova-compute[75080]:   <devices>
Dec 05 15:24:48 user nova-compute[75080]:     <disk type="block" device="disk">
Dec 05 15:24:48 user nova-compute[75080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:24:48 user nova-compute[75080]:       <source dev="/dev/sdh"/>
Dec 05 15:24:48 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:24:48 user nova-compute[75080]:       <serial>0fa65be6-f658-43ad-9151-f2a5d3c9f4cc</serial>
Dec 05 15:24:48 user nova-compute[75080]:     </disk>
Dec 05 15:24:48 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:24:48 user nova-compute[75080]:       <mac address="fa:16:3e:93:e2:a8"/>
Dec 05 15:24:48 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:24:48 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:24:48 user nova-compute[75080]:       <target dev="tapd41ca18b-b2"/>
Dec 05 15:24:48 user nova-compute[75080]:     </interface>
Dec 05 15:24:48 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:24:48 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/f425241c-0a1d-44fa-affc-9e40974b290d/console.log" append="off"/>
Dec 05 15:24:48 user nova-compute[75080]:     </serial>
Dec 05 15:24:48 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:24:48 user nova-compute[75080]:     <video>
Dec 05 15:24:48 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:24:48 user nova-compute[75080]:     </video>
Dec 05 15:24:48 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:24:48 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:24:48 user nova-compute[75080]:     </rng>
Dec 05 15:24:48 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:24:48 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:24:48 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:24:48 user nova-compute[75080]:     </memballoon>
Dec 05 15:24:48 user nova-compute[75080]:   </devices>
Dec 05 15:24:48 user nova-compute[75080]: </domain>
Dec 05 15:24:48 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:24:48 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1738099649',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1738099649',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1738099649',id=21,image_ref='352419aa-7d60-4170-a438-57a2e09d45b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnnw3KdRZ1MpnVTdLA8PBdGCfDAg1hrSWPfsT0IWonkzIk1pszJEFKRdG6nOkzBtQenW85XFPRQTo69mVQBspktwmS0jXWSKCAdT6NmqrmqjQ8OIB6SQgJ0h/pb3JJP+w==',key_name='tempest-keypair-430281623',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11227acd507347ae9c5a3bc710707f84',ramdisk_id='',reservation_id='r-kgsdlqix',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-23416231',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-23416231-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-23416231',owner_user_name='tempest-TestVolumeBootPattern-23416231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:24:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15be5b54cc8346bb86683e4ed2fbba9e',uuid=f425241c-0a1d-44fa-affc-9e40974b290d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d41ca18b-b2d5-46dc-a5f4-410b315986b6", "address": "fa:16:3e:93:e2:a8", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd41ca18b-b2", "ovs_interfaceid": "d41ca18b-b2d5-46dc-a5f4-410b315986b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:24:48 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Converting VIF {"id": "d41ca18b-b2d5-46dc-a5f4-410b315986b6", "address": "fa:16:3e:93:e2:a8", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd41ca18b-b2", "ovs_interfaceid": "d41ca18b-b2d5-46dc-a5f4-410b315986b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:24:48 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:e2:a8,bridge_name='br-int',has_traffic_filtering=True,id=d41ca18b-b2d5-46dc-a5f4-410b315986b6,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd41ca18b-b2') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:24:48 user nova-compute[75080]: DEBUG os_vif [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:e2:a8,bridge_name='br-int',has_traffic_filtering=True,id=d41ca18b-b2d5-46dc-a5f4-410b315986b6,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd41ca18b-b2') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:24:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:24:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9d4ffb10-944c-5bba-826c-261f44427f34', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:24:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd41ca18b-b2, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd41ca18b-b2, col_values=(('qos', UUID('8449af0e-a4b2-43fb-9cab-7e6f049ac661')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd41ca18b-b2, col_values=(('external_ids', {'iface-id': 'd41ca18b-b2d5-46dc-a5f4-410b315986b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:e2:a8', 'vm-uuid': 'f425241c-0a1d-44fa-affc-9e40974b290d'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:24:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:24:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:48 user nova-compute[75080]: INFO os_vif [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:e2:a8,bridge_name='br-int',has_traffic_filtering=True,id=d41ca18b-b2d5-46dc-a5f4-410b315986b6,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd41ca18b-b2')
Dec 05 15:24:48 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:24:48 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] No VIF found with MAC fa:16:3e:93:e2:a8, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:24:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:50 user nova-compute[75080]: DEBUG nova.compute.manager [req-c2ea7d38-c4b1-4a7e-8553-b1b71ffa3cb2 req-d74a332f-edba-4481-aeab-d538a731d067 service nova] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Received event network-vif-plugged-d41ca18b-b2d5-46dc-a5f4-410b315986b6 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:24:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c2ea7d38-c4b1-4a7e-8553-b1b71ffa3cb2 req-d74a332f-edba-4481-aeab-d538a731d067 service nova] Acquiring lock "f425241c-0a1d-44fa-affc-9e40974b290d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c2ea7d38-c4b1-4a7e-8553-b1b71ffa3cb2 req-d74a332f-edba-4481-aeab-d538a731d067 service nova] Lock "f425241c-0a1d-44fa-affc-9e40974b290d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c2ea7d38-c4b1-4a7e-8553-b1b71ffa3cb2 req-d74a332f-edba-4481-aeab-d538a731d067 service nova] Lock "f425241c-0a1d-44fa-affc-9e40974b290d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:50 user nova-compute[75080]: DEBUG nova.compute.manager [req-c2ea7d38-c4b1-4a7e-8553-b1b71ffa3cb2 req-d74a332f-edba-4481-aeab-d538a731d067 service nova] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] No waiting events found dispatching network-vif-plugged-d41ca18b-b2d5-46dc-a5f4-410b315986b6 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:24:50 user nova-compute[75080]: WARNING nova.compute.manager [req-c2ea7d38-c4b1-4a7e-8553-b1b71ffa3cb2 req-d74a332f-edba-4481-aeab-d538a731d067 service nova] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Received unexpected event network-vif-plugged-d41ca18b-b2d5-46dc-a5f4-410b315986b6 for instance with vm_state building and task_state spawning.
Dec 05 15:24:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:52 user nova-compute[75080]: DEBUG nova.compute.manager [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:24:52 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:24:52 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Instance spawned successfully.
Dec 05 15:24:52 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:24:52 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:24:52 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:24:52 user nova-compute[75080]: INFO nova.compute.manager [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Took 5.29 seconds to spawn the instance on the hypervisor.
Dec 05 15:24:52 user nova-compute[75080]: DEBUG nova.compute.manager [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:24:52 user nova-compute[75080]: INFO nova.compute.manager [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Took 30.24 seconds to build instance.
Dec 05 15:24:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-67d0908c-3922-41c9-8064-4cc0f9397277 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "f425241c-0a1d-44fa-affc-9e40974b290d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.401s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "f425241c-0a1d-44fa-affc-9e40974b290d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 29.913s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "f425241c-0a1d-44fa-affc-9e40974b290d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:52 user nova-compute[75080]: DEBUG nova.compute.manager [req-291d245f-014b-4196-9480-ba0f3e675c9b req-5832d101-d259-44b4-a2bf-c6526d2694d9 service nova] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Received event network-vif-plugged-d41ca18b-b2d5-46dc-a5f4-410b315986b6 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:24:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-291d245f-014b-4196-9480-ba0f3e675c9b req-5832d101-d259-44b4-a2bf-c6526d2694d9 service nova] Acquiring lock "f425241c-0a1d-44fa-affc-9e40974b290d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:24:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-291d245f-014b-4196-9480-ba0f3e675c9b req-5832d101-d259-44b4-a2bf-c6526d2694d9 service nova] Lock "f425241c-0a1d-44fa-affc-9e40974b290d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:24:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-291d245f-014b-4196-9480-ba0f3e675c9b req-5832d101-d259-44b4-a2bf-c6526d2694d9 service nova] Lock "f425241c-0a1d-44fa-affc-9e40974b290d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:24:52 user nova-compute[75080]: DEBUG nova.compute.manager [req-291d245f-014b-4196-9480-ba0f3e675c9b req-5832d101-d259-44b4-a2bf-c6526d2694d9 service nova] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] No waiting events found dispatching network-vif-plugged-d41ca18b-b2d5-46dc-a5f4-410b315986b6 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:24:52 user nova-compute[75080]: WARNING nova.compute.manager [req-291d245f-014b-4196-9480-ba0f3e675c9b req-5832d101-d259-44b4-a2bf-c6526d2694d9 service nova] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Received unexpected event network-vif-plugged-d41ca18b-b2d5-46dc-a5f4-410b315986b6 for instance with vm_state active and task_state None.
Dec 05 15:24:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:24:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:01 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:06 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:11 user nova-compute[75080]: DEBUG nova.compute.manager [req-fd98dd4a-9a9f-4727-b57c-00d69e516719 req-0fc99e79-a647-4a4c-936d-224f3084665c service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Received event network-changed-6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:25:11 user nova-compute[75080]: DEBUG nova.compute.manager [req-fd98dd4a-9a9f-4727-b57c-00d69e516719 req-0fc99e79-a647-4a4c-936d-224f3084665c service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Refreshing instance network info cache due to event network-changed-6b187ba9-e311-4d40-8aa9-8f00feb45d88. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:25:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-fd98dd4a-9a9f-4727-b57c-00d69e516719 req-0fc99e79-a647-4a4c-936d-224f3084665c service nova] Acquiring lock "refresh_cache-60b8e21f-5fbd-4bc5-95ad-8d743ec796f7" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:25:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-fd98dd4a-9a9f-4727-b57c-00d69e516719 req-0fc99e79-a647-4a4c-936d-224f3084665c service nova] Acquired lock "refresh_cache-60b8e21f-5fbd-4bc5-95ad-8d743ec796f7" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:25:11 user nova-compute[75080]: DEBUG nova.network.neutron [req-fd98dd4a-9a9f-4727-b57c-00d69e516719 req-0fc99e79-a647-4a4c-936d-224f3084665c service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Refreshing network info cache for port 6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:25:11 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:12 user nova-compute[75080]: DEBUG nova.network.neutron [req-fd98dd4a-9a9f-4727-b57c-00d69e516719 req-0fc99e79-a647-4a4c-936d-224f3084665c service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Updated VIF entry in instance network info cache for port 6b187ba9-e311-4d40-8aa9-8f00feb45d88. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:25:12 user nova-compute[75080]: DEBUG nova.network.neutron [req-fd98dd4a-9a9f-4727-b57c-00d69e516719 req-0fc99e79-a647-4a4c-936d-224f3084665c service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Updating instance_info_cache with network_info: [{"id": "6b187ba9-e311-4d40-8aa9-8f00feb45d88", "address": "fa:16:3e:3b:1f:ec", "network": {"id": "98270770-6a03-4b54-9160-a049184a508d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1275663774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecf8f0b6db8b4faeb2c3f5b580e05600", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b187ba9-e3", "ovs_interfaceid": "6b187ba9-e311-4d40-8aa9-8f00feb45d88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:25:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-fd98dd4a-9a9f-4727-b57c-00d69e516719 req-0fc99e79-a647-4a4c-936d-224f3084665c service nova] Releasing lock "refresh_cache-60b8e21f-5fbd-4bc5-95ad-8d743ec796f7" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:25:12 user nova-compute[75080]: DEBUG nova.compute.manager [None req-f8f21ba6-d559-40ac-ac95-5a87edc1dde5 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:25:12 user nova-compute[75080]: INFO nova.compute.manager [None req-f8f21ba6-d559-40ac-ac95-5a87edc1dde5 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] instance snapshotting
Dec 05 15:25:12 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-f8f21ba6-d559-40ac-ac95-5a87edc1dde5 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Beginning live snapshot process
Dec 05 15:25:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-f8f21ba6-d559-40ac-ac95-5a87edc1dde5 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk --force-share --output=json -f qcow2 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:25:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-f8f21ba6-d559-40ac-ac95-5a87edc1dde5 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk --force-share --output=json -f qcow2" returned: 0 in 0.218s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:25:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-f8f21ba6-d559-40ac-ac95-5a87edc1dde5 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk --force-share --output=json -f qcow2 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:25:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-f8f21ba6-d559-40ac-ac95-5a87edc1dde5 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk --force-share --output=json -f qcow2" returned: 0 in 0.209s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:25:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-f8f21ba6-d559-40ac-ac95-5a87edc1dde5 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:25:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-f8f21ba6-d559-40ac-ac95-5a87edc1dde5 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.199s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:25:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-f8f21ba6-d559-40ac-ac95-5a87edc1dde5 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjjwz5igs/d3746d09fac14d1d84c1c301d1b658d0.delta 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:25:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-f8f21ba6-d559-40ac-ac95-5a87edc1dde5 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjjwz5igs/d3746d09fac14d1d84c1c301d1b658d0.delta 1073741824" returned: 0 in 0.049s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:25:13 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-f8f21ba6-d559-40ac-ac95-5a87edc1dde5 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Quiescing instance not available: QEMU guest agent is not enabled.
Dec 05 15:25:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:14 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-f8f21ba6-d559-40ac-ac95-5a87edc1dde5 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 15:25:14 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-f8f21ba6-d559-40ac-ac95-5a87edc1dde5 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 15:25:14 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-f8f21ba6-d559-40ac-ac95-5a87edc1dde5 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 05 15:25:14 user nova-compute[75080]: DEBUG nova.privsep.utils [None req-f8f21ba6-d559-40ac-ac95-5a87edc1dde5 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75080) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 15:25:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-f8f21ba6-d559-40ac-ac95-5a87edc1dde5 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjjwz5igs/d3746d09fac14d1d84c1c301d1b658d0.delta /opt/stack/data/nova/instances/snapshots/tmpjjwz5igs/d3746d09fac14d1d84c1c301d1b658d0 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:25:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-f8f21ba6-d559-40ac-ac95-5a87edc1dde5 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjjwz5igs/d3746d09fac14d1d84c1c301d1b658d0.delta /opt/stack/data/nova/instances/snapshots/tmpjjwz5igs/d3746d09fac14d1d84c1c301d1b658d0" returned: 0 in 0.370s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:25:15 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-f8f21ba6-d559-40ac-ac95-5a87edc1dde5 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Snapshot extracted, beginning image upload
Dec 05 15:25:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Acquiring lock "845ee1b9-b8d5-4ac2-a8e2-792c037934b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:25:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Lock "845ee1b9-b8d5-4ac2-a8e2-792c037934b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:25:15 user nova-compute[75080]: DEBUG nova.compute.manager [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:25:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:25:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:25:15 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:25:15 user nova-compute[75080]: INFO nova.compute.claims [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Claim successful on node user
Dec 05 15:25:16 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:25:16 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:25:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.511s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:25:16 user nova-compute[75080]: DEBUG nova.compute.manager [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:25:16 user nova-compute[75080]: DEBUG nova.compute.manager [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:25:16 user nova-compute[75080]: DEBUG nova.network.neutron [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:25:16 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:25:16 user nova-compute[75080]: DEBUG nova.compute.manager [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:25:16 user nova-compute[75080]: DEBUG nova.policy [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b29543e5a2d45e08cc6d09b61c9ae0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92d54e289b4749a13e57eade22a8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:25:16 user nova-compute[75080]: DEBUG nova.compute.manager [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:25:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:25:16 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Creating image(s)
Dec 05 15:25:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Acquiring lock "/opt/stack/data/nova/instances/845ee1b9-b8d5-4ac2-a8e2-792c037934b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:25:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Lock "/opt/stack/data/nova/instances/845ee1b9-b8d5-4ac2-a8e2-792c037934b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:25:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Lock "/opt/stack/data/nova/instances/845ee1b9-b8d5-4ac2-a8e2-792c037934b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.030s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:25:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:25:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.186s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:25:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:25:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:25:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:25:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:17 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.219s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:25:17 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/845ee1b9-b8d5-4ac2-a8e2-792c037934b0/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:25:17 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/845ee1b9-b8d5-4ac2-a8e2-792c037934b0/disk 1073741824" returned: 0 in 0.058s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:25:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:25:17 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:25:17 user nova-compute[75080]: DEBUG nova.network.neutron [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Successfully created port: f70f0dca-a0a5-4b2f-b6ef-84422347dd49 {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:25:17 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.247s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:25:17 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Checking if we can resize image /opt/stack/data/nova/instances/845ee1b9-b8d5-4ac2-a8e2-792c037934b0/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 15:25:17 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/845ee1b9-b8d5-4ac2-a8e2-792c037934b0/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:25:17 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/845ee1b9-b8d5-4ac2-a8e2-792c037934b0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:25:17 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Cannot resize image /opt/stack/data/nova/instances/845ee1b9-b8d5-4ac2-a8e2-792c037934b0/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 15:25:17 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:25:17 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Ensure instance console log exists: /opt/stack/data/nova/instances/845ee1b9-b8d5-4ac2-a8e2-792c037934b0/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:25:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:25:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:25:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:25:17 user nova-compute[75080]: DEBUG nova.network.neutron [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Successfully updated port: f70f0dca-a0a5-4b2f-b6ef-84422347dd49 {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:25:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Acquiring lock "refresh_cache-845ee1b9-b8d5-4ac2-a8e2-792c037934b0" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:25:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Acquired lock "refresh_cache-845ee1b9-b8d5-4ac2-a8e2-792c037934b0" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:25:17 user nova-compute[75080]: DEBUG nova.network.neutron [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:25:17 user nova-compute[75080]: DEBUG nova.compute.manager [req-25cfe310-930d-49a7-bfa8-7c3370be355e req-feb6a90b-f005-4e24-bc54-501a6022f6f8 service nova] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Received event network-changed-f70f0dca-a0a5-4b2f-b6ef-84422347dd49 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:25:17 user nova-compute[75080]: DEBUG nova.compute.manager [req-25cfe310-930d-49a7-bfa8-7c3370be355e req-feb6a90b-f005-4e24-bc54-501a6022f6f8 service nova] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Refreshing instance network info cache due to event network-changed-f70f0dca-a0a5-4b2f-b6ef-84422347dd49. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:25:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-25cfe310-930d-49a7-bfa8-7c3370be355e req-feb6a90b-f005-4e24-bc54-501a6022f6f8 service nova] Acquiring lock "refresh_cache-845ee1b9-b8d5-4ac2-a8e2-792c037934b0" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:25:17 user nova-compute[75080]: DEBUG nova.network.neutron [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG nova.network.neutron [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Updating instance_info_cache with network_info: [{"id": "f70f0dca-a0a5-4b2f-b6ef-84422347dd49", "address": "fa:16:3e:83:3c:76", "network": {"id": "d4c7d48a-4f32-41d6-a1d8-d0c6b0df3c3f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-699668764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab92d54e289b4749a13e57eade22a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf70f0dca-a0", "ovs_interfaceid": "f70f0dca-a0a5-4b2f-b6ef-84422347dd49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Releasing lock "refresh_cache-845ee1b9-b8d5-4ac2-a8e2-792c037934b0" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG nova.compute.manager [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Instance network_info: |[{"id": "f70f0dca-a0a5-4b2f-b6ef-84422347dd49", "address": "fa:16:3e:83:3c:76", "network": {"id": "d4c7d48a-4f32-41d6-a1d8-d0c6b0df3c3f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-699668764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab92d54e289b4749a13e57eade22a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf70f0dca-a0", "ovs_interfaceid": "f70f0dca-a0a5-4b2f-b6ef-84422347dd49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-25cfe310-930d-49a7-bfa8-7c3370be355e req-feb6a90b-f005-4e24-bc54-501a6022f6f8 service nova] Acquired lock "refresh_cache-845ee1b9-b8d5-4ac2-a8e2-792c037934b0" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG nova.network.neutron [req-25cfe310-930d-49a7-bfa8-7c3370be355e req-feb6a90b-f005-4e24-bc54-501a6022f6f8 service nova] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Refreshing network info cache for port f70f0dca-a0a5-4b2f-b6ef-84422347dd49 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Start _get_guest_xml network_info=[{"id": "f70f0dca-a0a5-4b2f-b6ef-84422347dd49", "address": "fa:16:3e:83:3c:76", "network": {"id": "d4c7d48a-4f32-41d6-a1d8-d0c6b0df3c3f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-699668764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab92d54e289b4749a13e57eade22a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf70f0dca-a0", "ovs_interfaceid": "f70f0dca-a0a5-4b2f-b6ef-84422347dd49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:25:18 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:25:18 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:25:18 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:25:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1993513088',display_name='tempest-DeleteServersTestJSON-server-1993513088',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1993513088',id=23,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab92d54e289b4749a13e57eade22a8db',ramdisk_id='',reservation_id='r-mq6l6fpr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1556760987',owner_user_name='tempest-DeleteServersTestJSON-1556760987-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:25:17Z,user_data=None,user_id='6b29543e5a2d45e08cc6d09b61c9ae0c',uuid=845ee1b9-b8d5-4ac2-a8e2-792c037934b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f70f0dca-a0a5-4b2f-b6ef-84422347dd49", "address": "fa:16:3e:83:3c:76", "network": {"id": "d4c7d48a-4f32-41d6-a1d8-d0c6b0df3c3f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-699668764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab92d54e289b4749a13e57eade22a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf70f0dca-a0", "ovs_interfaceid": "f70f0dca-a0a5-4b2f-b6ef-84422347dd49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Converting VIF {"id": "f70f0dca-a0a5-4b2f-b6ef-84422347dd49", "address": "fa:16:3e:83:3c:76", "network": {"id": "d4c7d48a-4f32-41d6-a1d8-d0c6b0df3c3f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-699668764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab92d54e289b4749a13e57eade22a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf70f0dca-a0", "ovs_interfaceid": "f70f0dca-a0a5-4b2f-b6ef-84422347dd49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:3c:76,bridge_name='br-int',has_traffic_filtering=True,id=f70f0dca-a0a5-4b2f-b6ef-84422347dd49,network=Network(d4c7d48a-4f32-41d6-a1d8-d0c6b0df3c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf70f0dca-a0') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG nova.objects.instance [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Lazy-loading 'pci_devices' on Instance uuid 845ee1b9-b8d5-4ac2-a8e2-792c037934b0 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:25:18 user nova-compute[75080]:   <uuid>845ee1b9-b8d5-4ac2-a8e2-792c037934b0</uuid>
Dec 05 15:25:18 user nova-compute[75080]:   <name>instance-00000017</name>
Dec 05 15:25:18 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:25:18 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:25:18 user nova-compute[75080]:   <metadata>
Dec 05 15:25:18 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:25:18 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:25:18 user nova-compute[75080]:       <nova:name>tempest-DeleteServersTestJSON-server-1993513088</nova:name>
Dec 05 15:25:18 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:25:18</nova:creationTime>
Dec 05 15:25:18 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:25:18 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:25:18 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:25:18 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:25:18 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:25:18 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:25:18 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:25:18 user nova-compute[75080]:       <nova:owner>
Dec 05 15:25:18 user nova-compute[75080]:         <nova:user uuid="6b29543e5a2d45e08cc6d09b61c9ae0c">tempest-DeleteServersTestJSON-1556760987-project-member</nova:user>
Dec 05 15:25:18 user nova-compute[75080]:         <nova:project uuid="ab92d54e289b4749a13e57eade22a8db">tempest-DeleteServersTestJSON-1556760987</nova:project>
Dec 05 15:25:18 user nova-compute[75080]:       </nova:owner>
Dec 05 15:25:18 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:25:18 user nova-compute[75080]:       <nova:ports>
Dec 05 15:25:18 user nova-compute[75080]:         <nova:port uuid="f70f0dca-a0a5-4b2f-b6ef-84422347dd49">
Dec 05 15:25:18 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 05 15:25:18 user nova-compute[75080]:         </nova:port>
Dec 05 15:25:18 user nova-compute[75080]:       </nova:ports>
Dec 05 15:25:18 user nova-compute[75080]:     </nova:instance>
Dec 05 15:25:18 user nova-compute[75080]:   </metadata>
Dec 05 15:25:18 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:25:18 user nova-compute[75080]:     <system>
Dec 05 15:25:18 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:25:18 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:25:18 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:25:18 user nova-compute[75080]:       <entry name="serial">845ee1b9-b8d5-4ac2-a8e2-792c037934b0</entry>
Dec 05 15:25:18 user nova-compute[75080]:       <entry name="uuid">845ee1b9-b8d5-4ac2-a8e2-792c037934b0</entry>
Dec 05 15:25:18 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:25:18 user nova-compute[75080]:     </system>
Dec 05 15:25:18 user nova-compute[75080]:   </sysinfo>
Dec 05 15:25:18 user nova-compute[75080]:   <os>
Dec 05 15:25:18 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:25:18 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:25:18 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:25:18 user nova-compute[75080]:   </os>
Dec 05 15:25:18 user nova-compute[75080]:   <features>
Dec 05 15:25:18 user nova-compute[75080]:     <acpi/>
Dec 05 15:25:18 user nova-compute[75080]:     <apic/>
Dec 05 15:25:18 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:25:18 user nova-compute[75080]:   </features>
Dec 05 15:25:18 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:25:18 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:25:18 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:25:18 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:25:18 user nova-compute[75080]:   </clock>
Dec 05 15:25:18 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:25:18 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:25:18 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:25:18 user nova-compute[75080]:   </cpu>
Dec 05 15:25:18 user nova-compute[75080]:   <devices>
Dec 05 15:25:18 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:25:18 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:25:18 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/845ee1b9-b8d5-4ac2-a8e2-792c037934b0/disk"/>
Dec 05 15:25:18 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:25:18 user nova-compute[75080]:     </disk>
Dec 05 15:25:18 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:25:18 user nova-compute[75080]:       <mac address="fa:16:3e:83:3c:76"/>
Dec 05 15:25:18 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:25:18 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:25:18 user nova-compute[75080]:       <target dev="tapf70f0dca-a0"/>
Dec 05 15:25:18 user nova-compute[75080]:     </interface>
Dec 05 15:25:18 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:25:18 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/845ee1b9-b8d5-4ac2-a8e2-792c037934b0/console.log" append="off"/>
Dec 05 15:25:18 user nova-compute[75080]:     </serial>
Dec 05 15:25:18 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:25:18 user nova-compute[75080]:     <video>
Dec 05 15:25:18 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:25:18 user nova-compute[75080]:     </video>
Dec 05 15:25:18 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:25:18 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:25:18 user nova-compute[75080]:     </rng>
Dec 05 15:25:18 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:25:18 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:25:18 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:25:18 user nova-compute[75080]:     </memballoon>
Dec 05 15:25:18 user nova-compute[75080]:   </devices>
Dec 05 15:25:18 user nova-compute[75080]: </domain>
Dec 05 15:25:18 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:25:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1993513088',display_name='tempest-DeleteServersTestJSON-server-1993513088',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1993513088',id=23,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab92d54e289b4749a13e57eade22a8db',ramdisk_id='',reservation_id='r-mq6l6fpr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1556760987',owner_user_name='tempest-DeleteServersTestJSON-1556760987-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:25:17Z,user_data=None,user_id='6b29543e5a2d45e08cc6d09b61c9ae0c',uuid=845ee1b9-b8d5-4ac2-a8e2-792c037934b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f70f0dca-a0a5-4b2f-b6ef-84422347dd49", "address": "fa:16:3e:83:3c:76", "network": {"id": "d4c7d48a-4f32-41d6-a1d8-d0c6b0df3c3f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-699668764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab92d54e289b4749a13e57eade22a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf70f0dca-a0", "ovs_interfaceid": "f70f0dca-a0a5-4b2f-b6ef-84422347dd49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Converting VIF {"id": "f70f0dca-a0a5-4b2f-b6ef-84422347dd49", "address": "fa:16:3e:83:3c:76", "network": {"id": "d4c7d48a-4f32-41d6-a1d8-d0c6b0df3c3f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-699668764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab92d54e289b4749a13e57eade22a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf70f0dca-a0", "ovs_interfaceid": "f70f0dca-a0a5-4b2f-b6ef-84422347dd49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:3c:76,bridge_name='br-int',has_traffic_filtering=True,id=f70f0dca-a0a5-4b2f-b6ef-84422347dd49,network=Network(d4c7d48a-4f32-41d6-a1d8-d0c6b0df3c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf70f0dca-a0') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG os_vif [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:3c:76,bridge_name='br-int',has_traffic_filtering=True,id=f70f0dca-a0a5-4b2f-b6ef-84422347dd49,network=Network(d4c7d48a-4f32-41d6-a1d8-d0c6b0df3c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf70f0dca-a0') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd3590814-3d38-53eb-8a24-33941254c913', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf70f0dca-a0, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf70f0dca-a0, col_values=(('qos', UUID('e50ed939-7948-49a8-a585-335275708aa4')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf70f0dca-a0, col_values=(('external_ids', {'iface-id': 'f70f0dca-a0a5-4b2f-b6ef-84422347dd49', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:3c:76', 'vm-uuid': '845ee1b9-b8d5-4ac2-a8e2-792c037934b0'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:18 user nova-compute[75080]: INFO os_vif [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:3c:76,bridge_name='br-int',has_traffic_filtering=True,id=f70f0dca-a0a5-4b2f-b6ef-84422347dd49,network=Network(d4c7d48a-4f32-41d6-a1d8-d0c6b0df3c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf70f0dca-a0')
Dec 05 15:25:18 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-f8f21ba6-d559-40ac-ac95-5a87edc1dde5 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Snapshot image upload complete
Dec 05 15:25:18 user nova-compute[75080]: INFO nova.compute.manager [None req-f8f21ba6-d559-40ac-ac95-5a87edc1dde5 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Took 5.70 seconds to snapshot the instance on the hypervisor.
Dec 05 15:25:18 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] No VIF found with MAC fa:16:3e:83:3c:76, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG nova.network.neutron [req-25cfe310-930d-49a7-bfa8-7c3370be355e req-feb6a90b-f005-4e24-bc54-501a6022f6f8 service nova] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Updated VIF entry in instance network info cache for port f70f0dca-a0a5-4b2f-b6ef-84422347dd49. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG nova.network.neutron [req-25cfe310-930d-49a7-bfa8-7c3370be355e req-feb6a90b-f005-4e24-bc54-501a6022f6f8 service nova] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Updating instance_info_cache with network_info: [{"id": "f70f0dca-a0a5-4b2f-b6ef-84422347dd49", "address": "fa:16:3e:83:3c:76", "network": {"id": "d4c7d48a-4f32-41d6-a1d8-d0c6b0df3c3f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-699668764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab92d54e289b4749a13e57eade22a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf70f0dca-a0", "ovs_interfaceid": "f70f0dca-a0a5-4b2f-b6ef-84422347dd49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:25:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-25cfe310-930d-49a7-bfa8-7c3370be355e req-feb6a90b-f005-4e24-bc54-501a6022f6f8 service nova] Releasing lock "refresh_cache-845ee1b9-b8d5-4ac2-a8e2-792c037934b0" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:25:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:20 user nova-compute[75080]: DEBUG nova.compute.manager [req-9223fce4-f594-4c1d-a91f-c4fbec120201 req-cd5a7b7a-48f1-4944-919e-5a4bd1b498a9 service nova] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Received event network-vif-plugged-f70f0dca-a0a5-4b2f-b6ef-84422347dd49 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:25:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9223fce4-f594-4c1d-a91f-c4fbec120201 req-cd5a7b7a-48f1-4944-919e-5a4bd1b498a9 service nova] Acquiring lock "845ee1b9-b8d5-4ac2-a8e2-792c037934b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:25:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9223fce4-f594-4c1d-a91f-c4fbec120201 req-cd5a7b7a-48f1-4944-919e-5a4bd1b498a9 service nova] Lock "845ee1b9-b8d5-4ac2-a8e2-792c037934b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:25:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9223fce4-f594-4c1d-a91f-c4fbec120201 req-cd5a7b7a-48f1-4944-919e-5a4bd1b498a9 service nova] Lock "845ee1b9-b8d5-4ac2-a8e2-792c037934b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:25:20 user nova-compute[75080]: DEBUG nova.compute.manager [req-9223fce4-f594-4c1d-a91f-c4fbec120201 req-cd5a7b7a-48f1-4944-919e-5a4bd1b498a9 service nova] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] No waiting events found dispatching network-vif-plugged-f70f0dca-a0a5-4b2f-b6ef-84422347dd49 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:25:20 user nova-compute[75080]: WARNING nova.compute.manager [req-9223fce4-f594-4c1d-a91f-c4fbec120201 req-cd5a7b7a-48f1-4944-919e-5a4bd1b498a9 service nova] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Received unexpected event network-vif-plugged-f70f0dca-a0a5-4b2f-b6ef-84422347dd49 for instance with vm_state building and task_state spawning.
Dec 05 15:25:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:21 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:21 user nova-compute[75080]: DEBUG nova.compute.manager [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:25:21 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:25:21 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Instance spawned successfully.
Dec 05 15:25:21 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:25:21 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:25:21 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:25:21 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:25:21 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:25:21 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:25:21 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:25:22 user nova-compute[75080]: DEBUG nova.compute.manager [req-7e4960d4-7bf0-4e27-a422-60d8a0c19bd8 req-b05a94cf-b4c2-469e-8190-a33912b07dc0 service nova] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Received event network-vif-plugged-f70f0dca-a0a5-4b2f-b6ef-84422347dd49 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:25:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7e4960d4-7bf0-4e27-a422-60d8a0c19bd8 req-b05a94cf-b4c2-469e-8190-a33912b07dc0 service nova] Acquiring lock "845ee1b9-b8d5-4ac2-a8e2-792c037934b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:25:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7e4960d4-7bf0-4e27-a422-60d8a0c19bd8 req-b05a94cf-b4c2-469e-8190-a33912b07dc0 service nova] Lock "845ee1b9-b8d5-4ac2-a8e2-792c037934b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:25:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7e4960d4-7bf0-4e27-a422-60d8a0c19bd8 req-b05a94cf-b4c2-469e-8190-a33912b07dc0 service nova] Lock "845ee1b9-b8d5-4ac2-a8e2-792c037934b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:25:22 user nova-compute[75080]: DEBUG nova.compute.manager [req-7e4960d4-7bf0-4e27-a422-60d8a0c19bd8 req-b05a94cf-b4c2-469e-8190-a33912b07dc0 service nova] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] No waiting events found dispatching network-vif-plugged-f70f0dca-a0a5-4b2f-b6ef-84422347dd49 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:25:22 user nova-compute[75080]: WARNING nova.compute.manager [req-7e4960d4-7bf0-4e27-a422-60d8a0c19bd8 req-b05a94cf-b4c2-469e-8190-a33912b07dc0 service nova] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Received unexpected event network-vif-plugged-f70f0dca-a0a5-4b2f-b6ef-84422347dd49 for instance with vm_state building and task_state spawning.
Dec 05 15:25:22 user nova-compute[75080]: INFO nova.compute.manager [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Took 5.43 seconds to spawn the instance on the hypervisor.
Dec 05 15:25:22 user nova-compute[75080]: DEBUG nova.compute.manager [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:25:22 user nova-compute[75080]: INFO nova.compute.manager [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Took 6.53 seconds to build instance.
Dec 05 15:25:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1dac2e8c-e3a1-4ddc-9f1b-80f6db635095 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Lock "845ee1b9-b8d5-4ac2-a8e2-792c037934b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.663s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:25:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:25 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:25:26 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:25:26 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:25:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:28 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:25:28 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:25:28 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:25:29 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:25:29 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:25:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-5e29bda9-f1d6-4951-9343-f189934a8a23" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:25:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-5e29bda9-f1d6-4951-9343-f189934a8a23" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:25:29 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 15:25:29 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Updating instance_info_cache with network_info: [{"id": "fb2619ea-ffe7-4d82-9b44-984ee393620c", "address": "fa:16:3e:4b:c9:8b", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb2619ea-ff", "ovs_interfaceid": "fb2619ea-ffe7-4d82-9b44-984ee393620c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:25:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-5e29bda9-f1d6-4951-9343-f189934a8a23" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:25:30 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 15:25:30 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:25:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:25:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:25:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:25:30 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:25:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:25:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:25:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:25:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:25:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:25:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:25:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:25:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:25:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:25:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:25:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:25:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:25:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:25:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:25:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:25:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:25:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:25:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:25:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:25:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:25:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:25:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:25:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:25:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:25:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:25:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:25:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:25:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:25:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:25:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:25:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:25:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:25:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:25:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:25:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/845ee1b9-b8d5-4ac2-a8e2-792c037934b0/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:25:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/845ee1b9-b8d5-4ac2-a8e2-792c037934b0/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:25:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/845ee1b9-b8d5-4ac2-a8e2-792c037934b0/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:25:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/845ee1b9-b8d5-4ac2-a8e2-792c037934b0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:25:34 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:25:34 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:25:34 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=7401MB free_disk=25.3031005859375GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:25:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:25:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:25:34 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance bd75375a-8b70-4bc2-a72b-14213ebaa4e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:25:34 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance eedd1529-4feb-4f85-8625-0c20d8e0359d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:25:34 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 5e29bda9-f1d6-4951-9343-f189934a8a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:25:34 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 607acee2-b585-43d2-a897-eca4983d62db actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:25:34 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 412e1e40-082a-429e-9d35-013b72322761 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:25:34 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 07b025ff-4a9d-48a2-b950-b8f2d165f33c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:25:34 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:25:34 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 6bf0a828-329b-46cf-aa76-bf6c24f08212 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:25:34 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance f425241c-0a1d-44fa-affc-9e40974b290d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:25:34 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance c9836958-96d4-4b3e-a45c-fbb97846dbd4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:25:34 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 845ee1b9-b8d5-4ac2-a8e2-792c037934b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:25:34 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:25:34 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:25:34 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:25:34 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:25:34 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:25:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.578s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:25:35 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:25:35 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:25:36 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:25:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:25:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:25:46 user nova-compute[75080]: DEBUG nova.compute.manager [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:25:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:25:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:25:46 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:25:46 user nova-compute[75080]: INFO nova.compute.claims [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Claim successful on node user
Dec 05 15:25:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:47 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:25:47 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:25:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:25:47 user nova-compute[75080]: DEBUG nova.compute.manager [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:25:47 user nova-compute[75080]: DEBUG nova.compute.manager [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:25:47 user nova-compute[75080]: DEBUG nova.network.neutron [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:25:47 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:25:47 user nova-compute[75080]: DEBUG nova.compute.manager [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:25:47 user nova-compute[75080]: DEBUG nova.policy [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '829d709c32db431199af609ddbc8b090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97145ab79b414c4fb8772c71e9414581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:25:47 user nova-compute[75080]: INFO nova.virt.block_device [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Booting with blank volume at /dev/vda
Dec 05 15:25:48 user nova-compute[75080]: DEBUG nova.network.neutron [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Successfully created port: af017697-07fb-4000-87d4-87f84dbd53bc {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:25:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:48 user nova-compute[75080]: DEBUG nova.network.neutron [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Successfully updated port: af017697-07fb-4000-87d4-87f84dbd53bc {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:25:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "refresh_cache-ab882db7-e6d7-44ca-9ea4-ae2fa68f7929" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:25:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquired lock "refresh_cache-ab882db7-e6d7-44ca-9ea4-ae2fa68f7929" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:25:48 user nova-compute[75080]: DEBUG nova.network.neutron [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:25:48 user nova-compute[75080]: DEBUG nova.compute.manager [req-10f84919-ef8a-4e26-8ed6-4cb02369ee46 req-bb37a5a2-d999-487e-babd-52907f4c6bdf service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Received event network-changed-af017697-07fb-4000-87d4-87f84dbd53bc {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:25:48 user nova-compute[75080]: DEBUG nova.compute.manager [req-10f84919-ef8a-4e26-8ed6-4cb02369ee46 req-bb37a5a2-d999-487e-babd-52907f4c6bdf service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Refreshing instance network info cache due to event network-changed-af017697-07fb-4000-87d4-87f84dbd53bc. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:25:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-10f84919-ef8a-4e26-8ed6-4cb02369ee46 req-bb37a5a2-d999-487e-babd-52907f4c6bdf service nova] Acquiring lock "refresh_cache-ab882db7-e6d7-44ca-9ea4-ae2fa68f7929" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:25:48 user nova-compute[75080]: DEBUG nova.network.neutron [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:25:48 user nova-compute[75080]: DEBUG nova.network.neutron [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Updating instance_info_cache with network_info: [{"id": "af017697-07fb-4000-87d4-87f84dbd53bc", "address": "fa:16:3e:48:4c:fd", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf017697-07", "ovs_interfaceid": "af017697-07fb-4000-87d4-87f84dbd53bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:25:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Releasing lock "refresh_cache-ab882db7-e6d7-44ca-9ea4-ae2fa68f7929" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:25:49 user nova-compute[75080]: DEBUG nova.compute.manager [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Instance network_info: |[{"id": "af017697-07fb-4000-87d4-87f84dbd53bc", "address": "fa:16:3e:48:4c:fd", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf017697-07", "ovs_interfaceid": "af017697-07fb-4000-87d4-87f84dbd53bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:25:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-10f84919-ef8a-4e26-8ed6-4cb02369ee46 req-bb37a5a2-d999-487e-babd-52907f4c6bdf service nova] Acquired lock "refresh_cache-ab882db7-e6d7-44ca-9ea4-ae2fa68f7929" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:25:49 user nova-compute[75080]: DEBUG nova.network.neutron [req-10f84919-ef8a-4e26-8ed6-4cb02369ee46 req-bb37a5a2-d999-487e-babd-52907f4c6bdf service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Refreshing network info cache for port af017697-07fb-4000-87d4-87f84dbd53bc {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:25:49 user nova-compute[75080]: DEBUG nova.network.neutron [req-10f84919-ef8a-4e26-8ed6-4cb02369ee46 req-bb37a5a2-d999-487e-babd-52907f4c6bdf service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Updated VIF entry in instance network info cache for port af017697-07fb-4000-87d4-87f84dbd53bc. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:25:49 user nova-compute[75080]: DEBUG nova.network.neutron [req-10f84919-ef8a-4e26-8ed6-4cb02369ee46 req-bb37a5a2-d999-487e-babd-52907f4c6bdf service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Updating instance_info_cache with network_info: [{"id": "af017697-07fb-4000-87d4-87f84dbd53bc", "address": "fa:16:3e:48:4c:fd", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf017697-07", "ovs_interfaceid": "af017697-07fb-4000-87d4-87f84dbd53bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:25:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-10f84919-ef8a-4e26-8ed6-4cb02369ee46 req-bb37a5a2-d999-487e-babd-52907f4c6bdf service nova] Releasing lock "refresh_cache-ab882db7-e6d7-44ca-9ea4-ae2fa68f7929" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:25:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:52 user nova-compute[75080]: DEBUG os_brick.utils [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:25:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:25:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:25:52 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b143e04e-e880-45b2-8823-048fa7fadd5a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:25:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:25:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:25:52 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a00b04-7e0f-4282-bfa8-add311cfb2ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:25:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:25:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.048s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:25:53 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a9468b-ecce-4331-b95a-9777760edd86]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:25:53 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed022b68-5706-4c47-b10d-c03540fa99d6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:25:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:25:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:25:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:25:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:25:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:25:53 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:25:53 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[961ff280-8229-4820-9b4a-fc86e120a382]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:25:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:25:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:25:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:25:53 user nova-compute[75080]: DEBUG os_brick.utils [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:25:53 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Updating existing volume attachment record: 53765958-32d0-4029-ad8b-cb3b97317862 {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:25:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:25:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG nova.compute.manager [req-05c14ca3-d2b0-4b29-97aa-ae232cd31ce5 req-44275398-d168-42d2-8bc8-eff9db37c4bb service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-changed-0250593a-4991-4e30-9e86-4f403f81bbe6 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG nova.compute.manager [req-05c14ca3-d2b0-4b29-97aa-ae232cd31ce5 req-44275398-d168-42d2-8bc8-eff9db37c4bb service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Refreshing instance network info cache due to event network-changed-0250593a-4991-4e30-9e86-4f403f81bbe6. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-05c14ca3-d2b0-4b29-97aa-ae232cd31ce5 req-44275398-d168-42d2-8bc8-eff9db37c4bb service nova] Acquiring lock "refresh_cache-6bf0a828-329b-46cf-aa76-bf6c24f08212" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-05c14ca3-d2b0-4b29-97aa-ae232cd31ce5 req-44275398-d168-42d2-8bc8-eff9db37c4bb service nova] Acquired lock "refresh_cache-6bf0a828-329b-46cf-aa76-bf6c24f08212" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG nova.network.neutron [req-05c14ca3-d2b0-4b29-97aa-ae232cd31ce5 req-44275398-d168-42d2-8bc8-eff9db37c4bb service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Refreshing network info cache for port 0250593a-4991-4e30-9e86-4f403f81bbe6 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG nova.compute.manager [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:26:02 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Creating image(s)
Dec 05 15:26:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Did not create local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Ensure instance console log exists: /opt/stack/data/nova/instances/ab882db7-e6d7-44ca-9ea4-ae2fa68f7929/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Start _get_guest_xml network_info=[{"id": "af017697-07fb-4000-87d4-87f84dbd53bc", "address": "fa:16:3e:48:4c:fd", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf017697-07", "ovs_interfaceid": "af017697-07fb-4000-87d4-87f84dbd53bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eTtyOlSx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ab882db7-e6d7-44ca-9ea4-ae2fa68f7929', 'attached_at': '', 'detached_at': '', 'volume_id': '2b7c6bb1-e02f-431a-97d7-ea24d61bb399', 'serial': '2b7c6bb1-e02f-431a-97d7-ea24d61bb399'}, 'device_type': 'disk', 'attachment_id': '53765958-32d0-4029-ad8b-cb3b97317862', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:26:02 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:26:02 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:26:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eTtyOlSx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:26:02 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:26:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:26:02 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:26:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:26:02 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:26:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a71a3b-4f08-44f2-a41d-1f7953f39628]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:26:02 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa322e0c-a85f-4f54-88b7-ad00f14a1dfd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399] added
Dec 05 15:26:02 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[347f4bf4-fbdc-40a9-bba9-029d61ed0f10]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec28b9f-a96e-4290-840b-62d0ff7dfaec]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eTtyOlSx {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eTtyOlSx" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e93f46c-dad8-49b5-aa17-d63ca22827aa]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eTtyOlSx'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ef4a1a-d541-4335-b583-1db4e53152a3]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f2a300-1f90-4dde-a87d-c3e1e30f301b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:26:02 user nova-compute[75080]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb (non-flash)
Dec 05 15:26:02 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:26:02 user nova-compute[75080]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 (non-flash)
Dec 05 15:26:02 user nova-compute[75080]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c (non-flash)
Dec 05 15:26:02 user nova-compute[75080]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc (non-flash)
Dec 05 15:26:02 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:26:02 user nova-compute[75080]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb (non-flash)
Dec 05 15:26:02 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:26:02 user nova-compute[75080]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 (non-flash)
Dec 05 15:26:02 user nova-compute[75080]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c (non-flash)
Dec 05 15:26:02 user nova-compute[75080]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc (non-flash)
Dec 05 15:26:02 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:26:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:03 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:03 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2b12cc-0ff2-4038-8bd2-1c7ac0b9d77a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:03 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399, portal: 172.16.0.220,3260]
Dec 05 15:26:03 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399, portal: 172.16.0.220,3260] successful.
Dec 05 15:26:03 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:03 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:03 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:03 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a7cf79-66f2-4105-b875-ec9ae6957570]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:03 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:03 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:03 user nova-compute[75080]: DEBUG nova.network.neutron [req-05c14ca3-d2b0-4b29-97aa-ae232cd31ce5 req-44275398-d168-42d2-8bc8-eff9db37c4bb service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Updated VIF entry in instance network info cache for port 0250593a-4991-4e30-9e86-4f403f81bbe6. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:26:03 user nova-compute[75080]: DEBUG nova.network.neutron [req-05c14ca3-d2b0-4b29-97aa-ae232cd31ce5 req-44275398-d168-42d2-8bc8-eff9db37c4bb service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Updating instance_info_cache with network_info: [{"id": "0250593a-4991-4e30-9e86-4f403f81bbe6", "address": "fa:16:3e:64:7a:bd", "network": {"id": "0e5b22b3-949b-4958-8500-8730f46ffb1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2105495982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0250593a-49", "ovs_interfaceid": "0250593a-4991-4e30-9e86-4f403f81bbe6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "70683181-d134-4a6c-9bc4-9dcf7b019162", "address": "fa:16:3e:d6:c5:60", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70683181-d1", "ovs_interfaceid": "70683181-d134-4a6c-9bc4-9dcf7b019162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "58b3e25c-cbd6-4bdd-83e8-775a0708df4e", "address": "fa:16:3e:40:ba:74", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b3e25c-cb", "ovs_interfaceid": "58b3e25c-cbd6-4bdd-83e8-775a0708df4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7a891d10-f2c1-4a8e-b404-67372485e9a5", "address": "fa:16:3e:4d:4a:cf", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a891d10-f2", "ovs_interfaceid": "7a891d10-f2c1-4a8e-b404-67372485e9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "362dc737-7651-44c0-a618-ed6a1bcbee5c", "address": "fa:16:3e:da:3e:bf", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap362dc737-76", "ovs_interfaceid": "362dc737-7651-44c0-a618-ed6a1bcbee5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb4d8798-73e9-4b84-91f1-8a6578f22ac1", "address": "fa:16:3e:da:66:49", "network": {"id": "af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-211886922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4d8798-73", "ovs_interfaceid": "eb4d8798-73e9-4b84-91f1-8a6578f22ac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "510c5cfb-99de-4b45-aa65-a1c7a53969ea", "address": "fa:16:3e:34:62:97", "network": {"id": "af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-211886922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap510c5cfb-99", "ovs_interfaceid": "510c5cfb-99de-4b45-aa65-a1c7a53969ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:26:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-05c14ca3-d2b0-4b29-97aa-ae232cd31ce5 req-44275398-d168-42d2-8bc8-eff9db37c4bb service nova] Releasing lock "refresh_cache-6bf0a828-329b-46cf-aa76-bf6c24f08212" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:26:03 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:03 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d06411-2009-487c-bb2e-7e0ad4dbe6e3]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:03 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:26:03 user nova-compute[75080]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb (non-flash)
Dec 05 15:26:03 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:26:03 user nova-compute[75080]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 (non-flash)
Dec 05 15:26:03 user nova-compute[75080]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c (non-flash)
Dec 05 15:26:03 user nova-compute[75080]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc (non-flash)
Dec 05 15:26:03 user nova-compute[75080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:26:03 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:26:03 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:26:03 user nova-compute[75080]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb (non-flash)
Dec 05 15:26:03 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:26:03 user nova-compute[75080]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 (non-flash)
Dec 05 15:26:03 user nova-compute[75080]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c (non-flash)
Dec 05 15:26:03 user nova-compute[75080]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc (non-flash)
Dec 05 15:26:03 user nova-compute[75080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:26:03 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:26:03 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:26:03 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:26:03 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] HCTL ('38', '-', '-', 0) found on session 24 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:26:03 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:26:03 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:03 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:03 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6325585d-e048-4387-afa7-4c70443461ca]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:03 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Searching for a device in session 24 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:26:03 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eTtyOlSx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:26:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:26:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 15:26:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:26:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:26:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:04 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:26:04 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23263323431313863', 'path': '/dev/sdg'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:26:04 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263323431313863', 'path': '/dev/sdg'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:26:04 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:25:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1586887461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1586887461',id=24,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97145ab79b414c4fb8772c71e9414581',ramdisk_id='',reservation_id='r-ibun0y2c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2060228993',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:25:47Z,user_data=None,user_id='829d709c32db431199af609ddbc8b090',uuid=ab882db7-e6d7-44ca-9ea4-ae2fa68f7929,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af017697-07fb-4000-87d4-87f84dbd53bc", "address": "fa:16:3e:48:4c:fd", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf017697-07", "ovs_interfaceid": "af017697-07fb-4000-87d4-87f84dbd53bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:26:04 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Converting VIF {"id": "af017697-07fb-4000-87d4-87f84dbd53bc", "address": "fa:16:3e:48:4c:fd", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf017697-07", "ovs_interfaceid": "af017697-07fb-4000-87d4-87f84dbd53bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:26:04 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:4c:fd,bridge_name='br-int',has_traffic_filtering=True,id=af017697-07fb-4000-87d4-87f84dbd53bc,network=Network(61aa968d-7e44-4ef2-955f-2e5441416f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf017697-07') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:26:04 user nova-compute[75080]: DEBUG nova.objects.instance [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lazy-loading 'pci_devices' on Instance uuid ab882db7-e6d7-44ca-9ea4-ae2fa68f7929 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:26:04 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:26:04 user nova-compute[75080]:   <uuid>ab882db7-e6d7-44ca-9ea4-ae2fa68f7929</uuid>
Dec 05 15:26:04 user nova-compute[75080]:   <name>instance-00000018</name>
Dec 05 15:26:04 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:26:04 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:26:04 user nova-compute[75080]:   <metadata>
Dec 05 15:26:04 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:26:04 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:26:04 user nova-compute[75080]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1586887461</nova:name>
Dec 05 15:26:04 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:26:02</nova:creationTime>
Dec 05 15:26:04 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:26:04 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:26:04 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:26:04 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:26:04 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:26:04 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:26:04 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:26:04 user nova-compute[75080]:       <nova:owner>
Dec 05 15:26:04 user nova-compute[75080]:         <nova:user uuid="829d709c32db431199af609ddbc8b090">tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member</nova:user>
Dec 05 15:26:04 user nova-compute[75080]:         <nova:project uuid="97145ab79b414c4fb8772c71e9414581">tempest-ServerBootFromVolumeStableRescueTest-2060228993</nova:project>
Dec 05 15:26:04 user nova-compute[75080]:       </nova:owner>
Dec 05 15:26:04 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:26:04 user nova-compute[75080]:       <nova:ports>
Dec 05 15:26:04 user nova-compute[75080]:         <nova:port uuid="af017697-07fb-4000-87d4-87f84dbd53bc">
Dec 05 15:26:04 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 05 15:26:04 user nova-compute[75080]:         </nova:port>
Dec 05 15:26:04 user nova-compute[75080]:       </nova:ports>
Dec 05 15:26:04 user nova-compute[75080]:     </nova:instance>
Dec 05 15:26:04 user nova-compute[75080]:   </metadata>
Dec 05 15:26:04 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:26:04 user nova-compute[75080]:     <system>
Dec 05 15:26:04 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:26:04 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:26:04 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:26:04 user nova-compute[75080]:       <entry name="serial">ab882db7-e6d7-44ca-9ea4-ae2fa68f7929</entry>
Dec 05 15:26:04 user nova-compute[75080]:       <entry name="uuid">ab882db7-e6d7-44ca-9ea4-ae2fa68f7929</entry>
Dec 05 15:26:04 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:26:04 user nova-compute[75080]:     </system>
Dec 05 15:26:04 user nova-compute[75080]:   </sysinfo>
Dec 05 15:26:04 user nova-compute[75080]:   <os>
Dec 05 15:26:04 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:26:04 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:26:04 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:26:04 user nova-compute[75080]:   </os>
Dec 05 15:26:04 user nova-compute[75080]:   <features>
Dec 05 15:26:04 user nova-compute[75080]:     <acpi/>
Dec 05 15:26:04 user nova-compute[75080]:     <apic/>
Dec 05 15:26:04 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:26:04 user nova-compute[75080]:   </features>
Dec 05 15:26:04 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:26:04 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:26:04 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:26:04 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:26:04 user nova-compute[75080]:   </clock>
Dec 05 15:26:04 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:26:04 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:26:04 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:26:04 user nova-compute[75080]:   </cpu>
Dec 05 15:26:04 user nova-compute[75080]:   <devices>
Dec 05 15:26:04 user nova-compute[75080]:     <disk type="block" device="disk">
Dec 05 15:26:04 user nova-compute[75080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:26:04 user nova-compute[75080]:       <source dev="/dev/sdg"/>
Dec 05 15:26:04 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:26:04 user nova-compute[75080]:       <serial>2b7c6bb1-e02f-431a-97d7-ea24d61bb399</serial>
Dec 05 15:26:04 user nova-compute[75080]:     </disk>
Dec 05 15:26:04 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:26:04 user nova-compute[75080]:       <mac address="fa:16:3e:48:4c:fd"/>
Dec 05 15:26:04 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:26:04 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:26:04 user nova-compute[75080]:       <target dev="tapaf017697-07"/>
Dec 05 15:26:04 user nova-compute[75080]:     </interface>
Dec 05 15:26:04 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:26:04 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/ab882db7-e6d7-44ca-9ea4-ae2fa68f7929/console.log" append="off"/>
Dec 05 15:26:04 user nova-compute[75080]:     </serial>
Dec 05 15:26:04 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:26:04 user nova-compute[75080]:     <video>
Dec 05 15:26:04 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:26:04 user nova-compute[75080]:     </video>
Dec 05 15:26:04 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:26:04 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:26:04 user nova-compute[75080]:     </rng>
Dec 05 15:26:04 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:26:04 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:26:04 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:26:04 user nova-compute[75080]:     </memballoon>
Dec 05 15:26:04 user nova-compute[75080]:   </devices>
Dec 05 15:26:04 user nova-compute[75080]: </domain>
Dec 05 15:26:04 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:26:04 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:25:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1586887461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1586887461',id=24,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97145ab79b414c4fb8772c71e9414581',ramdisk_id='',reservation_id='r-ibun0y2c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2060228993',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:25:47Z,user_data=None,user_id='829d709c32db431199af609ddbc8b090',uuid=ab882db7-e6d7-44ca-9ea4-ae2fa68f7929,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af017697-07fb-4000-87d4-87f84dbd53bc", "address": "fa:16:3e:48:4c:fd", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf017697-07", "ovs_interfaceid": "af017697-07fb-4000-87d4-87f84dbd53bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:26:04 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Converting VIF {"id": "af017697-07fb-4000-87d4-87f84dbd53bc", "address": "fa:16:3e:48:4c:fd", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf017697-07", "ovs_interfaceid": "af017697-07fb-4000-87d4-87f84dbd53bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:26:04 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:4c:fd,bridge_name='br-int',has_traffic_filtering=True,id=af017697-07fb-4000-87d4-87f84dbd53bc,network=Network(61aa968d-7e44-4ef2-955f-2e5441416f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf017697-07') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:26:04 user nova-compute[75080]: DEBUG os_vif [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:4c:fd,bridge_name='br-int',has_traffic_filtering=True,id=af017697-07fb-4000-87d4-87f84dbd53bc,network=Network(61aa968d-7e44-4ef2-955f-2e5441416f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf017697-07') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:26:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:26:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:26:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '44e81d5e-7147-5cec-8419-038719fa2e78', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:26:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:26:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf017697-07, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:26:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaf017697-07, col_values=(('qos', UUID('384e6236-abb0-4e83-ab9b-d786e243633d')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:26:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaf017697-07, col_values=(('external_ids', {'iface-id': 'af017697-07fb-4000-87d4-87f84dbd53bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:4c:fd', 'vm-uuid': 'ab882db7-e6d7-44ca-9ea4-ae2fa68f7929'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:26:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:26:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:04 user nova-compute[75080]: INFO os_vif [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:4c:fd,bridge_name='br-int',has_traffic_filtering=True,id=af017697-07fb-4000-87d4-87f84dbd53bc,network=Network(61aa968d-7e44-4ef2-955f-2e5441416f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf017697-07')
Dec 05 15:26:04 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:26:04 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] No VIF found with MAC fa:16:3e:48:4c:fd, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:26:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Acquiring lock "6bf0a828-329b-46cf-aa76-bf6c24f08212" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Acquiring lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:05 user nova-compute[75080]: INFO nova.compute.manager [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Terminating instance
Dec 05 15:26:05 user nova-compute[75080]: DEBUG nova.compute.manager [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:26:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:05 user nova-compute[75080]: DEBUG nova.compute.manager [req-6271c728-117a-4994-975f-ff206ec39f89 req-b0673667-4bac-4c35-a45e-c3248f6378cf service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-unplugged-0250593a-4991-4e30-9e86-4f403f81bbe6 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:26:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-6271c728-117a-4994-975f-ff206ec39f89 req-b0673667-4bac-4c35-a45e-c3248f6378cf service nova] Acquiring lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-6271c728-117a-4994-975f-ff206ec39f89 req-b0673667-4bac-4c35-a45e-c3248f6378cf service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-6271c728-117a-4994-975f-ff206ec39f89 req-b0673667-4bac-4c35-a45e-c3248f6378cf service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:05 user nova-compute[75080]: DEBUG nova.compute.manager [req-6271c728-117a-4994-975f-ff206ec39f89 req-b0673667-4bac-4c35-a45e-c3248f6378cf service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] No waiting events found dispatching network-vif-unplugged-0250593a-4991-4e30-9e86-4f403f81bbe6 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:26:05 user nova-compute[75080]: DEBUG nova.compute.manager [req-6271c728-117a-4994-975f-ff206ec39f89 req-b0673667-4bac-4c35-a45e-c3248f6378cf service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-unplugged-0250593a-4991-4e30-9e86-4f403f81bbe6 for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:26:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:05 user nova-compute[75080]: DEBUG nova.compute.manager [req-00659adc-78a3-4219-b809-10c72d97e5b8 req-f8c68e36-1f67-4f00-a947-48520b230a8a service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-unplugged-58b3e25c-cbd6-4bdd-83e8-775a0708df4e {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:26:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-00659adc-78a3-4219-b809-10c72d97e5b8 req-f8c68e36-1f67-4f00-a947-48520b230a8a service nova] Acquiring lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-00659adc-78a3-4219-b809-10c72d97e5b8 req-f8c68e36-1f67-4f00-a947-48520b230a8a service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-00659adc-78a3-4219-b809-10c72d97e5b8 req-f8c68e36-1f67-4f00-a947-48520b230a8a service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:05 user nova-compute[75080]: DEBUG nova.compute.manager [req-00659adc-78a3-4219-b809-10c72d97e5b8 req-f8c68e36-1f67-4f00-a947-48520b230a8a service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] No waiting events found dispatching network-vif-unplugged-58b3e25c-cbd6-4bdd-83e8-775a0708df4e {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:26:05 user nova-compute[75080]: DEBUG nova.compute.manager [req-00659adc-78a3-4219-b809-10c72d97e5b8 req-f8c68e36-1f67-4f00-a947-48520b230a8a service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-unplugged-58b3e25c-cbd6-4bdd-83e8-775a0708df4e for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:26:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:05 user nova-compute[75080]: DEBUG nova.compute.manager [req-72bff01a-6e23-4e25-9e90-857e3773a7e0 req-21552824-d9e3-41c5-b7fa-060d319aab2a service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Received event network-vif-plugged-af017697-07fb-4000-87d4-87f84dbd53bc {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:26:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-72bff01a-6e23-4e25-9e90-857e3773a7e0 req-21552824-d9e3-41c5-b7fa-060d319aab2a service nova] Acquiring lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-72bff01a-6e23-4e25-9e90-857e3773a7e0 req-21552824-d9e3-41c5-b7fa-060d319aab2a service nova] Lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-72bff01a-6e23-4e25-9e90-857e3773a7e0 req-21552824-d9e3-41c5-b7fa-060d319aab2a service nova] Lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:05 user nova-compute[75080]: DEBUG nova.compute.manager [req-72bff01a-6e23-4e25-9e90-857e3773a7e0 req-21552824-d9e3-41c5-b7fa-060d319aab2a service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] No waiting events found dispatching network-vif-plugged-af017697-07fb-4000-87d4-87f84dbd53bc {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:26:05 user nova-compute[75080]: WARNING nova.compute.manager [req-72bff01a-6e23-4e25-9e90-857e3773a7e0 req-21552824-d9e3-41c5-b7fa-060d319aab2a service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Received unexpected event network-vif-plugged-af017697-07fb-4000-87d4-87f84dbd53bc for instance with vm_state building and task_state spawning.
Dec 05 15:26:06 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:06 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:06 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:06 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:06 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:06 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:06 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:06 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:06 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:06 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:06 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Instance destroyed successfully.
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.objects.instance [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Lazy-loading 'resources' on Instance uuid 6bf0a828-329b-46cf-aa76-bf6c24f08212 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1515147318',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1515147318',id=20,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLABp92B+QoSjO3Nxzym0L9AU1hs81rZrESUgnXLnvRsbfhOgXiJY51Pu/5sRkfV5DsnzijnsLpzT1f3eDANWTNGJryO8rMim4GO2hLFZkVjWYfIyLmQ5BqB2NrgQeAsMw==',key_name='tempest-keypair-755591069',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:24:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='318ca7ad8bc84749ab0d0fb1e8aa34e6',ramdisk_id='',reservation_id='r-woffnt4p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-310720617',owner_user_name='tempest-TaggedBootDevicesTest_v242-310720617-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:24:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c369909d6cb47cfaad8670df22f4e67',uuid=6bf0a828-329b-46cf-aa76-bf6c24f08212,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0250593a-4991-4e30-9e86-4f403f81bbe6", "address": "fa:16:3e:64:7a:bd", "network": {"id": "0e5b22b3-949b-4958-8500-8730f46ffb1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2105495982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0250593a-49", "ovs_interfaceid": "0250593a-4991-4e30-9e86-4f403f81bbe6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converting VIF {"id": "0250593a-4991-4e30-9e86-4f403f81bbe6", "address": "fa:16:3e:64:7a:bd", "network": {"id": "0e5b22b3-949b-4958-8500-8730f46ffb1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2105495982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0250593a-49", "ovs_interfaceid": "0250593a-4991-4e30-9e86-4f403f81bbe6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:7a:bd,bridge_name='br-int',has_traffic_filtering=True,id=0250593a-4991-4e30-9e86-4f403f81bbe6,network=Network(0e5b22b3-949b-4958-8500-8730f46ffb1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0250593a-49') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG os_vif [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:7a:bd,bridge_name='br-int',has_traffic_filtering=True,id=0250593a-4991-4e30-9e86-4f403f81bbe6,network=Network(0e5b22b3-949b-4958-8500-8730f46ffb1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0250593a-49') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0250593a-49, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=43cd7de4-c2cb-49b5-948b-4ea7c276a12c) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: INFO os_vif [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:7a:bd,bridge_name='br-int',has_traffic_filtering=True,id=0250593a-4991-4e30-9e86-4f403f81bbe6,network=Network(0e5b22b3-949b-4958-8500-8730f46ffb1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0250593a-49')
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1515147318',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1515147318',id=20,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLABp92B+QoSjO3Nxzym0L9AU1hs81rZrESUgnXLnvRsbfhOgXiJY51Pu/5sRkfV5DsnzijnsLpzT1f3eDANWTNGJryO8rMim4GO2hLFZkVjWYfIyLmQ5BqB2NrgQeAsMw==',key_name='tempest-keypair-755591069',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:24:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='318ca7ad8bc84749ab0d0fb1e8aa34e6',ramdisk_id='',reservation_id='r-woffnt4p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-310720617',owner_user_name='tempest-TaggedBootDevicesTest_v242-310720617-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:24:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c369909d6cb47cfaad8670df22f4e67',uuid=6bf0a828-329b-46cf-aa76-bf6c24f08212,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70683181-d134-4a6c-9bc4-9dcf7b019162", "address": "fa:16:3e:d6:c5:60", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70683181-d1", "ovs_interfaceid": "70683181-d134-4a6c-9bc4-9dcf7b019162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converting VIF {"id": "70683181-d134-4a6c-9bc4-9dcf7b019162", "address": "fa:16:3e:d6:c5:60", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70683181-d1", "ovs_interfaceid": "70683181-d134-4a6c-9bc4-9dcf7b019162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:c5:60,bridge_name='br-int',has_traffic_filtering=True,id=70683181-d134-4a6c-9bc4-9dcf7b019162,network=Network(bf07d779-8fb7-4791-aee6-823fcbba0098),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap70683181-d1') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG os_vif [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:c5:60,bridge_name='br-int',has_traffic_filtering=True,id=70683181-d134-4a6c-9bc4-9dcf7b019162,network=Network(bf07d779-8fb7-4791-aee6-823fcbba0098),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap70683181-d1') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70683181-d1, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ff1e1e0-8a52-4013-add8-0509bf8deadf) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: INFO os_vif [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:c5:60,bridge_name='br-int',has_traffic_filtering=True,id=70683181-d134-4a6c-9bc4-9dcf7b019162,network=Network(bf07d779-8fb7-4791-aee6-823fcbba0098),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap70683181-d1')
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1515147318',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1515147318',id=20,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLABp92B+QoSjO3Nxzym0L9AU1hs81rZrESUgnXLnvRsbfhOgXiJY51Pu/5sRkfV5DsnzijnsLpzT1f3eDANWTNGJryO8rMim4GO2hLFZkVjWYfIyLmQ5BqB2NrgQeAsMw==',key_name='tempest-keypair-755591069',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:24:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='318ca7ad8bc84749ab0d0fb1e8aa34e6',ramdisk_id='',reservation_id='r-woffnt4p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-310720617',owner_user_name='tempest-TaggedBootDevicesTest_v242-310720617-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:24:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c369909d6cb47cfaad8670df22f4e67',uuid=6bf0a828-329b-46cf-aa76-bf6c24f08212,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58b3e25c-cbd6-4bdd-83e8-775a0708df4e", "address": "fa:16:3e:40:ba:74", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b3e25c-cb", "ovs_interfaceid": "58b3e25c-cbd6-4bdd-83e8-775a0708df4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converting VIF {"id": "58b3e25c-cbd6-4bdd-83e8-775a0708df4e", "address": "fa:16:3e:40:ba:74", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b3e25c-cb", "ovs_interfaceid": "58b3e25c-cbd6-4bdd-83e8-775a0708df4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:ba:74,bridge_name='br-int',has_traffic_filtering=True,id=58b3e25c-cbd6-4bdd-83e8-775a0708df4e,network=Network(bf07d779-8fb7-4791-aee6-823fcbba0098),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap58b3e25c-cb') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG os_vif [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:ba:74,bridge_name='br-int',has_traffic_filtering=True,id=58b3e25c-cbd6-4bdd-83e8-775a0708df4e,network=Network(bf07d779-8fb7-4791-aee6-823fcbba0098),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap58b3e25c-cb') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58b3e25c-cb, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d4366a32-3e32-419a-bf74-987e0e70d2a6) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: INFO os_vif [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:ba:74,bridge_name='br-int',has_traffic_filtering=True,id=58b3e25c-cbd6-4bdd-83e8-775a0708df4e,network=Network(bf07d779-8fb7-4791-aee6-823fcbba0098),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap58b3e25c-cb')
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1515147318',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1515147318',id=20,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLABp92B+QoSjO3Nxzym0L9AU1hs81rZrESUgnXLnvRsbfhOgXiJY51Pu/5sRkfV5DsnzijnsLpzT1f3eDANWTNGJryO8rMim4GO2hLFZkVjWYfIyLmQ5BqB2NrgQeAsMw==',key_name='tempest-keypair-755591069',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:24:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='318ca7ad8bc84749ab0d0fb1e8aa34e6',ramdisk_id='',reservation_id='r-woffnt4p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-310720617',owner_user_name='tempest-TaggedBootDevicesTest_v242-310720617-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:24:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c369909d6cb47cfaad8670df22f4e67',uuid=6bf0a828-329b-46cf-aa76-bf6c24f08212,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a891d10-f2c1-4a8e-b404-67372485e9a5", "address": "fa:16:3e:4d:4a:cf", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a891d10-f2", "ovs_interfaceid": "7a891d10-f2c1-4a8e-b404-67372485e9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converting VIF {"id": "7a891d10-f2c1-4a8e-b404-67372485e9a5", "address": "fa:16:3e:4d:4a:cf", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a891d10-f2", "ovs_interfaceid": "7a891d10-f2c1-4a8e-b404-67372485e9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:4a:cf,bridge_name='br-int',has_traffic_filtering=True,id=7a891d10-f2c1-4a8e-b404-67372485e9a5,network=Network(bf07d779-8fb7-4791-aee6-823fcbba0098),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a891d10-f2') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG os_vif [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:4a:cf,bridge_name='br-int',has_traffic_filtering=True,id=7a891d10-f2c1-4a8e-b404-67372485e9a5,network=Network(bf07d779-8fb7-4791-aee6-823fcbba0098),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a891d10-f2') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a891d10-f2, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-2c333c45-582d-4b16-b01e-04c5552e2419 req-64ab7095-717a-4925-aa26-a01ffd2cb8dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-plugged-0250593a-4991-4e30-9e86-4f403f81bbe6 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2c333c45-582d-4b16-b01e-04c5552e2419 req-64ab7095-717a-4925-aa26-a01ffd2cb8dc service nova] Acquiring lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2c333c45-582d-4b16-b01e-04c5552e2419 req-64ab7095-717a-4925-aa26-a01ffd2cb8dc service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2c333c45-582d-4b16-b01e-04c5552e2419 req-64ab7095-717a-4925-aa26-a01ffd2cb8dc service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-2c333c45-582d-4b16-b01e-04c5552e2419 req-64ab7095-717a-4925-aa26-a01ffd2cb8dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] No waiting events found dispatching network-vif-plugged-0250593a-4991-4e30-9e86-4f403f81bbe6 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:26:07 user nova-compute[75080]: WARNING nova.compute.manager [req-2c333c45-582d-4b16-b01e-04c5552e2419 req-64ab7095-717a-4925-aa26-a01ffd2cb8dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received unexpected event network-vif-plugged-0250593a-4991-4e30-9e86-4f403f81bbe6 for instance with vm_state active and task_state deleting.
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-2c333c45-582d-4b16-b01e-04c5552e2419 req-64ab7095-717a-4925-aa26-a01ffd2cb8dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-unplugged-70683181-d134-4a6c-9bc4-9dcf7b019162 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2c333c45-582d-4b16-b01e-04c5552e2419 req-64ab7095-717a-4925-aa26-a01ffd2cb8dc service nova] Acquiring lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2c333c45-582d-4b16-b01e-04c5552e2419 req-64ab7095-717a-4925-aa26-a01ffd2cb8dc service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2c333c45-582d-4b16-b01e-04c5552e2419 req-64ab7095-717a-4925-aa26-a01ffd2cb8dc service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-2c333c45-582d-4b16-b01e-04c5552e2419 req-64ab7095-717a-4925-aa26-a01ffd2cb8dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] No waiting events found dispatching network-vif-unplugged-70683181-d134-4a6c-9bc4-9dcf7b019162 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-2c333c45-582d-4b16-b01e-04c5552e2419 req-64ab7095-717a-4925-aa26-a01ffd2cb8dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-unplugged-70683181-d134-4a6c-9bc4-9dcf7b019162 for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-2c333c45-582d-4b16-b01e-04c5552e2419 req-64ab7095-717a-4925-aa26-a01ffd2cb8dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-plugged-70683181-d134-4a6c-9bc4-9dcf7b019162 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2c333c45-582d-4b16-b01e-04c5552e2419 req-64ab7095-717a-4925-aa26-a01ffd2cb8dc service nova] Acquiring lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2c333c45-582d-4b16-b01e-04c5552e2419 req-64ab7095-717a-4925-aa26-a01ffd2cb8dc service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2c333c45-582d-4b16-b01e-04c5552e2419 req-64ab7095-717a-4925-aa26-a01ffd2cb8dc service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-2c333c45-582d-4b16-b01e-04c5552e2419 req-64ab7095-717a-4925-aa26-a01ffd2cb8dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] No waiting events found dispatching network-vif-plugged-70683181-d134-4a6c-9bc4-9dcf7b019162 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:26:07 user nova-compute[75080]: WARNING nova.compute.manager [req-2c333c45-582d-4b16-b01e-04c5552e2419 req-64ab7095-717a-4925-aa26-a01ffd2cb8dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received unexpected event network-vif-plugged-70683181-d134-4a6c-9bc4-9dcf7b019162 for instance with vm_state active and task_state deleting.
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0ab4cadd-3757-469b-a253-5a730392f9ec) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: INFO os_vif [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:4a:cf,bridge_name='br-int',has_traffic_filtering=True,id=7a891d10-f2c1-4a8e-b404-67372485e9a5,network=Network(bf07d779-8fb7-4791-aee6-823fcbba0098),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a891d10-f2')
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1515147318',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1515147318',id=20,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLABp92B+QoSjO3Nxzym0L9AU1hs81rZrESUgnXLnvRsbfhOgXiJY51Pu/5sRkfV5DsnzijnsLpzT1f3eDANWTNGJryO8rMim4GO2hLFZkVjWYfIyLmQ5BqB2NrgQeAsMw==',key_name='tempest-keypair-755591069',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:24:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='318ca7ad8bc84749ab0d0fb1e8aa34e6',ramdisk_id='',reservation_id='r-woffnt4p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-310720617',owner_user_name='tempest-TaggedBootDevicesTest_v242-310720617-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:24:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c369909d6cb47cfaad8670df22f4e67',uuid=6bf0a828-329b-46cf-aa76-bf6c24f08212,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "362dc737-7651-44c0-a618-ed6a1bcbee5c", "address": "fa:16:3e:da:3e:bf", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap362dc737-76", "ovs_interfaceid": "362dc737-7651-44c0-a618-ed6a1bcbee5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converting VIF {"id": "362dc737-7651-44c0-a618-ed6a1bcbee5c", "address": "fa:16:3e:da:3e:bf", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap362dc737-76", "ovs_interfaceid": "362dc737-7651-44c0-a618-ed6a1bcbee5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:3e:bf,bridge_name='br-int',has_traffic_filtering=True,id=362dc737-7651-44c0-a618-ed6a1bcbee5c,network=Network(bf07d779-8fb7-4791-aee6-823fcbba0098),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap362dc737-76') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG os_vif [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:3e:bf,bridge_name='br-int',has_traffic_filtering=True,id=362dc737-7651-44c0-a618-ed6a1bcbee5c,network=Network(bf07d779-8fb7-4791-aee6-823fcbba0098),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap362dc737-76') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap362dc737-76, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ecf26110-c107-4ac1-aebb-67145ed4c496) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: INFO os_vif [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:3e:bf,bridge_name='br-int',has_traffic_filtering=True,id=362dc737-7651-44c0-a618-ed6a1bcbee5c,network=Network(bf07d779-8fb7-4791-aee6-823fcbba0098),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap362dc737-76')
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1515147318',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1515147318',id=20,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLABp92B+QoSjO3Nxzym0L9AU1hs81rZrESUgnXLnvRsbfhOgXiJY51Pu/5sRkfV5DsnzijnsLpzT1f3eDANWTNGJryO8rMim4GO2hLFZkVjWYfIyLmQ5BqB2NrgQeAsMw==',key_name='tempest-keypair-755591069',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:24:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='318ca7ad8bc84749ab0d0fb1e8aa34e6',ramdisk_id='',reservation_id='r-woffnt4p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-310720617',owner_user_name='tempest-TaggedBootDevicesTest_v242-310720617-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:24:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c369909d6cb47cfaad8670df22f4e67',uuid=6bf0a828-329b-46cf-aa76-bf6c24f08212,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb4d8798-73e9-4b84-91f1-8a6578f22ac1", "address": "fa:16:3e:da:66:49", "network": {"id": "af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-211886922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4d8798-73", "ovs_interfaceid": "eb4d8798-73e9-4b84-91f1-8a6578f22ac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converting VIF {"id": "eb4d8798-73e9-4b84-91f1-8a6578f22ac1", "address": "fa:16:3e:da:66:49", "network": {"id": "af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-211886922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4d8798-73", "ovs_interfaceid": "eb4d8798-73e9-4b84-91f1-8a6578f22ac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:66:49,bridge_name='br-int',has_traffic_filtering=True,id=eb4d8798-73e9-4b84-91f1-8a6578f22ac1,network=Network(af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb4d8798-73') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG os_vif [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:66:49,bridge_name='br-int',has_traffic_filtering=True,id=eb4d8798-73e9-4b84-91f1-8a6578f22ac1,network=Network(af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb4d8798-73') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb4d8798-73, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=52518e8d-2fe8-4640-8e68-2a81857e4878) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: INFO os_vif [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:66:49,bridge_name='br-int',has_traffic_filtering=True,id=eb4d8798-73e9-4b84-91f1-8a6578f22ac1,network=Network(af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb4d8798-73')
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T15:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1515147318',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1515147318',id=20,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLABp92B+QoSjO3Nxzym0L9AU1hs81rZrESUgnXLnvRsbfhOgXiJY51Pu/5sRkfV5DsnzijnsLpzT1f3eDANWTNGJryO8rMim4GO2hLFZkVjWYfIyLmQ5BqB2NrgQeAsMw==',key_name='tempest-keypair-755591069',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:24:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='318ca7ad8bc84749ab0d0fb1e8aa34e6',ramdisk_id='',reservation_id='r-woffnt4p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-310720617',owner_user_name='tempest-TaggedBootDevicesTest_v242-310720617-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:24:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c369909d6cb47cfaad8670df22f4e67',uuid=6bf0a828-329b-46cf-aa76-bf6c24f08212,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "510c5cfb-99de-4b45-aa65-a1c7a53969ea", "address": "fa:16:3e:34:62:97", "network": {"id": "af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-211886922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap510c5cfb-99", "ovs_interfaceid": "510c5cfb-99de-4b45-aa65-a1c7a53969ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converting VIF {"id": "510c5cfb-99de-4b45-aa65-a1c7a53969ea", "address": "fa:16:3e:34:62:97", "network": {"id": "af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-211886922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap510c5cfb-99", "ovs_interfaceid": "510c5cfb-99de-4b45-aa65-a1c7a53969ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:62:97,bridge_name='br-int',has_traffic_filtering=True,id=510c5cfb-99de-4b45-aa65-a1c7a53969ea,network=Network(af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap510c5cfb-99') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG os_vif [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:62:97,bridge_name='br-int',has_traffic_filtering=True,id=510c5cfb-99de-4b45-aa65-a1c7a53969ea,network=Network(af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap510c5cfb-99') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap510c5cfb-99, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0049a98f-45c0-4d39-aabe-36c29a8d225c) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:07 user nova-compute[75080]: INFO os_vif [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:62:97,bridge_name='br-int',has_traffic_filtering=True,id=510c5cfb-99de-4b45-aa65-a1c7a53969ea,network=Network(af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap510c5cfb-99')
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oirgbPSx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:26:07 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:26:07 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2795b8f-38c4-43ad-bcf7-55af7676b587]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:26:07 user nova-compute[75080]: No targets found.
Dec 05 15:26:07 user nova-compute[75080]: iSNS:
Dec 05 15:26:07 user nova-compute[75080]: No targets found.
Dec 05 15:26:07 user nova-compute[75080]: STATIC:
Dec 05 15:26:07 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c
Dec 05 15:26:07 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:26:07 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:26:07 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc
Dec 05 15:26:07 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:26:07 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:26:07 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399
Dec 05 15:26:07 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:26:07 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:26:07 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb
Dec 05 15:26:07 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:26:07 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:26:07 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598
Dec 05 15:26:07 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:26:07 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:26:07 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989
Dec 05 15:26:07 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:26:07 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:26:07 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067
Dec 05 15:26:07 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:26:07 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:26:07 user nova-compute[75080]: FIRMWARE:
Dec 05 15:26:07 user nova-compute[75080]: No targets found.
Dec 05 15:26:07 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:26:07 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:26:07 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b705c1b6-1ff6-4dad-9def-5f6578f6c649]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e0fb23-6faa-475a-8416-92e7772646c9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:26:07 user nova-compute[75080]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb (non-flash)
Dec 05 15:26:07 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:26:07 user nova-compute[75080]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 (non-flash)
Dec 05 15:26:07 user nova-compute[75080]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c (non-flash)
Dec 05 15:26:07 user nova-compute[75080]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc (non-flash)
Dec 05 15:26:07 user nova-compute[75080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:26:07 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:26:07 user nova-compute[75080]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb (non-flash)
Dec 05 15:26:07 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:26:07 user nova-compute[75080]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 (non-flash)
Dec 05 15:26:07 user nova-compute[75080]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c (non-flash)
Dec 05 15:26:07 user nova-compute[75080]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc (non-flash)
Dec 05 15:26:07 user nova-compute[75080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:26:07 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f66383db7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb'): ({'sdc'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Removing single pathed devices sdc {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1daa62f6-2e59-4b03-8589-80bc5eed1671]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a9480d-431a-4f24-ace4-c29da05721bb]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Flushing IO for device /dev/sdc {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.034s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6266252-3192-4703-bdc0-727b6dfca8b2]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-plugged-58b3e25c-cbd6-4bdd-83e8-775a0708df4e {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] Acquiring lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] No waiting events found dispatching network-vif-plugged-58b3e25c-cbd6-4bdd-83e8-775a0708df4e {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:26:07 user nova-compute[75080]: WARNING nova.compute.manager [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received unexpected event network-vif-plugged-58b3e25c-cbd6-4bdd-83e8-775a0708df4e for instance with vm_state active and task_state deleting.
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-unplugged-7a891d10-f2c1-4a8e-b404-67372485e9a5 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] Acquiring lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] No waiting events found dispatching network-vif-unplugged-7a891d10-f2c1-4a8e-b404-67372485e9a5 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-unplugged-7a891d10-f2c1-4a8e-b404-67372485e9a5 for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-plugged-7a891d10-f2c1-4a8e-b404-67372485e9a5 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] Acquiring lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] No waiting events found dispatching network-vif-plugged-7a891d10-f2c1-4a8e-b404-67372485e9a5 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:26:07 user nova-compute[75080]: WARNING nova.compute.manager [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received unexpected event network-vif-plugged-7a891d10-f2c1-4a8e-b404-67372485e9a5 for instance with vm_state active and task_state deleting.
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-unplugged-362dc737-7651-44c0-a618-ed6a1bcbee5c {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] Acquiring lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] No waiting events found dispatching network-vif-unplugged-362dc737-7651-44c0-a618-ed6a1bcbee5c {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-unplugged-362dc737-7651-44c0-a618-ed6a1bcbee5c for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-plugged-362dc737-7651-44c0-a618-ed6a1bcbee5c {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] Acquiring lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] No waiting events found dispatching network-vif-plugged-362dc737-7651-44c0-a618-ed6a1bcbee5c {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:26:07 user nova-compute[75080]: WARNING nova.compute.manager [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received unexpected event network-vif-plugged-362dc737-7651-44c0-a618-ed6a1bcbee5c for instance with vm_state active and task_state deleting.
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-unplugged-eb4d8798-73e9-4b84-91f1-8a6578f22ac1 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] Acquiring lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] No waiting events found dispatching network-vif-unplugged-eb4d8798-73e9-4b84-91f1-8a6578f22ac1 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-unplugged-eb4d8798-73e9-4b84-91f1-8a6578f22ac1 for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-plugged-eb4d8798-73e9-4b84-91f1-8a6578f22ac1 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] Acquiring lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] No waiting events found dispatching network-vif-plugged-eb4d8798-73e9-4b84-91f1-8a6578f22ac1 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:26:07 user nova-compute[75080]: WARNING nova.compute.manager [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received unexpected event network-vif-plugged-eb4d8798-73e9-4b84-91f1-8a6578f22ac1 for instance with vm_state active and task_state deleting.
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-unplugged-510c5cfb-99de-4b45-aa65-a1c7a53969ea {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] Acquiring lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] No waiting events found dispatching network-vif-unplugged-510c5cfb-99de-4b45-aa65-a1c7a53969ea {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-unplugged-510c5cfb-99de-4b45-aa65-a1c7a53969ea for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-plugged-510c5cfb-99de-4b45-aa65-a1c7a53969ea {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] Acquiring lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] No waiting events found dispatching network-vif-plugged-510c5cfb-99de-4b45-aa65-a1c7a53969ea {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:26:07 user nova-compute[75080]: WARNING nova.compute.manager [req-2c7570e3-b33e-4df7-901f-4694654297da req-9497b697-c904-4716-88fb-a60c5f3cf4dc service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received unexpected event network-vif-plugged-510c5cfb-99de-4b45-aa65-a1c7a53969ea for instance with vm_state active and task_state deleting.
Dec 05 15:26:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-16eb9a4c-6ad5-4956-9bf1-0e77d6a0ee4c req-6a1f055a-b607-4be3-96a2-9cae353da95b service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Received event network-vif-plugged-af017697-07fb-4000-87d4-87f84dbd53bc {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-16eb9a4c-6ad5-4956-9bf1-0e77d6a0ee4c req-6a1f055a-b607-4be3-96a2-9cae353da95b service nova] Acquiring lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-16eb9a4c-6ad5-4956-9bf1-0e77d6a0ee4c req-6a1f055a-b607-4be3-96a2-9cae353da95b service nova] Lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-16eb9a4c-6ad5-4956-9bf1-0e77d6a0ee4c req-6a1f055a-b607-4be3-96a2-9cae353da95b service nova] Lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG nova.compute.manager [req-16eb9a4c-6ad5-4956-9bf1-0e77d6a0ee4c req-6a1f055a-b607-4be3-96a2-9cae353da95b service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] No waiting events found dispatching network-vif-plugged-af017697-07fb-4000-87d4-87f84dbd53bc {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:26:08 user nova-compute[75080]: WARNING nova.compute.manager [req-16eb9a4c-6ad5-4956-9bf1-0e77d6a0ee4c req-6a1f055a-b607-4be3-96a2-9cae353da95b service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Received unexpected event network-vif-plugged-af017697-07fb-4000-87d4-87f84dbd53bc for instance with vm_state building and task_state spawning.
Dec 05 15:26:08 user nova-compute[75080]: DEBUG nova.compute.manager [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc41767-5935-4b21-9be4-dddda985b4e2]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] SCSI volumes sdc have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:08 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Instance spawned successfully.
Dec 05 15:26:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c175f9-1158-4df2-b38d-1ecfc5ba682b]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f40f8d-981c-4dc5-98c6-ba026b5e2f6c]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb, portal: 172.16.0.220,3260]
Dec 05 15:26:08 user nova-compute[75080]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb, portal: 172.16.0.220,3260] successful.
Dec 05 15:26:08 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:08 user nova-compute[75080]: INFO nova.compute.manager [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Took 5.37 seconds to spawn the instance on the hypervisor.
Dec 05 15:26:08 user nova-compute[75080]: DEBUG nova.compute.manager [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0d9ab59-291a-4fec-9c4c-f11d6f37a6fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cba326-8789-41b8-ab5f-3eb1805913c4]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] <== disconnect_volume: return (383ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BiaLEflD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:26:08 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a357688b-4570-420d-a5aa-49b2ec99d843]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:26:08 user nova-compute[75080]: No targets found.
Dec 05 15:26:08 user nova-compute[75080]: iSNS:
Dec 05 15:26:08 user nova-compute[75080]: No targets found.
Dec 05 15:26:08 user nova-compute[75080]: STATIC:
Dec 05 15:26:08 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c
Dec 05 15:26:08 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:26:08 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:26:08 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc
Dec 05 15:26:08 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:26:08 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:26:08 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399
Dec 05 15:26:08 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:26:08 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:26:08 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598
Dec 05 15:26:08 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:26:08 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:26:08 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989
Dec 05 15:26:08 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:26:08 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:26:08 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067
Dec 05 15:26:08 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:26:08 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:26:08 user nova-compute[75080]: FIRMWARE:
Dec 05 15:26:08 user nova-compute[75080]: No targets found.
Dec 05 15:26:08 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:26:08 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:26:08 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:08 user nova-compute[75080]: INFO nova.compute.manager [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Took 21.52 seconds to build instance.
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d19a869-8ec0-4480-9f43-cc04ed009eed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-99b98e89-a23a-411e-9b53-04377ef17bc2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.665s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1ecaf7-5184-45df-8520-dee8740dc372]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:26:08 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:26:08 user nova-compute[75080]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 (non-flash)
Dec 05 15:26:08 user nova-compute[75080]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c (non-flash)
Dec 05 15:26:08 user nova-compute[75080]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc (non-flash)
Dec 05 15:26:08 user nova-compute[75080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:26:08 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:26:08 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:26:08 user nova-compute[75080]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 (non-flash)
Dec 05 15:26:08 user nova-compute[75080]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c (non-flash)
Dec 05 15:26:08 user nova-compute[75080]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc (non-flash)
Dec 05 15:26:08 user nova-compute[75080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:26:08 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f665c344dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067'): ({'sde'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Removing single pathed devices sde {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[71db0a97-bfa2-4815-af74-bcc162c452cc]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[33914924-b405-4398-8778-ac95f6228bb2]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Flushing IO for device /dev/sde {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde65a8c-a7af-4860-abdd-86dbc52665b7]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5dca44c-c913-49c1-be4a-0917ca98c574]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] SCSI volumes sde have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[af42e887-21ee-4f5a-84af-ef51dfeb09ab]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfc13a5-469a-4f5c-b522-d9b2d8b3efcc]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067, portal: 172.16.0.220,3260]
Dec 05 15:26:08 user nova-compute[75080]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067, portal: 172.16.0.220,3260] successful.
Dec 05 15:26:08 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1398ce-f855-4e97-9099-e4d050c59067 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c12a959-a026-4c54-a2ac-3fb09c106527]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] <== disconnect_volume: return (343ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yPfSVKjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:26:08 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e81ba2-2e4f-46be-989e-c922bb520f3b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:26:08 user nova-compute[75080]: No targets found.
Dec 05 15:26:08 user nova-compute[75080]: iSNS:
Dec 05 15:26:08 user nova-compute[75080]: No targets found.
Dec 05 15:26:08 user nova-compute[75080]: STATIC:
Dec 05 15:26:08 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c
Dec 05 15:26:08 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:26:08 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:26:08 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc
Dec 05 15:26:08 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:26:08 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:26:08 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399
Dec 05 15:26:08 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:26:08 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:26:08 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598
Dec 05 15:26:08 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:26:08 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:26:08 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989
Dec 05 15:26:08 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:26:08 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:26:08 user nova-compute[75080]: FIRMWARE:
Dec 05 15:26:08 user nova-compute[75080]: No targets found.
Dec 05 15:26:08 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:26:08 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:26:08 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf648214-10ed-4cb7-b3cf-065451c5dbab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf30c5e-e160-4480-9866-45b3d74037c6]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:26:08 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:26:08 user nova-compute[75080]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c (non-flash)
Dec 05 15:26:08 user nova-compute[75080]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc (non-flash)
Dec 05 15:26:08 user nova-compute[75080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:26:08 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:26:08 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:26:08 user nova-compute[75080]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c (non-flash)
Dec 05 15:26:08 user nova-compute[75080]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc (non-flash)
Dec 05 15:26:08 user nova-compute[75080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:26:08 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f665c344dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c'): ({'sdf'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Removing single pathed devices sdf {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2889b5-6200-4b2b-9edd-3112aa1afa47]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5e3930-f6dd-40c7-a453-a787535860af]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Flushing IO for device /dev/sdf {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19759e0-4f04-4dd1-9275-6cfe684a73be]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3616381-a94b-4f79-abfe-8f8768b357d5]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] SCSI volumes sdf have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff88b479-a8fe-49c3-976c-65cf4e964638]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4a6c75-4198-4f36-8d50-a69be0583abe]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c, portal: 172.16.0.220,3260]
Dec 05 15:26:08 user nova-compute[75080]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c, portal: 172.16.0.220,3260] successful.
Dec 05 15:26:08 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a13dc1-2688-4c91-a77f-8b79f94d6b0c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad68e60-a8fc-47f5-8c0d-6821325faa75]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] <== disconnect_volume: return (319ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:26:08 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Deleting instance files /opt/stack/data/nova/instances/6bf0a828-329b-46cf-aa76-bf6c24f08212_del
Dec 05 15:26:08 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Deletion of /opt/stack/data/nova/instances/6bf0a828-329b-46cf-aa76-bf6c24f08212_del complete
Dec 05 15:26:08 user nova-compute[75080]: INFO nova.compute.manager [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Took 3.67 seconds to destroy the instance on the hypervisor.
Dec 05 15:26:08 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:26:08 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:26:10 user nova-compute[75080]: DEBUG nova.compute.manager [req-ac4bf09b-3664-4aeb-88b4-2a232f9a5fec req-1ed3a7b0-2a0b-4539-b2bb-75b0179a8f4c service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-deleted-7a891d10-f2c1-4a8e-b404-67372485e9a5 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:26:10 user nova-compute[75080]: INFO nova.compute.manager [req-ac4bf09b-3664-4aeb-88b4-2a232f9a5fec req-1ed3a7b0-2a0b-4539-b2bb-75b0179a8f4c service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Neutron deleted interface 7a891d10-f2c1-4a8e-b404-67372485e9a5; detaching it from the instance and deleting it from the info cache
Dec 05 15:26:10 user nova-compute[75080]: DEBUG nova.network.neutron [req-ac4bf09b-3664-4aeb-88b4-2a232f9a5fec req-1ed3a7b0-2a0b-4539-b2bb-75b0179a8f4c service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Updating instance_info_cache with network_info: [{"id": "0250593a-4991-4e30-9e86-4f403f81bbe6", "address": "fa:16:3e:64:7a:bd", "network": {"id": "0e5b22b3-949b-4958-8500-8730f46ffb1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2105495982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0250593a-49", "ovs_interfaceid": "0250593a-4991-4e30-9e86-4f403f81bbe6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "70683181-d134-4a6c-9bc4-9dcf7b019162", "address": "fa:16:3e:d6:c5:60", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70683181-d1", "ovs_interfaceid": "70683181-d134-4a6c-9bc4-9dcf7b019162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "58b3e25c-cbd6-4bdd-83e8-775a0708df4e", "address": "fa:16:3e:40:ba:74", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b3e25c-cb", "ovs_interfaceid": "58b3e25c-cbd6-4bdd-83e8-775a0708df4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "362dc737-7651-44c0-a618-ed6a1bcbee5c", "address": "fa:16:3e:da:3e:bf", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap362dc737-76", "ovs_interfaceid": "362dc737-7651-44c0-a618-ed6a1bcbee5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb4d8798-73e9-4b84-91f1-8a6578f22ac1", "address": "fa:16:3e:da:66:49", "network": {"id": "af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-211886922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4d8798-73", "ovs_interfaceid": "eb4d8798-73e9-4b84-91f1-8a6578f22ac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "510c5cfb-99de-4b45-aa65-a1c7a53969ea", "address": "fa:16:3e:34:62:97", "network": {"id": "af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-211886922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap510c5cfb-99", "ovs_interfaceid": "510c5cfb-99de-4b45-aa65-a1c7a53969ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:26:10 user nova-compute[75080]: DEBUG nova.compute.manager [req-ac4bf09b-3664-4aeb-88b4-2a232f9a5fec req-1ed3a7b0-2a0b-4539-b2bb-75b0179a8f4c service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Detach interface failed, port_id=7a891d10-f2c1-4a8e-b404-67372485e9a5, reason: Instance 6bf0a828-329b-46cf-aa76-bf6c24f08212 could not be found. {{(pid=75080) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 15:26:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:12 user nova-compute[75080]: DEBUG nova.compute.manager [req-b039b6ad-0505-499a-9926-f82a183e8624 req-adf2949b-11b5-4394-a209-68722fa3d11a service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-deleted-0250593a-4991-4e30-9e86-4f403f81bbe6 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:26:12 user nova-compute[75080]: INFO nova.compute.manager [req-b039b6ad-0505-499a-9926-f82a183e8624 req-adf2949b-11b5-4394-a209-68722fa3d11a service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Neutron deleted interface 0250593a-4991-4e30-9e86-4f403f81bbe6; detaching it from the instance and deleting it from the info cache
Dec 05 15:26:12 user nova-compute[75080]: DEBUG nova.network.neutron [req-b039b6ad-0505-499a-9926-f82a183e8624 req-adf2949b-11b5-4394-a209-68722fa3d11a service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Updating instance_info_cache with network_info: [{"id": "70683181-d134-4a6c-9bc4-9dcf7b019162", "address": "fa:16:3e:d6:c5:60", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70683181-d1", "ovs_interfaceid": "70683181-d134-4a6c-9bc4-9dcf7b019162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "58b3e25c-cbd6-4bdd-83e8-775a0708df4e", "address": "fa:16:3e:40:ba:74", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b3e25c-cb", "ovs_interfaceid": "58b3e25c-cbd6-4bdd-83e8-775a0708df4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "362dc737-7651-44c0-a618-ed6a1bcbee5c", "address": "fa:16:3e:da:3e:bf", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap362dc737-76", "ovs_interfaceid": "362dc737-7651-44c0-a618-ed6a1bcbee5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb4d8798-73e9-4b84-91f1-8a6578f22ac1", "address": "fa:16:3e:da:66:49", "network": {"id": "af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-211886922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4d8798-73", "ovs_interfaceid": "eb4d8798-73e9-4b84-91f1-8a6578f22ac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "510c5cfb-99de-4b45-aa65-a1c7a53969ea", "address": "fa:16:3e:34:62:97", "network": {"id": "af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-211886922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap510c5cfb-99", "ovs_interfaceid": "510c5cfb-99de-4b45-aa65-a1c7a53969ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:26:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:12 user nova-compute[75080]: DEBUG nova.compute.manager [req-b039b6ad-0505-499a-9926-f82a183e8624 req-adf2949b-11b5-4394-a209-68722fa3d11a service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Detach interface failed, port_id=0250593a-4991-4e30-9e86-4f403f81bbe6, reason: Instance 6bf0a828-329b-46cf-aa76-bf6c24f08212 could not be found. {{(pid=75080) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 15:26:12 user nova-compute[75080]: DEBUG nova.compute.manager [req-b039b6ad-0505-499a-9926-f82a183e8624 req-adf2949b-11b5-4394-a209-68722fa3d11a service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-deleted-362dc737-7651-44c0-a618-ed6a1bcbee5c {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:26:12 user nova-compute[75080]: INFO nova.compute.manager [req-b039b6ad-0505-499a-9926-f82a183e8624 req-adf2949b-11b5-4394-a209-68722fa3d11a service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Neutron deleted interface 362dc737-7651-44c0-a618-ed6a1bcbee5c; detaching it from the instance and deleting it from the info cache
Dec 05 15:26:12 user nova-compute[75080]: DEBUG nova.network.neutron [req-b039b6ad-0505-499a-9926-f82a183e8624 req-adf2949b-11b5-4394-a209-68722fa3d11a service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Updating instance_info_cache with network_info: [{"id": "70683181-d134-4a6c-9bc4-9dcf7b019162", "address": "fa:16:3e:d6:c5:60", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70683181-d1", "ovs_interfaceid": "70683181-d134-4a6c-9bc4-9dcf7b019162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "58b3e25c-cbd6-4bdd-83e8-775a0708df4e", "address": "fa:16:3e:40:ba:74", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b3e25c-cb", "ovs_interfaceid": "58b3e25c-cbd6-4bdd-83e8-775a0708df4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eb4d8798-73e9-4b84-91f1-8a6578f22ac1", "address": "fa:16:3e:da:66:49", "network": {"id": "af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-211886922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4d8798-73", "ovs_interfaceid": "eb4d8798-73e9-4b84-91f1-8a6578f22ac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "510c5cfb-99de-4b45-aa65-a1c7a53969ea", "address": "fa:16:3e:34:62:97", "network": {"id": "af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-211886922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap510c5cfb-99", "ovs_interfaceid": "510c5cfb-99de-4b45-aa65-a1c7a53969ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:26:12 user nova-compute[75080]: DEBUG nova.compute.manager [req-b039b6ad-0505-499a-9926-f82a183e8624 req-adf2949b-11b5-4394-a209-68722fa3d11a service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Detach interface failed, port_id=362dc737-7651-44c0-a618-ed6a1bcbee5c, reason: Instance 6bf0a828-329b-46cf-aa76-bf6c24f08212 could not be found. {{(pid=75080) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 15:26:12 user nova-compute[75080]: DEBUG nova.compute.manager [req-b039b6ad-0505-499a-9926-f82a183e8624 req-adf2949b-11b5-4394-a209-68722fa3d11a service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-deleted-510c5cfb-99de-4b45-aa65-a1c7a53969ea {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:26:12 user nova-compute[75080]: INFO nova.compute.manager [req-b039b6ad-0505-499a-9926-f82a183e8624 req-adf2949b-11b5-4394-a209-68722fa3d11a service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Neutron deleted interface 510c5cfb-99de-4b45-aa65-a1c7a53969ea; detaching it from the instance and deleting it from the info cache
Dec 05 15:26:12 user nova-compute[75080]: DEBUG nova.network.neutron [req-b039b6ad-0505-499a-9926-f82a183e8624 req-adf2949b-11b5-4394-a209-68722fa3d11a service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Updating instance_info_cache with network_info: [{"id": "70683181-d134-4a6c-9bc4-9dcf7b019162", "address": "fa:16:3e:d6:c5:60", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70683181-d1", "ovs_interfaceid": "70683181-d134-4a6c-9bc4-9dcf7b019162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "58b3e25c-cbd6-4bdd-83e8-775a0708df4e", "address": "fa:16:3e:40:ba:74", "network": {"id": "bf07d779-8fb7-4791-aee6-823fcbba0098", "bridge": "br-int", "label": "tempest-device-tagging-net1-572321596", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b3e25c-cb", "ovs_interfaceid": "58b3e25c-cbd6-4bdd-83e8-775a0708df4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eb4d8798-73e9-4b84-91f1-8a6578f22ac1", "address": "fa:16:3e:da:66:49", "network": {"id": "af0f99ae-3d96-4ebe-946a-8d63b1a2fa8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-211886922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "318ca7ad8bc84749ab0d0fb1e8aa34e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4d8798-73", "ovs_interfaceid": "eb4d8798-73e9-4b84-91f1-8a6578f22ac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:26:12 user nova-compute[75080]: DEBUG nova.compute.manager [req-b039b6ad-0505-499a-9926-f82a183e8624 req-adf2949b-11b5-4394-a209-68722fa3d11a service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Detach interface failed, port_id=510c5cfb-99de-4b45-aa65-a1c7a53969ea, reason: Instance 6bf0a828-329b-46cf-aa76-bf6c24f08212 could not be found. {{(pid=75080) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 15:26:12 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:26:12 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Took 3.98 seconds to deallocate network for instance.
Dec 05 15:26:13 user nova-compute[75080]: DEBUG nova.compute.manager [req-c20b93e1-2d72-42d2-b12c-e75b02b3d72c req-c041918a-8b8b-463e-a5c1-f4c4622b5782 service nova] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Received event network-changed-d41ca18b-b2d5-46dc-a5f4-410b315986b6 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:26:13 user nova-compute[75080]: DEBUG nova.compute.manager [req-c20b93e1-2d72-42d2-b12c-e75b02b3d72c req-c041918a-8b8b-463e-a5c1-f4c4622b5782 service nova] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Refreshing instance network info cache due to event network-changed-d41ca18b-b2d5-46dc-a5f4-410b315986b6. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:26:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c20b93e1-2d72-42d2-b12c-e75b02b3d72c req-c041918a-8b8b-463e-a5c1-f4c4622b5782 service nova] Acquiring lock "refresh_cache-f425241c-0a1d-44fa-affc-9e40974b290d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:26:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c20b93e1-2d72-42d2-b12c-e75b02b3d72c req-c041918a-8b8b-463e-a5c1-f4c4622b5782 service nova] Acquired lock "refresh_cache-f425241c-0a1d-44fa-affc-9e40974b290d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:26:13 user nova-compute[75080]: DEBUG nova.network.neutron [req-c20b93e1-2d72-42d2-b12c-e75b02b3d72c req-c041918a-8b8b-463e-a5c1-f4c4622b5782 service nova] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Refreshing network info cache for port d41ca18b-b2d5-46dc-a5f4-410b315986b6 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:26:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "f425241c-0a1d-44fa-affc-9e40974b290d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "f425241c-0a1d-44fa-affc-9e40974b290d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "f425241c-0a1d-44fa-affc-9e40974b290d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "f425241c-0a1d-44fa-affc-9e40974b290d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "f425241c-0a1d-44fa-affc-9e40974b290d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:13 user nova-compute[75080]: DEBUG nova.network.neutron [req-c20b93e1-2d72-42d2-b12c-e75b02b3d72c req-c041918a-8b8b-463e-a5c1-f4c4622b5782 service nova] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Updated VIF entry in instance network info cache for port d41ca18b-b2d5-46dc-a5f4-410b315986b6. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:26:13 user nova-compute[75080]: DEBUG nova.network.neutron [req-c20b93e1-2d72-42d2-b12c-e75b02b3d72c req-c041918a-8b8b-463e-a5c1-f4c4622b5782 service nova] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Updating instance_info_cache with network_info: [{"id": "d41ca18b-b2d5-46dc-a5f4-410b315986b6", "address": "fa:16:3e:93:e2:a8", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd41ca18b-b2", "ovs_interfaceid": "d41ca18b-b2d5-46dc-a5f4-410b315986b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:26:13 user nova-compute[75080]: INFO nova.compute.manager [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Terminating instance
Dec 05 15:26:13 user nova-compute[75080]: DEBUG nova.compute.manager [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:26:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c20b93e1-2d72-42d2-b12c-e75b02b3d72c req-c041918a-8b8b-463e-a5c1-f4c4622b5782 service nova] Releasing lock "refresh_cache-f425241c-0a1d-44fa-affc-9e40974b290d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:26:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG nova.compute.manager [req-8f48adde-aac8-4e93-8859-24c1a765c6a8 req-7c500446-0c29-45b8-90fd-9b60c1edb54b service nova] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Received event network-vif-unplugged-d41ca18b-b2d5-46dc-a5f4-410b315986b6 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8f48adde-aac8-4e93-8859-24c1a765c6a8 req-7c500446-0c29-45b8-90fd-9b60c1edb54b service nova] Acquiring lock "f425241c-0a1d-44fa-affc-9e40974b290d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8f48adde-aac8-4e93-8859-24c1a765c6a8 req-7c500446-0c29-45b8-90fd-9b60c1edb54b service nova] Lock "f425241c-0a1d-44fa-affc-9e40974b290d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8f48adde-aac8-4e93-8859-24c1a765c6a8 req-7c500446-0c29-45b8-90fd-9b60c1edb54b service nova] Lock "f425241c-0a1d-44fa-affc-9e40974b290d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG nova.compute.manager [req-8f48adde-aac8-4e93-8859-24c1a765c6a8 req-7c500446-0c29-45b8-90fd-9b60c1edb54b service nova] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] No waiting events found dispatching network-vif-unplugged-d41ca18b-b2d5-46dc-a5f4-410b315986b6 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG nova.compute.manager [req-8f48adde-aac8-4e93-8859-24c1a765c6a8 req-7c500446-0c29-45b8-90fd-9b60c1edb54b service nova] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Received event network-vif-unplugged-d41ca18b-b2d5-46dc-a5f4-410b315986b6 for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:26:14 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Instance destroyed successfully.
Dec 05 15:26:14 user nova-compute[75080]: DEBUG nova.objects.instance [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lazy-loading 'resources' on Instance uuid f425241c-0a1d-44fa-affc-9e40974b290d {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1738099649',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1738099649',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1738099649',id=21,image_ref='352419aa-7d60-4170-a438-57a2e09d45b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnnw3KdRZ1MpnVTdLA8PBdGCfDAg1hrSWPfsT0IWonkzIk1pszJEFKRdG6nOkzBtQenW85XFPRQTo69mVQBspktwmS0jXWSKCAdT6NmqrmqjQ8OIB6SQgJ0h/pb3JJP+w==',key_name='tempest-keypair-430281623',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:24:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11227acd507347ae9c5a3bc710707f84',ramdisk_id='',reservation_id='r-kgsdlqix',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-23416231',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-23416231-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-23416231',owner_user_name='tempest-TestVolumeBootPattern-23416231-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:24:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15be5b54cc8346bb86683e4ed2fbba9e',uuid=f425241c-0a1d-44fa-affc-9e40974b290d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d41ca18b-b2d5-46dc-a5f4-410b315986b6", "address": "fa:16:3e:93:e2:a8", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd41ca18b-b2", "ovs_interfaceid": "d41ca18b-b2d5-46dc-a5f4-410b315986b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Converting VIF {"id": "d41ca18b-b2d5-46dc-a5f4-410b315986b6", "address": "fa:16:3e:93:e2:a8", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd41ca18b-b2", "ovs_interfaceid": "d41ca18b-b2d5-46dc-a5f4-410b315986b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:e2:a8,bridge_name='br-int',has_traffic_filtering=True,id=d41ca18b-b2d5-46dc-a5f4-410b315986b6,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd41ca18b-b2') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG os_vif [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:e2:a8,bridge_name='br-int',has_traffic_filtering=True,id=d41ca18b-b2d5-46dc-a5f4-410b315986b6,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd41ca18b-b2') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd41ca18b-b2, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8449af0e-a4b2-43fb-9cab-7e6f049ac661) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:14 user nova-compute[75080]: INFO os_vif [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:e2:a8,bridge_name='br-int',has_traffic_filtering=True,id=d41ca18b-b2d5-46dc-a5f4-410b315986b6,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd41ca18b-b2')
Dec 05 15:26:14 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xpYNQakn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:26:14 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:26:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6dc192-60d3-4221-b54f-0f4b71d507df]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:26:14 user nova-compute[75080]: No targets found.
Dec 05 15:26:14 user nova-compute[75080]: iSNS:
Dec 05 15:26:14 user nova-compute[75080]: No targets found.
Dec 05 15:26:14 user nova-compute[75080]: STATIC:
Dec 05 15:26:14 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc
Dec 05 15:26:14 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:26:14 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:26:14 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399
Dec 05 15:26:14 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:26:14 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:26:14 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598
Dec 05 15:26:14 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:26:14 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:26:14 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989
Dec 05 15:26:14 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:26:14 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:26:14 user nova-compute[75080]: FIRMWARE:
Dec 05 15:26:14 user nova-compute[75080]: No targets found.
Dec 05 15:26:14 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:26:14 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:26:14 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[675fcb7d-f98e-461e-97d2-dbe8c138856c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3dad964-885c-4e4c-bc26-d02b1dcbc46c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:26:14 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:26:14 user nova-compute[75080]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc (non-flash)
Dec 05 15:26:14 user nova-compute[75080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:26:14 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:26:14 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:26:14 user nova-compute[75080]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc (non-flash)
Dec 05 15:26:14 user nova-compute[75080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:26:14 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f663835dd80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc'): ({'sdh'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Removing single pathed devices sdh {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b61ebbd-b7e4-4441-ba0e-88e4ca45effd]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6757eaf5-b980-4a8f-b124-253d070efa82]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Flushing IO for device /dev/sdh {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[489e1e39-d84c-4594-897d-a507bef482ff]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG nova.compute.manager [req-69065391-1616-4c3f-a8c0-85d265c37f23 req-3616b66d-a94c-482e-a12a-4f31141ff299 service nova] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Received event network-vif-deleted-eb4d8798-73e9-4b84-91f1-8a6578f22ac1 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.050s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af4c0f5-1702-4c76-8590-19698e43e095]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] SCSI volumes sdh have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe817f0c7-34e9d10594ecda2e', '/dev/disk/by-id/scsi-23334653964313035', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e817f0c7') {{(pid=86242) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 05 15:26:14 user nova-compute[75080]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOe817f0c7-34e9d10594ecda2e
Dec 05 15:26:14 user nova-compute[75080]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23334653964313035
Dec 05 15:26:14 user nova-compute[75080]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_e817f0c7
Dec 05 15:26:14 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[050253d3-5d1c-45b7-b862-5f6c776dc284]: (4, None) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60cfa44-6b15-47fb-bfd1-0c27cdbcbbe6]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdf74c1-5105-46f3-8b42-e0f0f4737eb3]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc, portal: 172.16.0.220,3260]
Dec 05 15:26:14 user nova-compute[75080]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc, portal: 172.16.0.220,3260] successful.
Dec 05 15:26:14 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fa65be6-f658-43ad-9151-f2a5d3c9f4cc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:15 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5a566e-c78a-485b-8f0e-d4e585683b01]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:15 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:15 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:26:15 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] <== disconnect_volume: return (351ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:26:15 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:26:15 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Deleting instance files /opt/stack/data/nova/instances/f425241c-0a1d-44fa-affc-9e40974b290d_del
Dec 05 15:26:15 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Deletion of /opt/stack/data/nova/instances/f425241c-0a1d-44fa-affc-9e40974b290d_del complete
Dec 05 15:26:15 user nova-compute[75080]: INFO nova.compute.manager [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Took 1.27 seconds to destroy the instance on the hypervisor.
Dec 05 15:26:15 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:26:15 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:26:15 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:26:15 user nova-compute[75080]: INFO nova.compute.manager [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] [instance: 6bf0a828-329b-46cf-aa76-bf6c24f08212] Took 2.51 seconds to detach 3 volumes for instance.
Dec 05 15:26:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:15 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:26:15 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:26:15 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:26:15 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Took 0.84 seconds to deallocate network for instance.
Dec 05 15:26:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.504s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:15 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Deleted allocations for instance 6bf0a828-329b-46cf-aa76-bf6c24f08212
Dec 05 15:26:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-086d897f-fab0-4788-8fe5-71e0b09559be tempest-TaggedBootDevicesTest_v242-310720617 tempest-TaggedBootDevicesTest_v242-310720617-project-member] Lock "6bf0a828-329b-46cf-aa76-bf6c24f08212" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.858s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:16 user nova-compute[75080]: DEBUG nova.compute.manager [req-038e322f-51a2-4ab9-8255-c2db3f25a901 req-a3b7a8cf-4b27-4e94-9e2b-e67716e5e1c9 service nova] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Received event network-vif-plugged-d41ca18b-b2d5-46dc-a5f4-410b315986b6 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:26:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-038e322f-51a2-4ab9-8255-c2db3f25a901 req-a3b7a8cf-4b27-4e94-9e2b-e67716e5e1c9 service nova] Acquiring lock "f425241c-0a1d-44fa-affc-9e40974b290d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-038e322f-51a2-4ab9-8255-c2db3f25a901 req-a3b7a8cf-4b27-4e94-9e2b-e67716e5e1c9 service nova] Lock "f425241c-0a1d-44fa-affc-9e40974b290d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-038e322f-51a2-4ab9-8255-c2db3f25a901 req-a3b7a8cf-4b27-4e94-9e2b-e67716e5e1c9 service nova] Lock "f425241c-0a1d-44fa-affc-9e40974b290d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:16 user nova-compute[75080]: DEBUG nova.compute.manager [req-038e322f-51a2-4ab9-8255-c2db3f25a901 req-a3b7a8cf-4b27-4e94-9e2b-e67716e5e1c9 service nova] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] No waiting events found dispatching network-vif-plugged-d41ca18b-b2d5-46dc-a5f4-410b315986b6 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:26:16 user nova-compute[75080]: WARNING nova.compute.manager [req-038e322f-51a2-4ab9-8255-c2db3f25a901 req-a3b7a8cf-4b27-4e94-9e2b-e67716e5e1c9 service nova] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Received unexpected event network-vif-plugged-d41ca18b-b2d5-46dc-a5f4-410b315986b6 for instance with vm_state active and task_state deleting.
Dec 05 15:26:16 user nova-compute[75080]: INFO nova.compute.manager [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Took 0.95 seconds to detach 1 volumes for instance.
Dec 05 15:26:16 user nova-compute[75080]: DEBUG nova.compute.manager [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Deleting volume: 0fa65be6-f658-43ad-9151-f2a5d3c9f4cc {{(pid=75080) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 05 15:26:16 user nova-compute[75080]: DEBUG nova.compute.manager [req-dae207be-c830-4d76-8651-540faa635ae9 req-271ddd6e-a703-43ce-823d-66dc98e0e22a service nova] [instance: f425241c-0a1d-44fa-affc-9e40974b290d] Received event network-vif-deleted-d41ca18b-b2d5-46dc-a5f4-410b315986b6 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:26:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:17 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:26:17 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:26:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:17 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Deleted allocations for instance f425241c-0a1d-44fa-affc-9e40974b290d
Dec 05 15:26:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3870aceb-3bad-4846-8e0d-6f698b70ad2b tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "f425241c-0a1d-44fa-affc-9e40974b290d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.723s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Acquiring lock "412e1e40-082a-429e-9d35-013b72322761" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "412e1e40-082a-429e-9d35-013b72322761" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:18 user nova-compute[75080]: DEBUG nova.objects.instance [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lazy-loading 'flavor' on Instance uuid 412e1e40-082a-429e-9d35-013b72322761 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:26:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "412e1e40-082a-429e-9d35-013b72322761" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a590f7e8-6cf7-4085-af01-47d5a44d7c75 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Acquiring lock "bd75375a-8b70-4bc2-a72b-14213ebaa4e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a590f7e8-6cf7-4085-af01-47d5a44d7c75 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Lock "bd75375a-8b70-4bc2-a72b-14213ebaa4e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a590f7e8-6cf7-4085-af01-47d5a44d7c75 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Acquiring lock "bd75375a-8b70-4bc2-a72b-14213ebaa4e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a590f7e8-6cf7-4085-af01-47d5a44d7c75 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Lock "bd75375a-8b70-4bc2-a72b-14213ebaa4e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a590f7e8-6cf7-4085-af01-47d5a44d7c75 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Lock "bd75375a-8b70-4bc2-a72b-14213ebaa4e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:18 user nova-compute[75080]: INFO nova.compute.manager [None req-a590f7e8-6cf7-4085-af01-47d5a44d7c75 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Terminating instance
Dec 05 15:26:18 user nova-compute[75080]: DEBUG nova.compute.manager [None req-a590f7e8-6cf7-4085-af01-47d5a44d7c75 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Acquiring lock "412e1e40-082a-429e-9d35-013b72322761" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "412e1e40-082a-429e-9d35-013b72322761" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:19 user nova-compute[75080]: INFO nova.compute.manager [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Attaching volume 64d9a505-3db3-49e1-b76d-68f48f59c4cb to /dev/vdb
Dec 05 15:26:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG os_brick.utils [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc1d43c-31c5-4524-a27f-48e7ed6427a0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG nova.compute.manager [req-735e6a4c-0792-435f-a0ee-c0f7625f7bc8 req-c3b2cc45-6057-465d-9fcb-72f468c319d5 service nova] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Received event network-vif-unplugged-06f46569-efd3-4978-b954-cdbb51b09e30 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-735e6a4c-0792-435f-a0ee-c0f7625f7bc8 req-c3b2cc45-6057-465d-9fcb-72f468c319d5 service nova] Acquiring lock "bd75375a-8b70-4bc2-a72b-14213ebaa4e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-735e6a4c-0792-435f-a0ee-c0f7625f7bc8 req-c3b2cc45-6057-465d-9fcb-72f468c319d5 service nova] Lock "bd75375a-8b70-4bc2-a72b-14213ebaa4e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-735e6a4c-0792-435f-a0ee-c0f7625f7bc8 req-c3b2cc45-6057-465d-9fcb-72f468c319d5 service nova] Lock "bd75375a-8b70-4bc2-a72b-14213ebaa4e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG nova.compute.manager [req-735e6a4c-0792-435f-a0ee-c0f7625f7bc8 req-c3b2cc45-6057-465d-9fcb-72f468c319d5 service nova] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] No waiting events found dispatching network-vif-unplugged-06f46569-efd3-4978-b954-cdbb51b09e30 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG nova.compute.manager [req-735e6a4c-0792-435f-a0ee-c0f7625f7bc8 req-c3b2cc45-6057-465d-9fcb-72f468c319d5 service nova] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Received event network-vif-unplugged-06f46569-efd3-4978-b954-cdbb51b09e30 for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f4a470-2b88-4117-812e-4597c9150f80]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce44755-8506-4db9-a43d-54e9dbf96ecd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece497a9-9f27-484d-ab12-95595bb5c8c3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:26:19 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:26:19 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0ca3bc-f056-4c21-8503-5ebc42723f2b]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG os_brick.utils [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Updating existing volume attachment record: 1522b001-f9cd-4f61-895a-6275832940fc {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:26:19 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Instance destroyed successfully.
Dec 05 15:26:19 user nova-compute[75080]: DEBUG nova.objects.instance [None req-a590f7e8-6cf7-4085-af01-47d5a44d7c75 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Lazy-loading 'resources' on Instance uuid bd75375a-8b70-4bc2-a72b-14213ebaa4e9 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-a590f7e8-6cf7-4085-af01-47d5a44d7c75 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:17:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1899701466',display_name='tempest-ServersNegativeTestJSON-server-1899701466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1899701466',id=1,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:17:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48e73fbf2c414f32bcdeef4bae598b2f',ramdisk_id='',reservation_id='r-5iwn6f9j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-32084328',owner_user_name='tempest-ServersNegativeTestJSON-32084328-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:17:43Z,user_data=None,user_id='e06d18d33aaa442dba24fbd214a49f9d',uuid=bd75375a-8b70-4bc2-a72b-14213ebaa4e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06f46569-efd3-4978-b954-cdbb51b09e30", "address": "fa:16:3e:8e:cb:88", "network": {"id": "05b09885-a021-44b4-b8d6-1504a4c2dfeb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1903039338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e73fbf2c414f32bcdeef4bae598b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f46569-ef", "ovs_interfaceid": "06f46569-efd3-4978-b954-cdbb51b09e30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-a590f7e8-6cf7-4085-af01-47d5a44d7c75 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Converting VIF {"id": "06f46569-efd3-4978-b954-cdbb51b09e30", "address": "fa:16:3e:8e:cb:88", "network": {"id": "05b09885-a021-44b4-b8d6-1504a4c2dfeb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1903039338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e73fbf2c414f32bcdeef4bae598b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f46569-ef", "ovs_interfaceid": "06f46569-efd3-4978-b954-cdbb51b09e30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-a590f7e8-6cf7-4085-af01-47d5a44d7c75 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:cb:88,bridge_name='br-int',has_traffic_filtering=True,id=06f46569-efd3-4978-b954-cdbb51b09e30,network=Network(05b09885-a021-44b4-b8d6-1504a4c2dfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06f46569-ef') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG os_vif [None req-a590f7e8-6cf7-4085-af01-47d5a44d7c75 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:cb:88,bridge_name='br-int',has_traffic_filtering=True,id=06f46569-efd3-4978-b954-cdbb51b09e30,network=Network(05b09885-a021-44b4-b8d6-1504a4c2dfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06f46569-ef') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06f46569-ef, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=416b3eeb-bf0a-417e-aba9-6b43d186f999) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:19 user nova-compute[75080]: INFO os_vif [None req-a590f7e8-6cf7-4085-af01-47d5a44d7c75 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:cb:88,bridge_name='br-int',has_traffic_filtering=True,id=06f46569-efd3-4978-b954-cdbb51b09e30,network=Network(05b09885-a021-44b4-b8d6-1504a4c2dfeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06f46569-ef')
Dec 05 15:26:19 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-a590f7e8-6cf7-4085-af01-47d5a44d7c75 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Deleting instance files /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9_del
Dec 05 15:26:19 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-a590f7e8-6cf7-4085-af01-47d5a44d7c75 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Deletion of /opt/stack/data/nova/instances/bd75375a-8b70-4bc2-a72b-14213ebaa4e9_del complete
Dec 05 15:26:19 user nova-compute[75080]: INFO nova.compute.manager [None req-a590f7e8-6cf7-4085-af01-47d5a44d7c75 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Took 0.72 seconds to destroy the instance on the hypervisor.
Dec 05 15:26:19 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-a590f7e8-6cf7-4085-af01-47d5a44d7c75 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG nova.compute.manager [req-d12e5c12-47a5-4620-9a07-2de0577baad2 req-ba91ec9b-d36d-435d-929c-e3a147938c00 service nova] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Received event network-changed-317f5115-d5c4-4bdd-8c6c-3c5900d15626 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG nova.compute.manager [req-d12e5c12-47a5-4620-9a07-2de0577baad2 req-ba91ec9b-d36d-435d-929c-e3a147938c00 service nova] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Refreshing instance network info cache due to event network-changed-317f5115-d5c4-4bdd-8c6c-3c5900d15626. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d12e5c12-47a5-4620-9a07-2de0577baad2 req-ba91ec9b-d36d-435d-929c-e3a147938c00 service nova] Acquiring lock "refresh_cache-c9836958-96d4-4b3e-a45c-fbb97846dbd4" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d12e5c12-47a5-4620-9a07-2de0577baad2 req-ba91ec9b-d36d-435d-929c-e3a147938c00 service nova] Acquired lock "refresh_cache-c9836958-96d4-4b3e-a45c-fbb97846dbd4" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:26:19 user nova-compute[75080]: DEBUG nova.network.neutron [req-d12e5c12-47a5-4620-9a07-2de0577baad2 req-ba91ec9b-d36d-435d-929c-e3a147938c00 service nova] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Refreshing network info cache for port 317f5115-d5c4-4bdd-8c6c-3c5900d15626 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:26:20 user nova-compute[75080]: DEBUG nova.network.neutron [req-d12e5c12-47a5-4620-9a07-2de0577baad2 req-ba91ec9b-d36d-435d-929c-e3a147938c00 service nova] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Updated VIF entry in instance network info cache for port 317f5115-d5c4-4bdd-8c6c-3c5900d15626. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:26:20 user nova-compute[75080]: DEBUG nova.network.neutron [req-d12e5c12-47a5-4620-9a07-2de0577baad2 req-ba91ec9b-d36d-435d-929c-e3a147938c00 service nova] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Updating instance_info_cache with network_info: [{"id": "317f5115-d5c4-4bdd-8c6c-3c5900d15626", "address": "fa:16:3e:22:7d:71", "network": {"id": "60895755-a5e0-4195-ace1-7627829ca044", "bridge": "br-int", "label": "tempest-TestStampPattern-2093692741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc899a7995f64588957e55ca0129c812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap317f5115-d5", "ovs_interfaceid": "317f5115-d5c4-4bdd-8c6c-3c5900d15626", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:26:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Acquiring lock "c9836958-96d4-4b3e-a45c-fbb97846dbd4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "c9836958-96d4-4b3e-a45c-fbb97846dbd4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d12e5c12-47a5-4620-9a07-2de0577baad2 req-ba91ec9b-d36d-435d-929c-e3a147938c00 service nova] Releasing lock "refresh_cache-c9836958-96d4-4b3e-a45c-fbb97846dbd4" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:26:20 user nova-compute[75080]: DEBUG nova.objects.instance [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lazy-loading 'flavor' on Instance uuid c9836958-96d4-4b3e-a45c-fbb97846dbd4 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:26:20 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:26:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "c9836958-96d4-4b3e-a45c-fbb97846dbd4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:20 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Took 0.65 seconds to deallocate network for instance.
Dec 05 15:26:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a590f7e8-6cf7-4085-af01-47d5a44d7c75 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a590f7e8-6cf7-4085-af01-47d5a44d7c75 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Acquiring lock "c9836958-96d4-4b3e-a45c-fbb97846dbd4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "c9836958-96d4-4b3e-a45c-fbb97846dbd4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:20 user nova-compute[75080]: INFO nova.compute.manager [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Attaching volume fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 to /dev/vdb
Dec 05 15:26:20 user nova-compute[75080]: DEBUG os_brick.utils [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:26:20 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:20 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:20 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50417e0-ad58-43f7-a11c-0bfeecec695e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:20 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:20 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:20 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67101de-8b68-468b-8e5b-dad08ef67101]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:20 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:20 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:20 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5741f52f-e52d-4c81-b462-ee5ae82cb897]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:20 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f512b8d-5222-49f2-b6d0-bd99e2740ea0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:20 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:20 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:26:20 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:26:20 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:20 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:26:20 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:26:20 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a8f4f7-dd1f-4834-a0ec-946824c63957]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:20 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:26:20 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:26:20 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:26:20 user nova-compute[75080]: DEBUG os_brick.utils [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] <== get_connector_properties: return (191ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:26:20 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Updating existing volume attachment record: 791f7d2f-e963-41c6-9b5f-092924d70bf5 {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:26:20 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-a590f7e8-6cf7-4085-af01-47d5a44d7c75 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:26:20 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-a590f7e8-6cf7-4085-af01-47d5a44d7c75 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:26:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a590f7e8-6cf7-4085-af01-47d5a44d7c75 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.437s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:20 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-a590f7e8-6cf7-4085-af01-47d5a44d7c75 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Deleted allocations for instance bd75375a-8b70-4bc2-a72b-14213ebaa4e9
Dec 05 15:26:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a590f7e8-6cf7-4085-af01-47d5a44d7c75 tempest-ServersNegativeTestJSON-32084328 tempest-ServersNegativeTestJSON-32084328-project-member] Lock "bd75375a-8b70-4bc2-a72b-14213ebaa4e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.991s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:21 user nova-compute[75080]: DEBUG nova.compute.manager [req-83817628-2223-42d3-b9f7-cbab6754d45a req-cc155ce8-6c3f-4e1c-8fd1-41071cbbfeae service nova] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Received event network-vif-plugged-06f46569-efd3-4978-b954-cdbb51b09e30 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:26:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-83817628-2223-42d3-b9f7-cbab6754d45a req-cc155ce8-6c3f-4e1c-8fd1-41071cbbfeae service nova] Acquiring lock "bd75375a-8b70-4bc2-a72b-14213ebaa4e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-83817628-2223-42d3-b9f7-cbab6754d45a req-cc155ce8-6c3f-4e1c-8fd1-41071cbbfeae service nova] Lock "bd75375a-8b70-4bc2-a72b-14213ebaa4e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-83817628-2223-42d3-b9f7-cbab6754d45a req-cc155ce8-6c3f-4e1c-8fd1-41071cbbfeae service nova] Lock "bd75375a-8b70-4bc2-a72b-14213ebaa4e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:21 user nova-compute[75080]: DEBUG nova.compute.manager [req-83817628-2223-42d3-b9f7-cbab6754d45a req-cc155ce8-6c3f-4e1c-8fd1-41071cbbfeae service nova] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] No waiting events found dispatching network-vif-plugged-06f46569-efd3-4978-b954-cdbb51b09e30 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:26:21 user nova-compute[75080]: WARNING nova.compute.manager [req-83817628-2223-42d3-b9f7-cbab6754d45a req-cc155ce8-6c3f-4e1c-8fd1-41071cbbfeae service nova] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Received unexpected event network-vif-plugged-06f46569-efd3-4978-b954-cdbb51b09e30 for instance with vm_state deleted and task_state None.
Dec 05 15:26:21 user nova-compute[75080]: DEBUG nova.compute.manager [req-83817628-2223-42d3-b9f7-cbab6754d45a req-cc155ce8-6c3f-4e1c-8fd1-41071cbbfeae service nova] [instance: bd75375a-8b70-4bc2-a72b-14213ebaa4e9] Received event network-vif-deleted-06f46569-efd3-4978-b954-cdbb51b09e30 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:26:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:28 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:26:28 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:26:28 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:26:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:26:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BMaNUgCf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:26:28 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:26:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:26:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:26:28 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:26:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:26:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:26:28 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:26:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bac0a15-c50c-4ba2-a81f-ac3f26d92746]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:26:28 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee07434-8d8f-4451-b1d9-63bfd9a01f13]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb] added
Dec 05 15:26:28 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19446af-a7c1-4bde-91ba-d80a55e95f04]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[978da561-6589-46a1-bc50-3fd5b1d19b60]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BMaNUgCf {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BMaNUgCf" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7d4eeb-a099-4efd-830d-aea6588a21ef]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BMaNUgCf'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d35444-ef6c-4cdc-bbfd-d7e4bd3744e3]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebdb333-06bc-463f-977b-ffb3d27f0eec]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:26:29 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:26:29 user nova-compute[75080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:26:29 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:26:29 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:26:29 user nova-compute[75080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:26:29 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed46174-1412-438d-916e-2ec40c00c1b8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb, portal: 172.16.0.220,3260]
Dec 05 15:26:29 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb, portal: 172.16.0.220,3260] successful.
Dec 05 15:26:29 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f381db-9ed2-4cfe-89a4-28138faf5488]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[289d47a8-7a36-401c-9ed9-bd6b205ce58f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:26:29 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:26:29 user nova-compute[75080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:26:29 user nova-compute[75080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:26:29 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:26:29 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:26:29 user nova-compute[75080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:26:29 user nova-compute[75080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:26:29 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1cd3e8-dc37-472d-b9df-39a51832545a]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BMaNUgCf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-607acee2-b585-43d2-a897-eca4983d62db" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-607acee2-b585-43d2-a897-eca4983d62db" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Updating instance_info_cache with network_info: [{"id": "5979a08d-6941-4e54-9f0f-a6aa1af07de8", "address": "fa:16:3e:94:6b:4c", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5979a08d-69", "ovs_interfaceid": "5979a08d-6941-4e54-9f0f-a6aa1af07de8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-607acee2-b585-43d2-a897-eca4983d62db" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:26:29 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMpfNPtx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:26:30 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:26:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26535306436353734', 'path': '/dev/sdc'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535306436353734', 'path': '/dev/sdc'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.151s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:26:30 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:26:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:26:30 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:26:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG nova.objects.instance [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lazy-loading 'flavor' on Instance uuid 412e1e40-082a-429e-9d35-013b72322761 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6597610f-fbca-435c-8049-dc96293b52a5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:26:30 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 15:26:30 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:26:30 user nova-compute[75080]:   <source dev="/dev/sdc"/>
Dec 05 15:26:30 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:26:30 user nova-compute[75080]:   <serial>64d9a505-3db3-49e1-b76d-68f48f59c4cb</serial>
Dec 05 15:26:30 user nova-compute[75080]: </disk>
Dec 05 15:26:30 user nova-compute[75080]:  {{(pid=75080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5656a69-ad2c-4382-a1b6-733e83347bb0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18] added
Dec 05 15:26:30 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5697b291-bae5-4385-8abb-4f8bae5977ba]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[503f0668-7eca-4c23-8e27-ddcf3ae25449]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dMpfNPtx {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dMpfNPtx" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ef1076-798d-4db5-b8a7-c62ee3dc3d69]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dMpfNPtx'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41b8716-b1be-457f-b63e-8ab26f9f91b7]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[924e43f6-6a05-480d-8706-f29072974d6b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:26:30 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:26:30 user nova-compute[75080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:26:30 user nova-compute[75080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:26:30 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:26:30 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:26:30 user nova-compute[75080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:26:30 user nova-compute[75080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:26:30 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f66a14a-aec8-4d1c-a62c-7115e8f7378b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18, portal: 172.16.0.220,3260]
Dec 05 15:26:30 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18, portal: 172.16.0.220,3260] successful.
Dec 05 15:26:30 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e476fb97-f7e7-4b7a-9868-000860811c72]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ce6a5c-7273-4e6b-b136-648248fa4f84]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:26:30 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:26:30 user nova-compute[75080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:26:30 user nova-compute[75080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:26:30 user nova-compute[75080]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 (non-flash)
Dec 05 15:26:30 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:26:30 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:26:30 user nova-compute[75080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:26:30 user nova-compute[75080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:26:30 user nova-compute[75080]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 (non-flash)
Dec 05 15:26:30 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] HCTL ('36', '-', '-', 0) found on session 26 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2454a356-9462-45a0-99df-10e007e60071]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: None {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] No VIF found with MAC fa:16:3e:ab:04:37, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:26:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5b9a20ed-b524-47db-bef7-bea9aaa02254 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "412e1e40-082a-429e-9d35-013b72322761" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.791s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:31 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:26:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:31 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:26:31 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:26:31 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMpfNPtx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:26:31 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:26:31 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] <== connect_volume: return (1490ms) {'type': 'block', 'scsi_wwn': '26266336435316432', 'path': '/dev/sde'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:26:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266336435316432', 'path': '/dev/sde'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:26:31 user nova-compute[75080]: DEBUG nova.objects.instance [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lazy-loading 'flavor' on Instance uuid c9836958-96d4-4b3e-a45c-fbb97846dbd4 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:26:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 15:26:31 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:26:31 user nova-compute[75080]:   <source dev="/dev/sde"/>
Dec 05 15:26:31 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:26:31 user nova-compute[75080]:   <serial>fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18</serial>
Dec 05 15:26:31 user nova-compute[75080]: </disk>
Dec 05 15:26:31 user nova-compute[75080]:  {{(pid=75080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 15:26:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:26:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:26:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] No VIF found with MAC fa:16:3e:22:7d:71, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:26:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5f0747b8-3fb3-4166-b70b-6cc83fdcf266 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "c9836958-96d4-4b3e-a45c-fbb97846dbd4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.835s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-467e7a93-3c35-4695-bbab-6b43a61d35b5 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "5e29bda9-f1d6-4951-9343-f189934a8a23" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-467e7a93-3c35-4695-bbab-6b43a61d35b5 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "5e29bda9-f1d6-4951-9343-f189934a8a23" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:32 user nova-compute[75080]: INFO nova.compute.manager [None req-467e7a93-3c35-4695-bbab-6b43a61d35b5 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Detaching volume fd29efe7-d1b9-4460-86f2-9eb719695989
Dec 05 15:26:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:26:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:32 user nova-compute[75080]: INFO nova.virt.block_device [None req-467e7a93-3c35-4695-bbab-6b43a61d35b5 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Attempting to driver detach volume fd29efe7-d1b9-4460-86f2-9eb719695989 from mountpoint /dev/vdb
Dec 05 15:26:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-467e7a93-3c35-4695-bbab-6b43a61d35b5 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Attempting to detach device vdb from instance 5e29bda9-f1d6-4951-9343-f189934a8a23 from the persistent domain config. {{(pid=75080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 15:26:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-467e7a93-3c35-4695-bbab-6b43a61d35b5 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:26:32 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:26:32 user nova-compute[75080]:   <source dev="/dev/sdd"/>
Dec 05 15:26:32 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:26:32 user nova-compute[75080]:   <serial>fd29efe7-d1b9-4460-86f2-9eb719695989</serial>
Dec 05 15:26:32 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 05 15:26:32 user nova-compute[75080]: </disk>
Dec 05 15:26:32 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:26:32 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-467e7a93-3c35-4695-bbab-6b43a61d35b5 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Successfully detached device vdb from instance 5e29bda9-f1d6-4951-9343-f189934a8a23 from the persistent domain config.
Dec 05 15:26:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-467e7a93-3c35-4695-bbab-6b43a61d35b5 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5e29bda9-f1d6-4951-9343-f189934a8a23 from the live domain config. {{(pid=75080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 15:26:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-467e7a93-3c35-4695-bbab-6b43a61d35b5 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:26:32 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:26:32 user nova-compute[75080]:   <source dev="/dev/sdd"/>
Dec 05 15:26:32 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:26:32 user nova-compute[75080]:   <serial>fd29efe7-d1b9-4460-86f2-9eb719695989</serial>
Dec 05 15:26:32 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 05 15:26:32 user nova-compute[75080]: </disk>
Dec 05 15:26:32 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:26:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:26:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:26:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-467e7a93-3c35-4695-bbab-6b43a61d35b5 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5e29bda9-f1d6-4951-9343-f189934a8a23 {{(pid=75080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 15:26:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:26:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/845ee1b9-b8d5-4ac2-a8e2-792c037934b0/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:33 user nova-compute[75080]: DEBUG nova.compute.manager [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Stashing vm_state: active {{(pid=75080) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Dec 05 15:26:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/845ee1b9-b8d5-4ac2-a8e2-792c037934b0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/845ee1b9-b8d5-4ac2-a8e2-792c037934b0/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.003s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:34 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:26:34 user nova-compute[75080]: INFO nova.compute.claims [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Claim successful on node user
Dec 05 15:26:34 user nova-compute[75080]: INFO nova.compute.resource_tracker [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Updating resource usage from migration 6a14dafe-5a94-4c59-bb53-5aac3920fec0
Dec 05 15:26:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/845ee1b9-b8d5-4ac2-a8e2-792c037934b0/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:26:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:34 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:26:34 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:26:34 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=7871MB free_disk=25.291725158691406GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:26:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:34 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:26:34 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:26:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.847s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:34 user nova-compute[75080]: INFO nova.compute.manager [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Migrating
Dec 05 15:26:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:26:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:26:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.243s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:35 user nova-compute[75080]: INFO nova.compute.rpcapi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Dec 05 15:26:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:26:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d81fe51b-c732-4662-9c1c-7957b5eb1e7c tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Acquiring lock "c9836958-96d4-4b3e-a45c-fbb97846dbd4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d81fe51b-c732-4662-9c1c-7957b5eb1e7c tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "c9836958-96d4-4b3e-a45c-fbb97846dbd4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Acquiring lock "refresh_cache-412e1e40-082a-429e-9d35-013b72322761" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:26:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Acquired lock "refresh_cache-412e1e40-082a-429e-9d35-013b72322761" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:26:35 user nova-compute[75080]: DEBUG nova.network.neutron [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:26:35 user nova-compute[75080]: INFO nova.compute.manager [None req-d81fe51b-c732-4662-9c1c-7957b5eb1e7c tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Detaching volume fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18
Dec 05 15:26:35 user nova-compute[75080]: INFO nova.virt.block_device [None req-d81fe51b-c732-4662-9c1c-7957b5eb1e7c tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Attempting to driver detach volume fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 from mountpoint /dev/vdb
Dec 05 15:26:35 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Applying migration context for instance 412e1e40-082a-429e-9d35-013b72322761 as it has an incoming, in-progress migration 6a14dafe-5a94-4c59-bb53-5aac3920fec0. Migration status is pre-migrating {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Dec 05 15:26:35 user nova-compute[75080]: INFO nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 412e1e40-082a-429e-9d35-013b72322761] Updating resource usage from migration 6a14dafe-5a94-4c59-bb53-5aac3920fec0
Dec 05 15:26:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d81fe51b-c732-4662-9c1c-7957b5eb1e7c tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Attempting to detach device vdb from instance c9836958-96d4-4b3e-a45c-fbb97846dbd4 from the persistent domain config. {{(pid=75080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 15:26:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-d81fe51b-c732-4662-9c1c-7957b5eb1e7c tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:26:35 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:26:35 user nova-compute[75080]:   <source dev="/dev/sde"/>
Dec 05 15:26:35 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:26:35 user nova-compute[75080]:   <serial>fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18</serial>
Dec 05 15:26:35 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 15:26:35 user nova-compute[75080]: </disk>
Dec 05 15:26:35 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:26:35 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-d81fe51b-c732-4662-9c1c-7957b5eb1e7c tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Successfully detached device vdb from instance c9836958-96d4-4b3e-a45c-fbb97846dbd4 from the persistent domain config.
Dec 05 15:26:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d81fe51b-c732-4662-9c1c-7957b5eb1e7c tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c9836958-96d4-4b3e-a45c-fbb97846dbd4 from the live domain config. {{(pid=75080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 15:26:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-d81fe51b-c732-4662-9c1c-7957b5eb1e7c tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:26:35 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:26:35 user nova-compute[75080]:   <source dev="/dev/sde"/>
Dec 05 15:26:35 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:26:35 user nova-compute[75080]:   <serial>fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18</serial>
Dec 05 15:26:35 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 15:26:35 user nova-compute[75080]: </disk>
Dec 05 15:26:35 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:26:35 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance eedd1529-4feb-4f85-8625-0c20d8e0359d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:26:35 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 5e29bda9-f1d6-4951-9343-f189934a8a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:26:35 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 607acee2-b585-43d2-a897-eca4983d62db actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:26:35 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 07b025ff-4a9d-48a2-b950-b8f2d165f33c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:26:35 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:26:35 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance c9836958-96d4-4b3e-a45c-fbb97846dbd4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:26:35 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 845ee1b9-b8d5-4ac2-a8e2-792c037934b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:26:35 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance ab882db7-e6d7-44ca-9ea4-ae2fa68f7929 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:26:35 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Migration 6a14dafe-5a94-4c59-bb53-5aac3920fec0 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1712}}
Dec 05 15:26:35 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 412e1e40-082a-429e-9d35-013b72322761 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:26:35 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:26:35 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:26:35 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:26:35 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:26:35 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:26:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.561s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:35 user nova-compute[75080]: DEBUG nova.network.neutron [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Updating instance_info_cache with network_info: [{"id": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "address": "fa:16:3e:ab:04:37", "network": {"id": "3f7b7f16-6cc0-45b9-9f9c-efd112a71092", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-47517680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00d040579ca46338e01b8110a0ebc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78547a5f-e1", "ovs_interfaceid": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:26:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Releasing lock "refresh_cache-412e1e40-082a-429e-9d35-013b72322761" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:26:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d81fe51b-c732-4662-9c1c-7957b5eb1e7c tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c9836958-96d4-4b3e-a45c-fbb97846dbd4 {{(pid=75080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 15:26:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Starting migrate_disk_and_power_off {{(pid=75080) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11490}}
Dec 05 15:26:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG nova.compute.manager [req-e7ad33c4-96a9-4419-9659-5ceca0865d4b req-dea330e2-6153-4751-b75a-c60e292ee1ce service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] Received event network-vif-unplugged-78547a5f-e10d-4a62-8d35-5584ce87d2c5 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-e7ad33c4-96a9-4419-9659-5ceca0865d4b req-dea330e2-6153-4751-b75a-c60e292ee1ce service nova] Acquiring lock "412e1e40-082a-429e-9d35-013b72322761-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-e7ad33c4-96a9-4419-9659-5ceca0865d4b req-dea330e2-6153-4751-b75a-c60e292ee1ce service nova] Lock "412e1e40-082a-429e-9d35-013b72322761-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-e7ad33c4-96a9-4419-9659-5ceca0865d4b req-dea330e2-6153-4751-b75a-c60e292ee1ce service nova] Lock "412e1e40-082a-429e-9d35-013b72322761-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG nova.compute.manager [req-e7ad33c4-96a9-4419-9659-5ceca0865d4b req-dea330e2-6153-4751-b75a-c60e292ee1ce service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] No waiting events found dispatching network-vif-unplugged-78547a5f-e10d-4a62-8d35-5584ce87d2c5 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:26:36 user nova-compute[75080]: WARNING nova.compute.manager [req-e7ad33c4-96a9-4419-9659-5ceca0865d4b req-dea330e2-6153-4751-b75a-c60e292ee1ce service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] Received unexpected event network-vif-unplugged-78547a5f-e10d-4a62-8d35-5584ce87d2c5 for instance with vm_state active and task_state resize_migrating.
Dec 05 15:26:36 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 412e1e40-082a-429e-9d35-013b72322761] Instance destroyed successfully.
Dec 05 15:26:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:22:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1475628522',display_name='tempest-ServerActionsTestOtherB-server-1475628522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1475628522',id=17,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwmHJwK89ZUQ4UynGDWrkxG5H0hE1b2MJmPt/rTqIdK43uWLaFbVA/0/Nip6RjSnsKkWhAWpaEvyfqDY42bj2ESHH8OvSzPeboVnwtrtWSkYdz3jR4YJhIMViK+6gUdwg==',key_name='tempest-keypair-508009308',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:22:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c00d040579ca46338e01b8110a0ebc05',ramdisk_id='',reservation_id='r-col74in8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1903161286',owner_user_name='tempest-ServerActionsTestOtherB-1903161286-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:26:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='512e60f95c314913959f037132353c9e',uuid=412e1e40-082a-429e-9d35-013b72322761,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "address": "fa:16:3e:ab:04:37", "network": {"id": "3f7b7f16-6cc0-45b9-9f9c-efd112a71092", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-47517680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-47517680-network", "vif_mac": "fa:16:3e:ab:04:37"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00d040579ca46338e01b8110a0ebc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78547a5f-e1", "ovs_interfaceid": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Converting VIF {"id": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "address": "fa:16:3e:ab:04:37", "network": {"id": "3f7b7f16-6cc0-45b9-9f9c-efd112a71092", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-47517680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-47517680-network", "vif_mac": "fa:16:3e:ab:04:37"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00d040579ca46338e01b8110a0ebc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78547a5f-e1", "ovs_interfaceid": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:04:37,bridge_name='br-int',has_traffic_filtering=True,id=78547a5f-e10d-4a62-8d35-5584ce87d2c5,network=Network(3f7b7f16-6cc0-45b9-9f9c-efd112a71092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78547a5f-e1') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG os_vif [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:04:37,bridge_name='br-int',has_traffic_filtering=True,id=78547a5f-e10d-4a62-8d35-5584ce87d2c5,network=Network(3f7b7f16-6cc0-45b9-9f9c-efd112a71092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78547a5f-e1') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78547a5f-e1, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=31b2147b-3f06-4615-8642-c647c7d1572f) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:36 user nova-compute[75080]: INFO os_vif [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:04:37,bridge_name='br-int',has_traffic_filtering=True,id=78547a5f-e10d-4a62-8d35-5584ce87d2c5,network=Network(3f7b7f16-6cc0-45b9-9f9c-efd112a71092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78547a5f-e1')
Dec 05 15:26:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BMaNUgCf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:26:36 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:26:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[807ec1f1-0153-47dd-ae5a-1817e17ef882]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:26:36 user nova-compute[75080]: No targets found.
Dec 05 15:26:36 user nova-compute[75080]: iSNS:
Dec 05 15:26:36 user nova-compute[75080]: No targets found.
Dec 05 15:26:36 user nova-compute[75080]: STATIC:
Dec 05 15:26:36 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399
Dec 05 15:26:36 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:26:36 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:26:36 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598
Dec 05 15:26:36 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:26:36 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:26:36 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989
Dec 05 15:26:36 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:26:36 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:26:36 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb
Dec 05 15:26:36 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:26:36 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:26:36 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18
Dec 05 15:26:36 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:26:36 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:26:36 user nova-compute[75080]: FIRMWARE:
Dec 05 15:26:36 user nova-compute[75080]: No targets found.
Dec 05 15:26:36 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:26:36 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:26:36 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19ae1b7-1b39-4a2f-bbe1-5df2385e92ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b77cfd-3a30-4dd2-9976-ce8048e1a0e1]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:26:36 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:26:36 user nova-compute[75080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:26:36 user nova-compute[75080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:26:36 user nova-compute[75080]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 (non-flash)
Dec 05 15:26:36 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:26:36 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:26:36 user nova-compute[75080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:26:36 user nova-compute[75080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:26:36 user nova-compute[75080]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 (non-flash)
Dec 05 15:26:36 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f665c538310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb'): ({'sdc'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Removing single pathed devices sdc {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1966c10f-5b8d-41d9-8585-173b9501a84e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2915d925-c235-4d05-94b8-4ca304a04450]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Flushing IO for device /dev/sdc {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[77390813-1629-4db7-aded-50f3526a573f]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d304c3b-ce31-4616-90bf-12c44ea26d9c]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] SCSI volumes sdc have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa57fc8d-aa0b-487e-a67d-0c42588e7373]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8577082-f4f2-48e9-bd2b-c0ae9af4e728]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb, portal: 172.16.0.220,3260]
Dec 05 15:26:36 user nova-compute[75080]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb, portal: 172.16.0.220,3260] successful.
Dec 05 15:26:36 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9035d4-7e25-4dae-975e-4816a432cb73]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] <== disconnect_volume: return (307ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:26:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:26:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761_resize/disk /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] CMD "cp -r /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761_resize/disk /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk" returned: 0 in 0.300s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761_resize/disk.info /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk.info {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:37 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:26:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] CMD "cp -r /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761_resize/disk.info /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk.info" returned: 0 in 0.039s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:37 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:26:37 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:26:38 user nova-compute[75080]: DEBUG nova.compute.manager [req-aef9f11d-d8b9-4a09-a538-25481d5fdea8 req-486ebddd-60a5-4c59-89d5-3360bc18ccbd service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] Received event network-vif-plugged-78547a5f-e10d-4a62-8d35-5584ce87d2c5 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:26:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-aef9f11d-d8b9-4a09-a538-25481d5fdea8 req-486ebddd-60a5-4c59-89d5-3360bc18ccbd service nova] Acquiring lock "412e1e40-082a-429e-9d35-013b72322761-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-aef9f11d-d8b9-4a09-a538-25481d5fdea8 req-486ebddd-60a5-4c59-89d5-3360bc18ccbd service nova] Lock "412e1e40-082a-429e-9d35-013b72322761-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-aef9f11d-d8b9-4a09-a538-25481d5fdea8 req-486ebddd-60a5-4c59-89d5-3360bc18ccbd service nova] Lock "412e1e40-082a-429e-9d35-013b72322761-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:38 user nova-compute[75080]: DEBUG nova.compute.manager [req-aef9f11d-d8b9-4a09-a538-25481d5fdea8 req-486ebddd-60a5-4c59-89d5-3360bc18ccbd service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] No waiting events found dispatching network-vif-plugged-78547a5f-e10d-4a62-8d35-5584ce87d2c5 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:26:38 user nova-compute[75080]: WARNING nova.compute.manager [req-aef9f11d-d8b9-4a09-a538-25481d5fdea8 req-486ebddd-60a5-4c59-89d5-3360bc18ccbd service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] Received unexpected event network-vif-plugged-78547a5f-e10d-4a62-8d35-5584ce87d2c5 for instance with vm_state active and task_state resize_migrating.
Dec 05 15:26:38 user nova-compute[75080]: DEBUG nova.network.neutron [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Port 78547a5f-e10d-4a62-8d35-5584ce87d2c5 binding to destination host user is already ACTIVE {{(pid=75080) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Dec 05 15:26:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Acquiring lock "412e1e40-082a-429e-9d35-013b72322761-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "412e1e40-082a-429e-9d35-013b72322761-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "412e1e40-082a-429e-9d35-013b72322761-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Acquiring lock "refresh_cache-412e1e40-082a-429e-9d35-013b72322761" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:26:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Acquired lock "refresh_cache-412e1e40-082a-429e-9d35-013b72322761" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:26:38 user nova-compute[75080]: DEBUG nova.network.neutron [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:26:39 user nova-compute[75080]: DEBUG nova.network.neutron [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Updating instance_info_cache with network_info: [{"id": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "address": "fa:16:3e:ab:04:37", "network": {"id": "3f7b7f16-6cc0-45b9-9f9c-efd112a71092", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-47517680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00d040579ca46338e01b8110a0ebc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78547a5f-e1", "ovs_interfaceid": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:26:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Releasing lock "refresh_cache-412e1e40-082a-429e-9d35-013b72322761" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:26:39 user nova-compute[75080]: DEBUG os_brick.utils [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:26:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:39 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[28796014-6d54-4466-b923-c323f0c98119]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:39 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f5d3aa-bbb5-48d4-a9f2-5bca5f969e76]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:39 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb918321-6d51-4368-a259-cb2b13ca900b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:39 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8227cf12-947d-4a8d-91a3-3d54bbe66bc4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:26:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:26:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:26:39 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:26:39 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade18eb2-6161-4db3-903f-1b6fe070646b]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:26:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:26:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:26:39 user nova-compute[75080]: DEBUG os_brick.utils [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:26:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:48 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Starting finish_migration {{(pid=75080) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11677}}
Dec 05 15:26:48 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Instance directory exists: not creating {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 05 15:26:48 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Creating image(s)
Dec 05 15:26:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.170s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Checking if we can resize image /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk. size=21474836480 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk 21474836480 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk 21474836480" returned: 0 in 0.042s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Did not create local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Ensure instance console log exists: /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Start _get_guest_xml network_info=[{"id": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "address": "fa:16:3e:ab:04:37", "network": {"id": "3f7b7f16-6cc0-45b9-9f9c-efd112a71092", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-47517680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-47517680-network", "vif_mac": "fa:16:3e:ab:04:37"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00d040579ca46338e01b8110a0ebc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78547a5f-e1", "ovs_interfaceid": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BMaNUgCf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '412e1e40-082a-429e-9d35-013b72322761', 'attached_at': '2023-12-05T15:26:49.000000', 'detached_at': '', 'volume_id': '64d9a505-3db3-49e1-b76d-68f48f59c4cb', 'serial': '64d9a505-3db3-49e1-b76d-68f48f59c4cb'}, 'device_type': 'disk', 'attachment_id': 'fde77aa2-463a-433a-b9b8-3c82057008af', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:26:49 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:26:49 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:26:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BMaNUgCf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:26:49 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:26:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:26:49 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:26:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:26:49 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd96eb94-4562-4fbf-9250-22e1f4664bdb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:26:49 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[747e2ab4-1763-4cbb-8e5a-78dae032c1a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb] added
Dec 05 15:26:49 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ff4213-24ad-469f-9e28-32c2d591c842]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a7f8ca-c3a3-4741-9441-06593afc1d39]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BMaNUgCf {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BMaNUgCf" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[982d1bca-d73d-4bea-8f89-1d0ffe08e532]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BMaNUgCf'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7335ee65-f4e6-4bdb-915f-6f316ace1142]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[597e8646-83ce-408f-8a3d-24e31edd1bec]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:26:49 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:26:49 user nova-compute[75080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:26:49 user nova-compute[75080]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 (non-flash)
Dec 05 15:26:49 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:26:49 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:26:49 user nova-compute[75080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:26:49 user nova-compute[75080]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 (non-flash)
Dec 05 15:26:49 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[33daed5e-71cc-4c81-99c0-a8d5c6390388]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb, portal: 172.16.0.220,3260]
Dec 05 15:26:49 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb, portal: 172.16.0.220,3260] successful.
Dec 05 15:26:49 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a4a0e0-4139-4064-b317-5d1f06ba9229]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e49414-9b82-4382-b667-f9d85ee5745a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:26:49 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:26:49 user nova-compute[75080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:26:49 user nova-compute[75080]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 (non-flash)
Dec 05 15:26:49 user nova-compute[75080]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:26:49 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:26:49 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:26:49 user nova-compute[75080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:26:49 user nova-compute[75080]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 (non-flash)
Dec 05 15:26:49 user nova-compute[75080]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:26:49 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[33250451-5417-41b2-8939-3c386453da22]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:49 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: None {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:26:50 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:26:50 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BMaNUgCf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:26:50 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:26:50 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26535306436353734', 'path': '/dev/sdc'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:26:50 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535306436353734', 'path': '/dev/sdc'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:26:50 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:22:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1475628522',display_name='tempest-ServerActionsTestOtherB-server-1475628522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1475628522',id=17,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwmHJwK89ZUQ4UynGDWrkxG5H0hE1b2MJmPt/rTqIdK43uWLaFbVA/0/Nip6RjSnsKkWhAWpaEvyfqDY42bj2ESHH8OvSzPeboVnwtrtWSkYdz3jR4YJhIMViK+6gUdwg==',key_name='tempest-keypair-508009308',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:22:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c00d040579ca46338e01b8110a0ebc05',ramdisk_id='',reservation_id='r-col74in8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1903161286',owner_user_name='tempest-ServerActionsTestOtherB-1903161286-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:26:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='512e60f95c314913959f037132353c9e',uuid=412e1e40-082a-429e-9d35-013b72322761,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "address": "fa:16:3e:ab:04:37", "network": {"id": "3f7b7f16-6cc0-45b9-9f9c-efd112a71092", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-47517680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-47517680-network", "vif_mac": "fa:16:3e:ab:04:37"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00d040579ca46338e01b8110a0ebc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78547a5f-e1", "ovs_interfaceid": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:26:50 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Converting VIF {"id": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "address": "fa:16:3e:ab:04:37", "network": {"id": "3f7b7f16-6cc0-45b9-9f9c-efd112a71092", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-47517680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-47517680-network", "vif_mac": "fa:16:3e:ab:04:37"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00d040579ca46338e01b8110a0ebc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78547a5f-e1", "ovs_interfaceid": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:26:50 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:04:37,bridge_name='br-int',has_traffic_filtering=True,id=78547a5f-e10d-4a62-8d35-5584ce87d2c5,network=Network(3f7b7f16-6cc0-45b9-9f9c-efd112a71092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78547a5f-e1') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:26:50 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:26:50 user nova-compute[75080]:   <uuid>412e1e40-082a-429e-9d35-013b72322761</uuid>
Dec 05 15:26:50 user nova-compute[75080]:   <name>instance-00000011</name>
Dec 05 15:26:50 user nova-compute[75080]:   <memory>2097152</memory>
Dec 05 15:26:50 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:26:50 user nova-compute[75080]:   <metadata>
Dec 05 15:26:50 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:26:50 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:26:50 user nova-compute[75080]:       <nova:name>tempest-ServerActionsTestOtherB-server-1475628522</nova:name>
Dec 05 15:26:50 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:26:49</nova:creationTime>
Dec 05 15:26:50 user nova-compute[75080]:       <nova:flavor name="m1.small">
Dec 05 15:26:50 user nova-compute[75080]:         <nova:memory>2048</nova:memory>
Dec 05 15:26:50 user nova-compute[75080]:         <nova:disk>20</nova:disk>
Dec 05 15:26:50 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:26:50 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:26:50 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:26:50 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:26:50 user nova-compute[75080]:       <nova:owner>
Dec 05 15:26:50 user nova-compute[75080]:         <nova:user uuid="512e60f95c314913959f037132353c9e">tempest-ServerActionsTestOtherB-1903161286-project-member</nova:user>
Dec 05 15:26:50 user nova-compute[75080]:         <nova:project uuid="c00d040579ca46338e01b8110a0ebc05">tempest-ServerActionsTestOtherB-1903161286</nova:project>
Dec 05 15:26:50 user nova-compute[75080]:       </nova:owner>
Dec 05 15:26:50 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:26:50 user nova-compute[75080]:       <nova:ports>
Dec 05 15:26:50 user nova-compute[75080]:         <nova:port uuid="78547a5f-e10d-4a62-8d35-5584ce87d2c5">
Dec 05 15:26:50 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 05 15:26:50 user nova-compute[75080]:         </nova:port>
Dec 05 15:26:50 user nova-compute[75080]:       </nova:ports>
Dec 05 15:26:50 user nova-compute[75080]:     </nova:instance>
Dec 05 15:26:50 user nova-compute[75080]:   </metadata>
Dec 05 15:26:50 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:26:50 user nova-compute[75080]:     <system>
Dec 05 15:26:50 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:26:50 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:26:50 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:26:50 user nova-compute[75080]:       <entry name="serial">412e1e40-082a-429e-9d35-013b72322761</entry>
Dec 05 15:26:50 user nova-compute[75080]:       <entry name="uuid">412e1e40-082a-429e-9d35-013b72322761</entry>
Dec 05 15:26:50 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:26:50 user nova-compute[75080]:     </system>
Dec 05 15:26:50 user nova-compute[75080]:   </sysinfo>
Dec 05 15:26:50 user nova-compute[75080]:   <os>
Dec 05 15:26:50 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:26:50 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:26:50 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:26:50 user nova-compute[75080]:   </os>
Dec 05 15:26:50 user nova-compute[75080]:   <features>
Dec 05 15:26:50 user nova-compute[75080]:     <acpi/>
Dec 05 15:26:50 user nova-compute[75080]:     <apic/>
Dec 05 15:26:50 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:26:50 user nova-compute[75080]:   </features>
Dec 05 15:26:50 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:26:50 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:26:50 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:26:50 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:26:50 user nova-compute[75080]:   </clock>
Dec 05 15:26:50 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:26:50 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:26:50 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:26:50 user nova-compute[75080]:   </cpu>
Dec 05 15:26:50 user nova-compute[75080]:   <devices>
Dec 05 15:26:50 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:26:50 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:26:50 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk"/>
Dec 05 15:26:50 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:26:50 user nova-compute[75080]:     </disk>
Dec 05 15:26:50 user nova-compute[75080]:     <disk type="block" device="disk">
Dec 05 15:26:50 user nova-compute[75080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:26:50 user nova-compute[75080]:       <source dev="/dev/sdc"/>
Dec 05 15:26:50 user nova-compute[75080]:       <target dev="vdb" bus="virtio"/>
Dec 05 15:26:50 user nova-compute[75080]:       <serial>64d9a505-3db3-49e1-b76d-68f48f59c4cb</serial>
Dec 05 15:26:50 user nova-compute[75080]:     </disk>
Dec 05 15:26:50 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:26:50 user nova-compute[75080]:       <mac address="fa:16:3e:ab:04:37"/>
Dec 05 15:26:50 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:26:50 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:26:50 user nova-compute[75080]:       <target dev="tap78547a5f-e1"/>
Dec 05 15:26:50 user nova-compute[75080]:     </interface>
Dec 05 15:26:50 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:26:50 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/console.log" append="off"/>
Dec 05 15:26:50 user nova-compute[75080]:     </serial>
Dec 05 15:26:50 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:26:50 user nova-compute[75080]:     <video>
Dec 05 15:26:50 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:26:50 user nova-compute[75080]:     </video>
Dec 05 15:26:50 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:26:50 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:26:50 user nova-compute[75080]:     </rng>
Dec 05 15:26:50 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:26:50 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:26:50 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:26:50 user nova-compute[75080]:     </memballoon>
Dec 05 15:26:50 user nova-compute[75080]:   </devices>
Dec 05 15:26:50 user nova-compute[75080]: </domain>
Dec 05 15:26:50 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:26:50 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:22:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1475628522',display_name='tempest-ServerActionsTestOtherB-server-1475628522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1475628522',id=17,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwmHJwK89ZUQ4UynGDWrkxG5H0hE1b2MJmPt/rTqIdK43uWLaFbVA/0/Nip6RjSnsKkWhAWpaEvyfqDY42bj2ESHH8OvSzPeboVnwtrtWSkYdz3jR4YJhIMViK+6gUdwg==',key_name='tempest-keypair-508009308',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:22:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c00d040579ca46338e01b8110a0ebc05',ramdisk_id='',reservation_id='r-col74in8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1903161286',owner_user_name='tempest-ServerActionsTestOtherB-1903161286-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:26:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='512e60f95c314913959f037132353c9e',uuid=412e1e40-082a-429e-9d35-013b72322761,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "address": "fa:16:3e:ab:04:37", "network": {"id": "3f7b7f16-6cc0-45b9-9f9c-efd112a71092", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-47517680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-47517680-network", "vif_mac": "fa:16:3e:ab:04:37"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00d040579ca46338e01b8110a0ebc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78547a5f-e1", "ovs_interfaceid": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:26:50 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Converting VIF {"id": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "address": "fa:16:3e:ab:04:37", "network": {"id": "3f7b7f16-6cc0-45b9-9f9c-efd112a71092", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-47517680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-47517680-network", "vif_mac": "fa:16:3e:ab:04:37"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00d040579ca46338e01b8110a0ebc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78547a5f-e1", "ovs_interfaceid": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:26:50 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:04:37,bridge_name='br-int',has_traffic_filtering=True,id=78547a5f-e10d-4a62-8d35-5584ce87d2c5,network=Network(3f7b7f16-6cc0-45b9-9f9c-efd112a71092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78547a5f-e1') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:26:50 user nova-compute[75080]: DEBUG os_vif [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:04:37,bridge_name='br-int',has_traffic_filtering=True,id=78547a5f-e10d-4a62-8d35-5584ce87d2c5,network=Network(3f7b7f16-6cc0-45b9-9f9c-efd112a71092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78547a5f-e1') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:26:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:26:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:26:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '41ed10b0-ba5b-52f0-a9c7-7087de9df1c3', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:26:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:26:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78547a5f-e1, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:26:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap78547a5f-e1, col_values=(('qos', UUID('2070c5cf-2fea-44b4-82b2-3bbaef025e43')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:26:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap78547a5f-e1, col_values=(('external_ids', {'iface-id': '78547a5f-e10d-4a62-8d35-5584ce87d2c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:04:37', 'vm-uuid': '412e1e40-082a-429e-9d35-013b72322761'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:26:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:26:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:50 user nova-compute[75080]: INFO os_vif [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:04:37,bridge_name='br-int',has_traffic_filtering=True,id=78547a5f-e10d-4a62-8d35-5584ce87d2c5,network=Network(3f7b7f16-6cc0-45b9-9f9c-efd112a71092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78547a5f-e1')
Dec 05 15:26:50 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:26:50 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:26:50 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] No VIF found with MAC fa:16:3e:ab:04:37, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:26:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:52 user nova-compute[75080]: DEBUG nova.compute.manager [req-267b81b5-4262-431f-8347-7efac4a663ad req-9102a6a4-45ac-4f0a-bd94-220571fec6fd service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] Received event network-vif-plugged-78547a5f-e10d-4a62-8d35-5584ce87d2c5 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:26:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-267b81b5-4262-431f-8347-7efac4a663ad req-9102a6a4-45ac-4f0a-bd94-220571fec6fd service nova] Acquiring lock "412e1e40-082a-429e-9d35-013b72322761-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-267b81b5-4262-431f-8347-7efac4a663ad req-9102a6a4-45ac-4f0a-bd94-220571fec6fd service nova] Lock "412e1e40-082a-429e-9d35-013b72322761-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-267b81b5-4262-431f-8347-7efac4a663ad req-9102a6a4-45ac-4f0a-bd94-220571fec6fd service nova] Lock "412e1e40-082a-429e-9d35-013b72322761-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:52 user nova-compute[75080]: DEBUG nova.compute.manager [req-267b81b5-4262-431f-8347-7efac4a663ad req-9102a6a4-45ac-4f0a-bd94-220571fec6fd service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] No waiting events found dispatching network-vif-plugged-78547a5f-e10d-4a62-8d35-5584ce87d2c5 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:26:52 user nova-compute[75080]: WARNING nova.compute.manager [req-267b81b5-4262-431f-8347-7efac4a663ad req-9102a6a4-45ac-4f0a-bd94-220571fec6fd service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] Received unexpected event network-vif-plugged-78547a5f-e10d-4a62-8d35-5584ce87d2c5 for instance with vm_state active and task_state resize_finish.
Dec 05 15:26:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:53 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-467e7a93-3c35-4695-bbab-6b43a61d35b5 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5e29bda9-f1d6-4951-9343-f189934a8a23 is timed out.
Dec 05 15:26:53 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-467e7a93-3c35-4695-bbab-6b43a61d35b5 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Successfully detached device vdb from instance 5e29bda9-f1d6-4951-9343-f189934a8a23 from the live domain config.
Dec 05 15:26:53 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-467e7a93-3c35-4695-bbab-6b43a61d35b5 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-467e7a93-3c35-4695-bbab-6b43a61d35b5 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ybmzpMJh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:26:53 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-467e7a93-3c35-4695-bbab-6b43a61d35b5 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:26:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-467e7a93-3c35-4695-bbab-6b43a61d35b5 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-467e7a93-3c35-4695-bbab-6b43a61d35b5 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[121845f2-5fd0-4ea7-b06b-355a57588272]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-467e7a93-3c35-4695-bbab-6b43a61d35b5 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:26:53 user nova-compute[75080]: No targets found.
Dec 05 15:26:53 user nova-compute[75080]: iSNS:
Dec 05 15:26:53 user nova-compute[75080]: No targets found.
Dec 05 15:26:53 user nova-compute[75080]: STATIC:
Dec 05 15:26:53 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399
Dec 05 15:26:53 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:26:53 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:26:53 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598
Dec 05 15:26:53 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:26:53 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:26:53 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989
Dec 05 15:26:53 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:26:53 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:26:53 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb
Dec 05 15:26:53 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:26:53 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:26:53 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18
Dec 05 15:26:53 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:26:53 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:26:53 user nova-compute[75080]: FIRMWARE:
Dec 05 15:26:53 user nova-compute[75080]: No targets found.
Dec 05 15:26:53 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-467e7a93-3c35-4695-bbab-6b43a61d35b5 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:26:53 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:26:53 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-467e7a93-3c35-4695-bbab-6b43a61d35b5 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f42fc16-f51b-448c-8c03-eb5a1af99e7b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5e1b1e-620b-437e-9e4e-bf0beb20f540]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-467e7a93-3c35-4695-bbab-6b43a61d35b5 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:26:53 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:26:53 user nova-compute[75080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:26:53 user nova-compute[75080]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 (non-flash)
Dec 05 15:26:53 user nova-compute[75080]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:26:53 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-467e7a93-3c35-4695-bbab-6b43a61d35b5 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:26:53 user nova-compute[75080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 (non-flash)
Dec 05 15:26:53 user nova-compute[75080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:26:53 user nova-compute[75080]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 (non-flash)
Dec 05 15:26:53 user nova-compute[75080]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:26:53 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-467e7a93-3c35-4695-bbab-6b43a61d35b5 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f665c1f5000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989'): ({'sdd'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-467e7a93-3c35-4695-bbab-6b43a61d35b5 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Removing single pathed devices sdd {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e165410-6475-4d00-86d5-38a2f8f19f6e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd797f55-f49b-4eef-86b5-71ea5127eb23]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-467e7a93-3c35-4695-bbab-6b43a61d35b5 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Flushing IO for device /dev/sdd {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f79c63-6b60-4110-9901-3a792d5f7b35]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-467e7a93-3c35-4695-bbab-6b43a61d35b5 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.032s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14a0099-b376-47ae-9738-6ca1e002fd68]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-467e7a93-3c35-4695-bbab-6b43a61d35b5 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-467e7a93-3c35-4695-bbab-6b43a61d35b5 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] SCSI volumes sdd have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-467e7a93-3c35-4695-bbab-6b43a61d35b5 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[718152f2-5646-4cd0-9522-4073d695219d]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-467e7a93-3c35-4695-bbab-6b43a61d35b5 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39142df-81f6-4a6a-8d22-8a9a696c4137]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-467e7a93-3c35-4695-bbab-6b43a61d35b5 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989, portal: 172.16.0.220,3260]
Dec 05 15:26:53 user nova-compute[75080]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989, portal: 172.16.0.220,3260] successful.
Dec 05 15:26:53 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd29efe7-d1b9-4460-86f2-9eb719695989 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ba6162-ecaa-44af-aaf7-aae9c1350bf5]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-467e7a93-3c35-4695-bbab-6b43a61d35b5 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-467e7a93-3c35-4695-bbab-6b43a61d35b5 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-467e7a93-3c35-4695-bbab-6b43a61d35b5 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] <== disconnect_volume: return (289ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:26:53 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-467e7a93-3c35-4695-bbab-6b43a61d35b5 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:26:54 user nova-compute[75080]: DEBUG nova.compute.manager [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:26:54 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 412e1e40-082a-429e-9d35-013b72322761] Instance running successfully.
Dec 05 15:26:54 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Failed to set time: agent not configured {{(pid=75080) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Dec 05 15:26:54 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2e5981bc-c401-4547-8f3a-34e708548d44 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] finish_migration finished successfully. {{(pid=75080) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11772}}
Dec 05 15:26:54 user nova-compute[75080]: DEBUG nova.objects.instance [None req-467e7a93-3c35-4695-bbab-6b43a61d35b5 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lazy-loading 'flavor' on Instance uuid 5e29bda9-f1d6-4951-9343-f189934a8a23 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:26:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-467e7a93-3c35-4695-bbab-6b43a61d35b5 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "5e29bda9-f1d6-4951-9343-f189934a8a23" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.713s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:54 user nova-compute[75080]: DEBUG nova.compute.manager [req-6f73d17f-c063-4821-a729-291ea7415ba1 req-3264ae22-5d2d-4238-8f04-8461f1f40928 service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] Received event network-vif-plugged-78547a5f-e10d-4a62-8d35-5584ce87d2c5 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:26:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-6f73d17f-c063-4821-a729-291ea7415ba1 req-3264ae22-5d2d-4238-8f04-8461f1f40928 service nova] Acquiring lock "412e1e40-082a-429e-9d35-013b72322761-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:26:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-6f73d17f-c063-4821-a729-291ea7415ba1 req-3264ae22-5d2d-4238-8f04-8461f1f40928 service nova] Lock "412e1e40-082a-429e-9d35-013b72322761-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:26:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-6f73d17f-c063-4821-a729-291ea7415ba1 req-3264ae22-5d2d-4238-8f04-8461f1f40928 service nova] Lock "412e1e40-082a-429e-9d35-013b72322761-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:54 user nova-compute[75080]: DEBUG nova.compute.manager [req-6f73d17f-c063-4821-a729-291ea7415ba1 req-3264ae22-5d2d-4238-8f04-8461f1f40928 service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] No waiting events found dispatching network-vif-plugged-78547a5f-e10d-4a62-8d35-5584ce87d2c5 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:26:54 user nova-compute[75080]: WARNING nova.compute.manager [req-6f73d17f-c063-4821-a729-291ea7415ba1 req-3264ae22-5d2d-4238-8f04-8461f1f40928 service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] Received unexpected event network-vif-plugged-78547a5f-e10d-4a62-8d35-5584ce87d2c5 for instance with vm_state resized and task_state None.
Dec 05 15:26:55 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-d81fe51b-c732-4662-9c1c-7957b5eb1e7c tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c9836958-96d4-4b3e-a45c-fbb97846dbd4 is timed out.
Dec 05 15:26:55 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-d81fe51b-c732-4662-9c1c-7957b5eb1e7c tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Successfully detached device vdb from instance c9836958-96d4-4b3e-a45c-fbb97846dbd4 from the live domain config.
Dec 05 15:26:55 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d81fe51b-c732-4662-9c1c-7957b5eb1e7c tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81fe51b-c732-4662-9c1c-7957b5eb1e7c tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMpfNPtx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:26:55 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-d81fe51b-c732-4662-9c1c-7957b5eb1e7c tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:26:55 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-d81fe51b-c732-4662-9c1c-7957b5eb1e7c tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-d81fe51b-c732-4662-9c1c-7957b5eb1e7c tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[940e8ae8-ea71-4806-a39b-d072cf3491c8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81fe51b-c732-4662-9c1c-7957b5eb1e7c tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:26:55 user nova-compute[75080]: No targets found.
Dec 05 15:26:55 user nova-compute[75080]: iSNS:
Dec 05 15:26:55 user nova-compute[75080]: No targets found.
Dec 05 15:26:55 user nova-compute[75080]: STATIC:
Dec 05 15:26:55 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399
Dec 05 15:26:55 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:26:55 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:26:55 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598
Dec 05 15:26:55 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:26:55 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:26:55 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb
Dec 05 15:26:55 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:26:55 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:26:55 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18
Dec 05 15:26:55 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:26:55 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:26:55 user nova-compute[75080]: FIRMWARE:
Dec 05 15:26:55 user nova-compute[75080]: No targets found.
Dec 05 15:26:55 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81fe51b-c732-4662-9c1c-7957b5eb1e7c tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:26:55 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:26:55 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81fe51b-c732-4662-9c1c-7957b5eb1e7c tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1addf649-1e85-47b0-a219-a056a47b644c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d65f32a-2922-4e29-8629-39e64563b7c6]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81fe51b-c732-4662-9c1c-7957b5eb1e7c tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:26:55 user nova-compute[75080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:26:55 user nova-compute[75080]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 (non-flash)
Dec 05 15:26:55 user nova-compute[75080]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:26:55 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81fe51b-c732-4662-9c1c-7957b5eb1e7c tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:26:55 user nova-compute[75080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:26:55 user nova-compute[75080]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 (non-flash)
Dec 05 15:26:55 user nova-compute[75080]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:26:55 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81fe51b-c732-4662-9c1c-7957b5eb1e7c tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f665c1f5cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18'): ({'sde'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-d81fe51b-c732-4662-9c1c-7957b5eb1e7c tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Removing single pathed devices sde {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee6a7a3-8f0b-414b-933d-5eecca7c4891]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9672aaf1-a930-48a0-8202-1e93703c6251]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-d81fe51b-c732-4662-9c1c-7957b5eb1e7c tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Flushing IO for device /dev/sde {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f968f43f-38f7-477a-b8be-920924aed4f2]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-d81fe51b-c732-4662-9c1c-7957b5eb1e7c tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4152a3d2-da13-41bf-b58e-dce61bb3cf6a]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-d81fe51b-c732-4662-9c1c-7957b5eb1e7c tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-d81fe51b-c732-4662-9c1c-7957b5eb1e7c tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] SCSI volumes sde have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81fe51b-c732-4662-9c1c-7957b5eb1e7c tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8744a27e-9760-43a8-ac26-501200bec16e]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81fe51b-c732-4662-9c1c-7957b5eb1e7c tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3347cba2-d0f8-4a79-ada0-c63bcb4f27a6]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81fe51b-c732-4662-9c1c-7957b5eb1e7c tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18, portal: 172.16.0.220,3260]
Dec 05 15:26:55 user nova-compute[75080]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18, portal: 172.16.0.220,3260] successful.
Dec 05 15:26:55 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbc1e460-bd7d-4ba0-9a6b-cb67223c8f18 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf92ea1-fc01-4b56-82be-1fa15a619fef]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81fe51b-c732-4662-9c1c-7957b5eb1e7c tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-d81fe51b-c732-4662-9c1c-7957b5eb1e7c tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81fe51b-c732-4662-9c1c-7957b5eb1e7c tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] <== disconnect_volume: return (342ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:26:55 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d81fe51b-c732-4662-9c1c-7957b5eb1e7c tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:26:56 user nova-compute[75080]: DEBUG nova.objects.instance [None req-d81fe51b-c732-4662-9c1c-7957b5eb1e7c tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lazy-loading 'flavor' on Instance uuid c9836958-96d4-4b3e-a45c-fbb97846dbd4 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:26:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d81fe51b-c732-4662-9c1c-7957b5eb1e7c tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "c9836958-96d4-4b3e-a45c-fbb97846dbd4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.762s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:26:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:26:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Acquiring lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:04 user nova-compute[75080]: DEBUG nova.objects.instance [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lazy-loading 'flavor' on Instance uuid 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:27:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Acquiring lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:04 user nova-compute[75080]: INFO nova.compute.manager [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Attaching volume d99fb99a-13b8-4dd8-a129-b0c0e68e9960 to /dev/vdb
Dec 05 15:27:04 user nova-compute[75080]: DEBUG os_brick.utils [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:27:04 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:04 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:04 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5090d44c-4ae8-47ab-a9ee-d1bc82caf63d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:04 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:04 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:04 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f2ad96-8f8e-4eda-b83f-da6601696337]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:04 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:04 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:04 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d42736-3178-4339-8156-833f6aed2f35]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:04 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[acffa719-deea-4719-bbd7-a44678eec385]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:04 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:04 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:27:04 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:27:04 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:04 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:27:04 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:27:04 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e07b1f5-80e2-4f85-a28d-1e351c7dda77]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:04 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:27:04 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:27:04 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:27:04 user nova-compute[75080]: DEBUG os_brick.utils [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:27:04 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Updating existing volume attachment record: 9888f253-fcb4-470b-ae2a-ef70db4028d2 {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:27:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:27:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Acquiring lock "845ee1b9-b8d5-4ac2-a8e2-792c037934b0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Lock "845ee1b9-b8d5-4ac2-a8e2-792c037934b0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:08 user nova-compute[75080]: DEBUG nova.objects.instance [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Lazy-loading 'flavor' on Instance uuid 845ee1b9-b8d5-4ac2-a8e2-792c037934b0 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:27:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Lock "845ee1b9-b8d5-4ac2-a8e2-792c037934b0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Acquiring lock "845ee1b9-b8d5-4ac2-a8e2-792c037934b0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Lock "845ee1b9-b8d5-4ac2-a8e2-792c037934b0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:08 user nova-compute[75080]: INFO nova.compute.manager [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Attaching volume 93939a1f-bbee-4e50-a599-900db2b04d8e to /dev/vdb
Dec 05 15:27:08 user nova-compute[75080]: DEBUG os_brick.utils [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:27:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[161f64a3-e17c-414b-b979-8b221ce9e77f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9ce604-9149-41a3-9657-194a33f1a24d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[199694c6-a821-462d-b398-1b8152e34a1d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8b1efa-d871-40bc-8267-0ab881171647]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:27:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:27:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:27:08 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:27:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfa1e56-ca32-4087-a4e4-9521686ede3f]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:27:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:27:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:27:08 user nova-compute[75080]: DEBUG os_brick.utils [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:27:08 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Updating existing volume attachment record: f1018d6e-48fc-4b3f-9c82-bf60f9ee563a {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:27:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "607acee2-b585-43d2-a897-eca4983d62db" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "607acee2-b585-43d2-a897-eca4983d62db" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "607acee2-b585-43d2-a897-eca4983d62db-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "607acee2-b585-43d2-a897-eca4983d62db-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "607acee2-b585-43d2-a897-eca4983d62db-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:09 user nova-compute[75080]: INFO nova.compute.manager [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Terminating instance
Dec 05 15:27:09 user nova-compute[75080]: DEBUG nova.compute.manager [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:27:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG nova.compute.manager [req-f5464842-831b-4ef2-8ed5-c3e10611b564 req-c849be25-c048-4a94-aa30-9a3da140f02c service nova] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Received event network-vif-unplugged-5979a08d-6941-4e54-9f0f-a6aa1af07de8 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f5464842-831b-4ef2-8ed5-c3e10611b564 req-c849be25-c048-4a94-aa30-9a3da140f02c service nova] Acquiring lock "607acee2-b585-43d2-a897-eca4983d62db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f5464842-831b-4ef2-8ed5-c3e10611b564 req-c849be25-c048-4a94-aa30-9a3da140f02c service nova] Lock "607acee2-b585-43d2-a897-eca4983d62db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f5464842-831b-4ef2-8ed5-c3e10611b564 req-c849be25-c048-4a94-aa30-9a3da140f02c service nova] Lock "607acee2-b585-43d2-a897-eca4983d62db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG nova.compute.manager [req-f5464842-831b-4ef2-8ed5-c3e10611b564 req-c849be25-c048-4a94-aa30-9a3da140f02c service nova] [instance: 607acee2-b585-43d2-a897-eca4983d62db] No waiting events found dispatching network-vif-unplugged-5979a08d-6941-4e54-9f0f-a6aa1af07de8 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG nova.compute.manager [req-f5464842-831b-4ef2-8ed5-c3e10611b564 req-c849be25-c048-4a94-aa30-9a3da140f02c service nova] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Received event network-vif-unplugged-5979a08d-6941-4e54-9f0f-a6aa1af07de8 for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:27:10 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Instance destroyed successfully.
Dec 05 15:27:10 user nova-compute[75080]: DEBUG nova.objects.instance [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lazy-loading 'resources' on Instance uuid 607acee2-b585-43d2-a897-eca4983d62db {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:22:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1343643765',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1343643765',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1343643765',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqhKohd/+Zu6WwJoPk+5PrlLuGFqnOTiENkWbBD5QSU5b+evA78SirwvOPaECiBFl5SfxUnl88cNfR23Qb+3NSlS7eK4mKt4l9nS7owjbXuvRlUEghiewHtV6WdVUnbDw==',key_name='tempest-keypair-1335740552',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:22:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11227acd507347ae9c5a3bc710707f84',ramdisk_id='',reservation_id='r-u407s099',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-23416231',owner_user_name='tempest-TestVolumeBootPattern-23416231-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:22:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15be5b54cc8346bb86683e4ed2fbba9e',uuid=607acee2-b585-43d2-a897-eca4983d62db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5979a08d-6941-4e54-9f0f-a6aa1af07de8", "address": "fa:16:3e:94:6b:4c", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5979a08d-69", "ovs_interfaceid": "5979a08d-6941-4e54-9f0f-a6aa1af07de8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Converting VIF {"id": "5979a08d-6941-4e54-9f0f-a6aa1af07de8", "address": "fa:16:3e:94:6b:4c", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5979a08d-69", "ovs_interfaceid": "5979a08d-6941-4e54-9f0f-a6aa1af07de8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:6b:4c,bridge_name='br-int',has_traffic_filtering=True,id=5979a08d-6941-4e54-9f0f-a6aa1af07de8,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5979a08d-69') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG os_vif [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:6b:4c,bridge_name='br-int',has_traffic_filtering=True,id=5979a08d-6941-4e54-9f0f-a6aa1af07de8,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5979a08d-69') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5979a08d-69, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eee59cf4-9f7a-48d6-a039-3034540a27fe) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:27:10 user nova-compute[75080]: INFO os_vif [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:6b:4c,bridge_name='br-int',has_traffic_filtering=True,id=5979a08d-6941-4e54-9f0f-a6aa1af07de8,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5979a08d-69')
Dec 05 15:27:10 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UyWpYcnM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:27:10 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:27:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c7d950-8c14-47a7-bb7d-e9e3f9a14741]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:27:10 user nova-compute[75080]: No targets found.
Dec 05 15:27:10 user nova-compute[75080]: iSNS:
Dec 05 15:27:10 user nova-compute[75080]: No targets found.
Dec 05 15:27:10 user nova-compute[75080]: STATIC:
Dec 05 15:27:10 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399
Dec 05 15:27:10 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:27:10 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:27:10 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598
Dec 05 15:27:10 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:27:10 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:27:10 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb
Dec 05 15:27:10 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:27:10 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:27:10 user nova-compute[75080]: FIRMWARE:
Dec 05 15:27:10 user nova-compute[75080]: No targets found.
Dec 05 15:27:10 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:27:10 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:27:10 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe801ea-7256-4e92-bcf6-f573c7dd9596]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd53969a-0bd6-40c9-ad40-fb08bde11699]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:27:10 user nova-compute[75080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:27:10 user nova-compute[75080]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:27:10 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 (non-flash)
Dec 05 15:27:10 user nova-compute[75080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:27:10 user nova-compute[75080]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:27:10 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f66384a43a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598'): ({'sdb'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Removing single pathed devices sdb {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[504e292a-bb28-49d6-bb44-49ba32d2cdc2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f132625-405f-4c46-9bbd-ae0b9749ceb8]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Flushing IO for device /dev/sdb {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a458830e-fe75-446c-9bd3-b1d9c2935f0b]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c296cec5-8bdf-4bf0-8def-10c8ab706a1d]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[911fe3d4-3a69-4fc1-9ecb-3905feb28b35]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8901d1fe-4346-4705-8375-c77bcdfd210c]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598, portal: 172.16.0.220,3260]
Dec 05 15:27:10 user nova-compute[75080]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598, portal: 172.16.0.220,3260] successful.
Dec 05 15:27:10 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b948b23-bb33-4107-9e97-aad44fb22598 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db6a22e-dcb0-403e-bc8b-2231b9eec4a9]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] <== disconnect_volume: return (338ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:27:10 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Deleting instance files /opt/stack/data/nova/instances/607acee2-b585-43d2-a897-eca4983d62db_del
Dec 05 15:27:10 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Deletion of /opt/stack/data/nova/instances/607acee2-b585-43d2-a897-eca4983d62db_del complete
Dec 05 15:27:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:10 user nova-compute[75080]: INFO nova.compute.manager [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Took 1.22 seconds to destroy the instance on the hypervisor.
Dec 05 15:27:10 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:27:10 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 607acee2-b585-43d2-a897-eca4983d62db] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:27:11 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:27:11 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Took 0.97 seconds to deallocate network for instance.
Dec 05 15:27:11 user nova-compute[75080]: DEBUG nova.compute.manager [req-616bd508-7fd1-4fb4-93a0-6fa790085bc4 req-1e2fbd10-bf7e-4bfa-b471-40ab7e7462a8 service nova] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Received event network-vif-deleted-5979a08d-6941-4e54-9f0f-a6aa1af07de8 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:27:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:12 user nova-compute[75080]: DEBUG nova.compute.manager [req-b8bf8653-beba-4b1e-850d-7336e813d86a req-e8e3c4b3-6ec9-4bf6-b706-1e323acbe266 service nova] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Received event network-vif-plugged-5979a08d-6941-4e54-9f0f-a6aa1af07de8 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:27:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-b8bf8653-beba-4b1e-850d-7336e813d86a req-e8e3c4b3-6ec9-4bf6-b706-1e323acbe266 service nova] Acquiring lock "607acee2-b585-43d2-a897-eca4983d62db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-b8bf8653-beba-4b1e-850d-7336e813d86a req-e8e3c4b3-6ec9-4bf6-b706-1e323acbe266 service nova] Lock "607acee2-b585-43d2-a897-eca4983d62db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-b8bf8653-beba-4b1e-850d-7336e813d86a req-e8e3c4b3-6ec9-4bf6-b706-1e323acbe266 service nova] Lock "607acee2-b585-43d2-a897-eca4983d62db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:12 user nova-compute[75080]: DEBUG nova.compute.manager [req-b8bf8653-beba-4b1e-850d-7336e813d86a req-e8e3c4b3-6ec9-4bf6-b706-1e323acbe266 service nova] [instance: 607acee2-b585-43d2-a897-eca4983d62db] No waiting events found dispatching network-vif-plugged-5979a08d-6941-4e54-9f0f-a6aa1af07de8 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:27:12 user nova-compute[75080]: WARNING nova.compute.manager [req-b8bf8653-beba-4b1e-850d-7336e813d86a req-e8e3c4b3-6ec9-4bf6-b706-1e323acbe266 service nova] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Received unexpected event network-vif-plugged-5979a08d-6941-4e54-9f0f-a6aa1af07de8 for instance with vm_state active and task_state deleting.
Dec 05 15:27:12 user nova-compute[75080]: INFO nova.compute.manager [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Took 0.82 seconds to detach 1 volumes for instance.
Dec 05 15:27:12 user nova-compute[75080]: DEBUG nova.compute.manager [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 607acee2-b585-43d2-a897-eca4983d62db] Deleting volume: 5b948b23-bb33-4107-9e97-aad44fb22598 {{(pid=75080) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 05 15:27:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:13 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:27:13 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:27:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:13 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Deleted allocations for instance 607acee2-b585-43d2-a897-eca4983d62db
Dec 05 15:27:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5b04be44-e55f-44cb-b628-0db7982d0f9d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "607acee2-b585-43d2-a897-eca4983d62db" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.706s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:15 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6e19c71f-b5b5-4aae-bf2e-c4a91d03627a tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "5e29bda9-f1d6-4951-9343-f189934a8a23" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6e19c71f-b5b5-4aae-bf2e-c4a91d03627a tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "5e29bda9-f1d6-4951-9343-f189934a8a23" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6e19c71f-b5b5-4aae-bf2e-c4a91d03627a tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "5e29bda9-f1d6-4951-9343-f189934a8a23-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6e19c71f-b5b5-4aae-bf2e-c4a91d03627a tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "5e29bda9-f1d6-4951-9343-f189934a8a23-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6e19c71f-b5b5-4aae-bf2e-c4a91d03627a tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "5e29bda9-f1d6-4951-9343-f189934a8a23-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:23 user nova-compute[75080]: INFO nova.compute.manager [None req-6e19c71f-b5b5-4aae-bf2e-c4a91d03627a tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Terminating instance
Dec 05 15:27:23 user nova-compute[75080]: DEBUG nova.compute.manager [None req-6e19c71f-b5b5-4aae-bf2e-c4a91d03627a tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:27:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:23 user nova-compute[75080]: DEBUG nova.compute.manager [req-9b1c0c8a-9d6e-44db-925f-77d672040a46 req-b49300eb-6acf-477a-aec5-153dfb4e3a28 service nova] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Received event network-vif-unplugged-fb2619ea-ffe7-4d82-9b44-984ee393620c {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:27:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9b1c0c8a-9d6e-44db-925f-77d672040a46 req-b49300eb-6acf-477a-aec5-153dfb4e3a28 service nova] Acquiring lock "5e29bda9-f1d6-4951-9343-f189934a8a23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9b1c0c8a-9d6e-44db-925f-77d672040a46 req-b49300eb-6acf-477a-aec5-153dfb4e3a28 service nova] Lock "5e29bda9-f1d6-4951-9343-f189934a8a23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9b1c0c8a-9d6e-44db-925f-77d672040a46 req-b49300eb-6acf-477a-aec5-153dfb4e3a28 service nova] Lock "5e29bda9-f1d6-4951-9343-f189934a8a23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:23 user nova-compute[75080]: DEBUG nova.compute.manager [req-9b1c0c8a-9d6e-44db-925f-77d672040a46 req-b49300eb-6acf-477a-aec5-153dfb4e3a28 service nova] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] No waiting events found dispatching network-vif-unplugged-fb2619ea-ffe7-4d82-9b44-984ee393620c {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:27:23 user nova-compute[75080]: DEBUG nova.compute.manager [req-9b1c0c8a-9d6e-44db-925f-77d672040a46 req-b49300eb-6acf-477a-aec5-153dfb4e3a28 service nova] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Received event network-vif-unplugged-fb2619ea-ffe7-4d82-9b44-984ee393620c for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:27:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:23 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Instance destroyed successfully.
Dec 05 15:27:23 user nova-compute[75080]: DEBUG nova.objects.instance [None req-6e19c71f-b5b5-4aae-bf2e-c4a91d03627a tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lazy-loading 'resources' on Instance uuid 5e29bda9-f1d6-4951-9343-f189934a8a23 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:27:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-6e19c71f-b5b5-4aae-bf2e-c4a91d03627a tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T15:21:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1999463025',display_name='tempest-ServerActionsTestOtherA-server-1633226047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1999463025',id=14,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvWGadIJzQhPYzEMGopP5ED52Y6Gi9xcl1Gk9R/9FWs4vsKHHKulX+a7vugCHkAURz4pQ6pvg505Y+Ts3LLi3NJ3+G0dMmP1DiJTl+hCPVyGkJWdfTJyUNAnDxFiveANg==',key_name='tempest-keypair-1591259108',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:24:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50f49255d5b74f448dc941027afbf84a',ramdisk_id='',reservation_id='r-qiq2etb6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-393209338',owner_user_name='tempest-ServerActionsTestOtherA-393209338-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:24:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e99cb2f1c4541fd9a656e038f4afac3',uuid=5e29bda9-f1d6-4951-9343-f189934a8a23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb2619ea-ffe7-4d82-9b44-984ee393620c", "address": "fa:16:3e:4b:c9:8b", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb2619ea-ff", "ovs_interfaceid": "fb2619ea-ffe7-4d82-9b44-984ee393620c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:27:23 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-6e19c71f-b5b5-4aae-bf2e-c4a91d03627a tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Converting VIF {"id": "fb2619ea-ffe7-4d82-9b44-984ee393620c", "address": "fa:16:3e:4b:c9:8b", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb2619ea-ff", "ovs_interfaceid": "fb2619ea-ffe7-4d82-9b44-984ee393620c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:27:23 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-6e19c71f-b5b5-4aae-bf2e-c4a91d03627a tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:c9:8b,bridge_name='br-int',has_traffic_filtering=True,id=fb2619ea-ffe7-4d82-9b44-984ee393620c,network=Network(efba4a7e-3a56-41d2-8af7-4c064ba641fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb2619ea-ff') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:27:23 user nova-compute[75080]: DEBUG os_vif [None req-6e19c71f-b5b5-4aae-bf2e-c4a91d03627a tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:c9:8b,bridge_name='br-int',has_traffic_filtering=True,id=fb2619ea-ffe7-4d82-9b44-984ee393620c,network=Network(efba4a7e-3a56-41d2-8af7-4c064ba641fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb2619ea-ff') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:27:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb2619ea-ff, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:27:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:27:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1f2c9181-2313-487b-bd2f-93e9fdad9449) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:27:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:23 user nova-compute[75080]: INFO os_vif [None req-6e19c71f-b5b5-4aae-bf2e-c4a91d03627a tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:c9:8b,bridge_name='br-int',has_traffic_filtering=True,id=fb2619ea-ffe7-4d82-9b44-984ee393620c,network=Network(efba4a7e-3a56-41d2-8af7-4c064ba641fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb2619ea-ff')
Dec 05 15:27:23 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-6e19c71f-b5b5-4aae-bf2e-c4a91d03627a tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Deleting instance files /opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23_del
Dec 05 15:27:23 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-6e19c71f-b5b5-4aae-bf2e-c4a91d03627a tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Deletion of /opt/stack/data/nova/instances/5e29bda9-f1d6-4951-9343-f189934a8a23_del complete
Dec 05 15:27:24 user nova-compute[75080]: INFO nova.compute.manager [None req-6e19c71f-b5b5-4aae-bf2e-c4a91d03627a tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Took 0.91 seconds to destroy the instance on the hypervisor.
Dec 05 15:27:24 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-6e19c71f-b5b5-4aae-bf2e-c4a91d03627a tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:27:24 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:27:24 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:27:24 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:27:24 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Took 0.72 seconds to deallocate network for instance.
Dec 05 15:27:24 user nova-compute[75080]: DEBUG nova.compute.manager [req-dd36afeb-4428-4bfc-820a-7f591a718927 req-e1e43edf-05fa-4c49-9054-6b5e22c2acc1 service nova] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Received event network-vif-deleted-fb2619ea-ffe7-4d82-9b44-984ee393620c {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:27:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6e19c71f-b5b5-4aae-bf2e-c4a91d03627a tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6e19c71f-b5b5-4aae-bf2e-c4a91d03627a tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:25 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-6e19c71f-b5b5-4aae-bf2e-c4a91d03627a tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:27:25 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-6e19c71f-b5b5-4aae-bf2e-c4a91d03627a tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:27:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6e19c71f-b5b5-4aae-bf2e-c4a91d03627a tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:25 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-6e19c71f-b5b5-4aae-bf2e-c4a91d03627a tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Deleted allocations for instance 5e29bda9-f1d6-4951-9343-f189934a8a23
Dec 05 15:27:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6e19c71f-b5b5-4aae-bf2e-c4a91d03627a tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "5e29bda9-f1d6-4951-9343-f189934a8a23" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.186s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:25 user nova-compute[75080]: DEBUG nova.compute.manager [req-c4e7cffd-5261-4e74-bb61-b3284a56ab26 req-a118e548-9964-4bf5-81b7-b6b99f396b84 service nova] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Received event network-vif-plugged-fb2619ea-ffe7-4d82-9b44-984ee393620c {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:27:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c4e7cffd-5261-4e74-bb61-b3284a56ab26 req-a118e548-9964-4bf5-81b7-b6b99f396b84 service nova] Acquiring lock "5e29bda9-f1d6-4951-9343-f189934a8a23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c4e7cffd-5261-4e74-bb61-b3284a56ab26 req-a118e548-9964-4bf5-81b7-b6b99f396b84 service nova] Lock "5e29bda9-f1d6-4951-9343-f189934a8a23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c4e7cffd-5261-4e74-bb61-b3284a56ab26 req-a118e548-9964-4bf5-81b7-b6b99f396b84 service nova] Lock "5e29bda9-f1d6-4951-9343-f189934a8a23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:25 user nova-compute[75080]: DEBUG nova.compute.manager [req-c4e7cffd-5261-4e74-bb61-b3284a56ab26 req-a118e548-9964-4bf5-81b7-b6b99f396b84 service nova] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] No waiting events found dispatching network-vif-plugged-fb2619ea-ffe7-4d82-9b44-984ee393620c {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:27:25 user nova-compute[75080]: WARNING nova.compute.manager [req-c4e7cffd-5261-4e74-bb61-b3284a56ab26 req-a118e548-9964-4bf5-81b7-b6b99f396b84 service nova] [instance: 5e29bda9-f1d6-4951-9343-f189934a8a23] Received unexpected event network-vif-plugged-fb2619ea-ffe7-4d82-9b44-984ee393620c for instance with vm_state deleted and task_state None.
Dec 05 15:27:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KesDLzjB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:27:27 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:27:27 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:27:27 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:27:27 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:27:27 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:27:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvXnmWMD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:27:27 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:27:27 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa3101f-4de2-415a-b5f3-c648885bc99c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:27:27 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93ef277-51ad-4c63-99bc-a479c62e09c1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960] added
Dec 05 15:27:27 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[376d27cc-a928-48bc-87a1-5b6aa50b7889]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7467270d-65ba-494b-b30d-470901469883]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KesDLzjB {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KesDLzjB" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aaf0414-a735-4c9b-bad5-579b49f99226]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KesDLzjB'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bdfe9b-45c6-4194-ba41-81718a625d01]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[662e4d37-ebcf-4b88-a925-af735cce3033]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:27:27 user nova-compute[75080]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:27:27 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:27:27 user nova-compute[75080]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:27:27 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b81d48-b827-4648-bdc1-7d7140ee5653]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960, portal: 172.16.0.220,3260]
Dec 05 15:27:27 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960, portal: 172.16.0.220,3260] successful.
Dec 05 15:27:27 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2203f7ca-9d1a-4753-a20d-4334db137dfb]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6b6c0e-5186-4471-ae63-00b0d1328a42]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:27:27 user nova-compute[75080]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:27:27 user nova-compute[75080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)
Dec 05 15:27:27 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:27:27 user nova-compute[75080]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:27:27 user nova-compute[75080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)
Dec 05 15:27:27 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced28074-220b-4300-b994-7853ff710c28]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KesDLzjB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:27:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:28 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:27:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:27:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23331663838616364', 'path': '/dev/sdb'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:27:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331663838616364', 'path': '/dev/sdb'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:27:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.295s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:27:28 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:27:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:27:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:27:28 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:27:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:28 user nova-compute[75080]: DEBUG nova.objects.instance [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lazy-loading 'flavor' on Instance uuid 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:27:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea68e3ad-3105-46f4-8d7b-2fa70e280557]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:27:28 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:27:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 15:27:28 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:27:28 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 15:27:28 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:27:28 user nova-compute[75080]:   <serial>d99fb99a-13b8-4dd8-a129-b0c0e68e9960</serial>
Dec 05 15:27:28 user nova-compute[75080]: </disk>
Dec 05 15:27:28 user nova-compute[75080]:  {{(pid=75080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 15:27:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da97a25-c232-4da2-bc67-6b76cb5552a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e] added
Dec 05 15:27:28 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:27:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e642db91-f0ea-4138-b609-d027a0f14417]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:27:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[70631084-eb6b-4f72-9c38-d33e2acaa4e8]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:27:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uvXnmWMD {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uvXnmWMD" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8357e8ed-a37d-48f4-acb6-366a51c119ed]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uvXnmWMD'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:27:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[65846de9-e933-4f8a-bb3e-f368559dc663]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:27:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe5da06-f211-4c78-aae6-ecd56db5cc7a]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:27:29 user nova-compute[75080]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:27:29 user nova-compute[75080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)
Dec 05 15:27:29 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:27:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:27:29 user nova-compute[75080]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:27:29 user nova-compute[75080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)
Dec 05 15:27:29 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:27:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0104047a-1d07-4600-8f2c-f37307528494]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e, portal: 172.16.0.220,3260]
Dec 05 15:27:29 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e, portal: 172.16.0.220,3260] successful.
Dec 05 15:27:29 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:27:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a78a030-284d-43c7-b186-77ff9157599c]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:27:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[798c96be-f72e-4738-bf1d-2b7f0999599e]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:27:29 user nova-compute[75080]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:27:29 user nova-compute[75080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)
Dec 05 15:27:29 user nova-compute[75080]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e (non-flash)
Dec 05 15:27:29 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:27:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:27:29 user nova-compute[75080]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:27:29 user nova-compute[75080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)
Dec 05 15:27:29 user nova-compute[75080]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e (non-flash)
Dec 05 15:27:29 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:27:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:27:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:27:29 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:27:29 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:27:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94bf364-e3f8-40b4-8012-152d4377e8bc]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:29 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: None {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:27:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:27:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:27:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] No VIF found with MAC fa:16:3e:3b:1f:ec, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:27:29 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:27:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-eff8a288-5005-4549-abb2-ebe5dd7b0f7f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.269s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:30 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:27:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvXnmWMD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:27:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:27:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] <== connect_volume: return (2645ms) {'type': 'block', 'scsi_wwn': '23738366166356531', 'path': '/dev/sdd'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:27:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738366166356531', 'path': '/dev/sdd'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:27:30 user nova-compute[75080]: DEBUG nova.objects.instance [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Lazy-loading 'flavor' on Instance uuid 845ee1b9-b8d5-4ac2-a8e2-792c037934b0 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:27:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 15:27:30 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:27:30 user nova-compute[75080]:   <source dev="/dev/sdd"/>
Dec 05 15:27:30 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:27:30 user nova-compute[75080]:   <serial>93939a1f-bbee-4e50-a599-900db2b04d8e</serial>
Dec 05 15:27:30 user nova-compute[75080]: </disk>
Dec 05 15:27:30 user nova-compute[75080]:  {{(pid=75080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 15:27:30 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:27:30 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:27:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:27:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:27:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] No VIF found with MAC fa:16:3e:83:3c:76, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:27:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "06d40106-075c-4b29-bfc5-a0224ece1d45" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "06d40106-075c-4b29-bfc5-a0224ece1d45" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:30 user nova-compute[75080]: DEBUG nova.compute.manager [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:27:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-412e1e40-082a-429e-9d35-013b72322761" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:27:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-412e1e40-082a-429e-9d35-013b72322761" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:27:30 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 412e1e40-082a-429e-9d35-013b72322761] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 15:27:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-de32c3c3-b01c-4d4f-902b-b4b7d45b8103 tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Lock "845ee1b9-b8d5-4ac2-a8e2-792c037934b0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.603s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:30 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:27:30 user nova-compute[75080]: INFO nova.compute.claims [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Claim successful on node user
Dec 05 15:27:31 user nova-compute[75080]: INFO nova.compute.manager [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Rescuing
Dec 05 15:27:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Acquiring lock "refresh_cache-60b8e21f-5fbd-4bc5-95ad-8d743ec796f7" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:27:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Acquired lock "refresh_cache-60b8e21f-5fbd-4bc5-95ad-8d743ec796f7" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:27:31 user nova-compute[75080]: DEBUG nova.network.neutron [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:27:31 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:27:31 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:27:31 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 412e1e40-082a-429e-9d35-013b72322761] Updating instance_info_cache with network_info: [{"id": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "address": "fa:16:3e:ab:04:37", "network": {"id": "3f7b7f16-6cc0-45b9-9f9c-efd112a71092", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-47517680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00d040579ca46338e01b8110a0ebc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78547a5f-e1", "ovs_interfaceid": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:27:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-412e1e40-082a-429e-9d35-013b72322761" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:27:31 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 412e1e40-082a-429e-9d35-013b72322761] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 15:27:31 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:27:31 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:27:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:31 user nova-compute[75080]: DEBUG nova.compute.manager [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:27:31 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:27:31 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:27:31 user nova-compute[75080]: DEBUG nova.compute.manager [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:27:31 user nova-compute[75080]: DEBUG nova.network.neutron [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:27:31 user nova-compute[75080]: DEBUG nova.network.neutron [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Updating instance_info_cache with network_info: [{"id": "6b187ba9-e311-4d40-8aa9-8f00feb45d88", "address": "fa:16:3e:3b:1f:ec", "network": {"id": "98270770-6a03-4b54-9160-a049184a508d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1275663774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecf8f0b6db8b4faeb2c3f5b580e05600", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b187ba9-e3", "ovs_interfaceid": "6b187ba9-e311-4d40-8aa9-8f00feb45d88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:27:31 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:27:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Releasing lock "refresh_cache-60b8e21f-5fbd-4bc5-95ad-8d743ec796f7" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:27:31 user nova-compute[75080]: DEBUG nova.compute.manager [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:27:31 user nova-compute[75080]: DEBUG nova.policy [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72a1c29faca44a4095dbda09561e5a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350b8a7b0ce4af7b83a280c0c1ec3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:27:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Acquiring lock "845ee1b9-b8d5-4ac2-a8e2-792c037934b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Lock "845ee1b9-b8d5-4ac2-a8e2-792c037934b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Acquiring lock "845ee1b9-b8d5-4ac2-a8e2-792c037934b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Lock "845ee1b9-b8d5-4ac2-a8e2-792c037934b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Lock "845ee1b9-b8d5-4ac2-a8e2-792c037934b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:31 user nova-compute[75080]: INFO nova.compute.manager [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Terminating instance
Dec 05 15:27:31 user nova-compute[75080]: DEBUG nova.compute.manager [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:27:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:31 user nova-compute[75080]: DEBUG nova.compute.manager [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:27:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:27:31 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Creating image(s)
Dec 05 15:27:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "/opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "/opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "/opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.234s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:32 user nova-compute[75080]: DEBUG nova.compute.manager [req-4829e6ee-0e9a-4c79-8e72-350b85f108ef req-71c48f3f-5d91-4726-83ef-ad6d31cdc013 service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Received event network-vif-unplugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:27:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4829e6ee-0e9a-4c79-8e72-350b85f108ef req-71c48f3f-5d91-4726-83ef-ad6d31cdc013 service nova] Acquiring lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4829e6ee-0e9a-4c79-8e72-350b85f108ef req-71c48f3f-5d91-4726-83ef-ad6d31cdc013 service nova] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4829e6ee-0e9a-4c79-8e72-350b85f108ef req-71c48f3f-5d91-4726-83ef-ad6d31cdc013 service nova] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:32 user nova-compute[75080]: DEBUG nova.compute.manager [req-4829e6ee-0e9a-4c79-8e72-350b85f108ef req-71c48f3f-5d91-4726-83ef-ad6d31cdc013 service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] No waiting events found dispatching network-vif-unplugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:27:32 user nova-compute[75080]: WARNING nova.compute.manager [req-4829e6ee-0e9a-4c79-8e72-350b85f108ef req-71c48f3f-5d91-4726-83ef-ad6d31cdc013 service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Received unexpected event network-vif-unplugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 for instance with vm_state active and task_state rescuing.
Dec 05 15:27:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:32 user nova-compute[75080]: DEBUG nova.compute.manager [None req-80d9dd5f-de1f-4dcd-b2a6-e9d966d89821 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:27:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.216s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45/disk 1073741824" returned: 0 in 0.055s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:32 user nova-compute[75080]: INFO nova.compute.manager [None req-80d9dd5f-de1f-4dcd-b2a6-e9d966d89821 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] instance snapshotting
Dec 05 15:27:32 user nova-compute[75080]: DEBUG nova.network.neutron [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Successfully created port: 5b00d45c-4fed-41ce-b3c1-67d45830034b {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:27:32 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-80d9dd5f-de1f-4dcd-b2a6-e9d966d89821 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Beginning live snapshot process
Dec 05 15:27:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.186s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:32 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Checking if we can resize image /opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 15:27:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-80d9dd5f-de1f-4dcd-b2a6-e9d966d89821 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk --force-share --output=json -f qcow2 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45/disk --force-share --output=json" returned: 0 in 0.313s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:32 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Cannot resize image /opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 15:27:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:27:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Ensure instance console log exists: /opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:27:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-80d9dd5f-de1f-4dcd-b2a6-e9d966d89821 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk --force-share --output=json -f qcow2" returned: 0 in 0.226s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-80d9dd5f-de1f-4dcd-b2a6-e9d966d89821 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk --force-share --output=json -f qcow2 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:33 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Instance destroyed successfully.
Dec 05 15:27:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:33 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Attempting a stable device rescue
Dec 05 15:27:33 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Instance destroyed successfully.
Dec 05 15:27:33 user nova-compute[75080]: DEBUG nova.objects.instance [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Lazy-loading 'resources' on Instance uuid 845ee1b9-b8d5-4ac2-a8e2-792c037934b0 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75080) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:25:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1993513088',display_name='tempest-DeleteServersTestJSON-server-1993513088',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1993513088',id=23,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:25:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab92d54e289b4749a13e57eade22a8db',ramdisk_id='',reservation_id='r-mq6l6fpr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1556760987',owner_user_name='tempest-DeleteServersTestJSON-1556760987-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:25:22Z,user_data=None,user_id='6b29543e5a2d45e08cc6d09b61c9ae0c',uuid=845ee1b9-b8d5-4ac2-a8e2-792c037934b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f70f0dca-a0a5-4b2f-b6ef-84422347dd49", "address": "fa:16:3e:83:3c:76", "network": {"id": "d4c7d48a-4f32-41d6-a1d8-d0c6b0df3c3f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-699668764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab92d54e289b4749a13e57eade22a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf70f0dca-a0", "ovs_interfaceid": "f70f0dca-a0a5-4b2f-b6ef-84422347dd49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Converting VIF {"id": "f70f0dca-a0a5-4b2f-b6ef-84422347dd49", "address": "fa:16:3e:83:3c:76", "network": {"id": "d4c7d48a-4f32-41d6-a1d8-d0c6b0df3c3f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-699668764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab92d54e289b4749a13e57eade22a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf70f0dca-a0", "ovs_interfaceid": "f70f0dca-a0a5-4b2f-b6ef-84422347dd49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:3c:76,bridge_name='br-int',has_traffic_filtering=True,id=f70f0dca-a0a5-4b2f-b6ef-84422347dd49,network=Network(d4c7d48a-4f32-41d6-a1d8-d0c6b0df3c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf70f0dca-a0') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG os_vif [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:3c:76,bridge_name='br-int',has_traffic_filtering=True,id=f70f0dca-a0a5-4b2f-b6ef-84422347dd49,network=Network(d4c7d48a-4f32-41d6-a1d8-d0c6b0df3c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf70f0dca-a0') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf70f0dca-a0, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Instance directory exists: not creating {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 05 15:27:33 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Creating image(s)
Dec 05 15:27:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Acquiring lock "/opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lock "/opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lock "/opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG nova.objects.instance [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lazy-loading 'trusted_certs' on Instance uuid 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e50ed939-7948-49a8-a585-335275708aa4) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-80d9dd5f-de1f-4dcd-b2a6-e9d966d89821 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk --force-share --output=json -f qcow2" returned: 0 in 0.276s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-80d9dd5f-de1f-4dcd-b2a6-e9d966d89821 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Acquiring lock "743326af1c1b89416c168e55cb540fe715fcd5cd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lock "743326af1c1b89416c168e55cb540fe715fcd5cd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG nova.network.neutron [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Successfully updated port: 5b00d45c-4fed-41ce-b3c1-67d45830034b {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:27:33 user nova-compute[75080]: INFO os_vif [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:3c:76,bridge_name='br-int',has_traffic_filtering=True,id=f70f0dca-a0a5-4b2f-b6ef-84422347dd49,network=Network(d4c7d48a-4f32-41d6-a1d8-d0c6b0df3c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf70f0dca-a0')
Dec 05 15:27:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvXnmWMD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:27:33 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:27:33 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG nova.compute.manager [req-7c585126-cb02-465d-b83c-b2b974e7988a req-44ea937e-5660-4c73-bd25-c6994cd9f506 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Received event network-changed-5b00d45c-4fed-41ce-b3c1-67d45830034b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG nova.compute.manager [req-7c585126-cb02-465d-b83c-b2b974e7988a req-44ea937e-5660-4c73-bd25-c6994cd9f506 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Refreshing instance network info cache due to event network-changed-5b00d45c-4fed-41ce-b3c1-67d45830034b. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7c585126-cb02-465d-b83c-b2b974e7988a req-44ea937e-5660-4c73-bd25-c6994cd9f506 service nova] Acquiring lock "refresh_cache-06d40106-075c-4b29-bfc5-a0224ece1d45" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7c585126-cb02-465d-b83c-b2b974e7988a req-44ea937e-5660-4c73-bd25-c6994cd9f506 service nova] Acquired lock "refresh_cache-06d40106-075c-4b29-bfc5-a0224ece1d45" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG nova.network.neutron [req-7c585126-cb02-465d-b83c-b2b974e7988a req-44ea937e-5660-4c73-bd25-c6994cd9f506 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Refreshing network info cache for port 5b00d45c-4fed-41ce-b3c1-67d45830034b {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "refresh_cache-06d40106-075c-4b29-bfc5-a0224ece1d45" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c324c773-dccd-4883-b968-a54528689f2a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:27:33 user nova-compute[75080]: No targets found.
Dec 05 15:27:33 user nova-compute[75080]: iSNS:
Dec 05 15:27:33 user nova-compute[75080]: No targets found.
Dec 05 15:27:33 user nova-compute[75080]: STATIC:
Dec 05 15:27:33 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399
Dec 05 15:27:33 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:27:33 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:27:33 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960
Dec 05 15:27:33 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:27:33 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:27:33 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e
Dec 05 15:27:33 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:27:33 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:27:33 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb
Dec 05 15:27:33 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:27:33 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:27:33 user nova-compute[75080]: FIRMWARE:
Dec 05 15:27:33 user nova-compute[75080]: No targets found.
Dec 05 15:27:33 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:27:33 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:27:33 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4aa10c-9f52-4d6e-b085-187900a0e86c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9f6db7-da5a-4031-8e29-c41f638451cf]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:27:33 user nova-compute[75080]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:27:33 user nova-compute[75080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)
Dec 05 15:27:33 user nova-compute[75080]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e (non-flash)
Dec 05 15:27:33 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:27:33 user nova-compute[75080]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:27:33 user nova-compute[75080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)
Dec 05 15:27:33 user nova-compute[75080]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e (non-flash)
Dec 05 15:27:33 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f66384a45e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e'): ({'sdd'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:27:33 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Removing single pathed devices sdd {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/743326af1c1b89416c168e55cb540fe715fcd5cd.part --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG nova.network.neutron [req-7c585126-cb02-465d-b83c-b2b974e7988a req-44ea937e-5660-4c73-bd25-c6994cd9f506 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0e1cff-1384-4621-90db-1d59635e69e5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG nova.compute.manager [req-7a161bb9-7ae4-4887-ae41-ab0ed4da8a8f req-861d92f7-b403-40f4-86f7-2dce8e0b6b0c service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Received event network-vif-plugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7a161bb9-7ae4-4887-ae41-ab0ed4da8a8f req-861d92f7-b403-40f4-86f7-2dce8e0b6b0c service nova] Acquiring lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7a161bb9-7ae4-4887-ae41-ab0ed4da8a8f req-861d92f7-b403-40f4-86f7-2dce8e0b6b0c service nova] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7a161bb9-7ae4-4887-ae41-ab0ed4da8a8f req-861d92f7-b403-40f4-86f7-2dce8e0b6b0c service nova] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG nova.compute.manager [req-7a161bb9-7ae4-4887-ae41-ab0ed4da8a8f req-861d92f7-b403-40f4-86f7-2dce8e0b6b0c service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] No waiting events found dispatching network-vif-plugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:27:34 user nova-compute[75080]: WARNING nova.compute.manager [req-7a161bb9-7ae4-4887-ae41-ab0ed4da8a8f req-861d92f7-b403-40f4-86f7-2dce8e0b6b0c service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Received unexpected event network-vif-plugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 for instance with vm_state active and task_state rescuing.
Dec 05 15:27:34 user nova-compute[75080]: DEBUG nova.compute.manager [req-7a161bb9-7ae4-4887-ae41-ab0ed4da8a8f req-861d92f7-b403-40f4-86f7-2dce8e0b6b0c service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Received event network-vif-plugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7a161bb9-7ae4-4887-ae41-ab0ed4da8a8f req-861d92f7-b403-40f4-86f7-2dce8e0b6b0c service nova] Acquiring lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7a161bb9-7ae4-4887-ae41-ab0ed4da8a8f req-861d92f7-b403-40f4-86f7-2dce8e0b6b0c service nova] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7a161bb9-7ae4-4887-ae41-ab0ed4da8a8f req-861d92f7-b403-40f4-86f7-2dce8e0b6b0c service nova] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG nova.compute.manager [req-7a161bb9-7ae4-4887-ae41-ab0ed4da8a8f req-861d92f7-b403-40f4-86f7-2dce8e0b6b0c service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] No waiting events found dispatching network-vif-plugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:27:34 user nova-compute[75080]: WARNING nova.compute.manager [req-7a161bb9-7ae4-4887-ae41-ab0ed4da8a8f req-861d92f7-b403-40f4-86f7-2dce8e0b6b0c service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Received unexpected event network-vif-plugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 for instance with vm_state active and task_state rescuing.
Dec 05 15:27:34 user nova-compute[75080]: DEBUG nova.compute.manager [req-7a161bb9-7ae4-4887-ae41-ab0ed4da8a8f req-861d92f7-b403-40f4-86f7-2dce8e0b6b0c service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Received event network-vif-plugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7a161bb9-7ae4-4887-ae41-ab0ed4da8a8f req-861d92f7-b403-40f4-86f7-2dce8e0b6b0c service nova] Acquiring lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7a161bb9-7ae4-4887-ae41-ab0ed4da8a8f req-861d92f7-b403-40f4-86f7-2dce8e0b6b0c service nova] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7a161bb9-7ae4-4887-ae41-ab0ed4da8a8f req-861d92f7-b403-40f4-86f7-2dce8e0b6b0c service nova] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG nova.compute.manager [req-7a161bb9-7ae4-4887-ae41-ab0ed4da8a8f req-861d92f7-b403-40f4-86f7-2dce8e0b6b0c service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] No waiting events found dispatching network-vif-plugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:27:34 user nova-compute[75080]: WARNING nova.compute.manager [req-7a161bb9-7ae4-4887-ae41-ab0ed4da8a8f req-861d92f7-b403-40f4-86f7-2dce8e0b6b0c service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Received unexpected event network-vif-plugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 for instance with vm_state active and task_state rescuing.
Dec 05 15:27:34 user nova-compute[75080]: DEBUG nova.compute.manager [req-7a161bb9-7ae4-4887-ae41-ab0ed4da8a8f req-861d92f7-b403-40f4-86f7-2dce8e0b6b0c service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Received event network-vif-unplugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7a161bb9-7ae4-4887-ae41-ab0ed4da8a8f req-861d92f7-b403-40f4-86f7-2dce8e0b6b0c service nova] Acquiring lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7a161bb9-7ae4-4887-ae41-ab0ed4da8a8f req-861d92f7-b403-40f4-86f7-2dce8e0b6b0c service nova] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7a161bb9-7ae4-4887-ae41-ab0ed4da8a8f req-861d92f7-b403-40f4-86f7-2dce8e0b6b0c service nova] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG nova.compute.manager [req-7a161bb9-7ae4-4887-ae41-ab0ed4da8a8f req-861d92f7-b403-40f4-86f7-2dce8e0b6b0c service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] No waiting events found dispatching network-vif-unplugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:27:34 user nova-compute[75080]: WARNING nova.compute.manager [req-7a161bb9-7ae4-4887-ae41-ab0ed4da8a8f req-861d92f7-b403-40f4-86f7-2dce8e0b6b0c service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Received unexpected event network-vif-unplugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 for instance with vm_state active and task_state rescuing.
Dec 05 15:27:34 user nova-compute[75080]: DEBUG nova.compute.manager [req-7a161bb9-7ae4-4887-ae41-ab0ed4da8a8f req-861d92f7-b403-40f4-86f7-2dce8e0b6b0c service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Received event network-vif-plugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7a161bb9-7ae4-4887-ae41-ab0ed4da8a8f req-861d92f7-b403-40f4-86f7-2dce8e0b6b0c service nova] Acquiring lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7a161bb9-7ae4-4887-ae41-ab0ed4da8a8f req-861d92f7-b403-40f4-86f7-2dce8e0b6b0c service nova] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7a161bb9-7ae4-4887-ae41-ab0ed4da8a8f req-861d92f7-b403-40f4-86f7-2dce8e0b6b0c service nova] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG nova.compute.manager [req-7a161bb9-7ae4-4887-ae41-ab0ed4da8a8f req-861d92f7-b403-40f4-86f7-2dce8e0b6b0c service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] No waiting events found dispatching network-vif-plugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:27:34 user nova-compute[75080]: WARNING nova.compute.manager [req-7a161bb9-7ae4-4887-ae41-ab0ed4da8a8f req-861d92f7-b403-40f4-86f7-2dce8e0b6b0c service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Received unexpected event network-vif-plugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 for instance with vm_state active and task_state rescuing.
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-80d9dd5f-de1f-4dcd-b2a6-e9d966d89821 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 1.273s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-80d9dd5f-de1f-4dcd-b2a6-e9d966d89821 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpr61lrgz6/d8f983b011324716845b3c6fb54219e4.delta 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[256a9a2f-e128-43cd-a34a-2689196b07b3]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Flushing IO for device /dev/sdd {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-80d9dd5f-de1f-4dcd-b2a6-e9d966d89821 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpr61lrgz6/d8f983b011324716845b3c6fb54219e4.delta 1073741824" returned: 0 in 0.066s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:34 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-80d9dd5f-de1f-4dcd-b2a6-e9d966d89821 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Quiescing instance not available: QEMU guest agent is not enabled.
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[71673e81-fee7-4d9d-89a7-c474c75d73cf]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/743326af1c1b89416c168e55cb540fe715fcd5cd.part --force-share --output=json" returned: 0 in 0.193s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG nova.virt.images [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] dc874935-1536-4160-ae5a-5a19675a07be was qcow2, converting to raw {{(pid=75080) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG nova.privsep.utils [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75080) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/743326af1c1b89416c168e55cb540fe715fcd5cd.part /opt/stack/data/nova/instances/_base/743326af1c1b89416c168e55cb540fe715fcd5cd.converted {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d67a5ed-775d-46fc-a690-d93700887f38]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] SCSI volumes sdd have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.050s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[79199b53-53de-4b46-9082-2f43cc42d3bb]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG nova.network.neutron [req-7c585126-cb02-465d-b83c-b2b974e7988a req-44ea937e-5660-4c73-bd25-c6994cd9f506 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7c585126-cb02-465d-b83c-b2b974e7988a req-44ea937e-5660-4c73-bd25-c6994cd9f506 service nova] Releasing lock "refresh_cache-06d40106-075c-4b29-bfc5-a0224ece1d45" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquired lock "refresh_cache-06d40106-075c-4b29-bfc5-a0224ece1d45" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG nova.network.neutron [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e -p 172.16.0.220:3260 --logout" returned: 0 in 0.149s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76d8c26-f1e8-4ba8-ae92-822174d2bdb1]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e, portal: 172.16.0.220,3260]
Dec 05 15:27:34 user nova-compute[75080]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e, portal: 172.16.0.220,3260] successful.
Dec 05 15:27:34 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93939a1f-bbee-4e50-a599-900db2b04d8e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cce522-ce63-471a-8b11-321a6ff1e2bf]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 1.583s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] <== disconnect_volume: return (1585ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:27:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:27:34 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Deleting instance files /opt/stack/data/nova/instances/845ee1b9-b8d5-4ac2-a8e2-792c037934b0_del
Dec 05 15:27:34 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Deletion of /opt/stack/data/nova/instances/845ee1b9-b8d5-4ac2-a8e2-792c037934b0_del complete
Dec 05 15:27:34 user nova-compute[75080]: DEBUG nova.network.neutron [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/743326af1c1b89416c168e55cb540fe715fcd5cd.part /opt/stack/data/nova/instances/_base/743326af1c1b89416c168e55cb540fe715fcd5cd.converted" returned: 0 in 0.521s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/743326af1c1b89416c168e55cb540fe715fcd5cd.converted --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:35 user nova-compute[75080]: INFO nova.compute.manager [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Took 3.42 seconds to destroy the instance on the hypervisor.
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/743326af1c1b89416c168e55cb540fe715fcd5cd.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lock "743326af1c1b89416c168e55cb540fe715fcd5cd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.044s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Acquiring lock "743326af1c1b89416c168e55cb540fe715fcd5cd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lock "743326af1c1b89416c168e55cb540fe715fcd5cd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/743326af1c1b89416c168e55cb540fe715fcd5cd --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.network.neutron [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Updating instance_info_cache with network_info: [{"id": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "address": "fa:16:3e:e1:1a:b2", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b00d45c-4f", "ovs_interfaceid": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.compute.manager [req-05dfb955-f164-48b9-9ce0-bb332cec8afb req-2c8284a4-02d7-4dd3-a62a-5858437252b2 service nova] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Received event network-vif-unplugged-f70f0dca-a0a5-4b2f-b6ef-84422347dd49 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-05dfb955-f164-48b9-9ce0-bb332cec8afb req-2c8284a4-02d7-4dd3-a62a-5858437252b2 service nova] Acquiring lock "845ee1b9-b8d5-4ac2-a8e2-792c037934b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-05dfb955-f164-48b9-9ce0-bb332cec8afb req-2c8284a4-02d7-4dd3-a62a-5858437252b2 service nova] Lock "845ee1b9-b8d5-4ac2-a8e2-792c037934b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-05dfb955-f164-48b9-9ce0-bb332cec8afb req-2c8284a4-02d7-4dd3-a62a-5858437252b2 service nova] Lock "845ee1b9-b8d5-4ac2-a8e2-792c037934b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.compute.manager [req-05dfb955-f164-48b9-9ce0-bb332cec8afb req-2c8284a4-02d7-4dd3-a62a-5858437252b2 service nova] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] No waiting events found dispatching network-vif-unplugged-f70f0dca-a0a5-4b2f-b6ef-84422347dd49 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.compute.manager [req-05dfb955-f164-48b9-9ce0-bb332cec8afb req-2c8284a4-02d7-4dd3-a62a-5858437252b2 service nova] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Received event network-vif-unplugged-f70f0dca-a0a5-4b2f-b6ef-84422347dd49 for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.compute.manager [req-05dfb955-f164-48b9-9ce0-bb332cec8afb req-2c8284a4-02d7-4dd3-a62a-5858437252b2 service nova] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Received event network-vif-plugged-f70f0dca-a0a5-4b2f-b6ef-84422347dd49 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-05dfb955-f164-48b9-9ce0-bb332cec8afb req-2c8284a4-02d7-4dd3-a62a-5858437252b2 service nova] Acquiring lock "845ee1b9-b8d5-4ac2-a8e2-792c037934b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-05dfb955-f164-48b9-9ce0-bb332cec8afb req-2c8284a4-02d7-4dd3-a62a-5858437252b2 service nova] Lock "845ee1b9-b8d5-4ac2-a8e2-792c037934b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-05dfb955-f164-48b9-9ce0-bb332cec8afb req-2c8284a4-02d7-4dd3-a62a-5858437252b2 service nova] Lock "845ee1b9-b8d5-4ac2-a8e2-792c037934b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.compute.manager [req-05dfb955-f164-48b9-9ce0-bb332cec8afb req-2c8284a4-02d7-4dd3-a62a-5858437252b2 service nova] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] No waiting events found dispatching network-vif-plugged-f70f0dca-a0a5-4b2f-b6ef-84422347dd49 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:27:35 user nova-compute[75080]: WARNING nova.compute.manager [req-05dfb955-f164-48b9-9ce0-bb332cec8afb req-2c8284a4-02d7-4dd3-a62a-5858437252b2 service nova] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Received unexpected event network-vif-plugged-f70f0dca-a0a5-4b2f-b6ef-84422347dd49 for instance with vm_state active and task_state deleting.
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Releasing lock "refresh_cache-06d40106-075c-4b29-bfc5-a0224ece1d45" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.compute.manager [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Instance network_info: |[{"id": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "address": "fa:16:3e:e1:1a:b2", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b00d45c-4f", "ovs_interfaceid": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Start _get_guest_xml network_info=[{"id": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "address": "fa:16:3e:e1:1a:b2", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b00d45c-4f", "ovs_interfaceid": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:27:35 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:27:35 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-80d9dd5f-de1f-4dcd-b2a6-e9d966d89821 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] COPY block job progress, current cursor: 524288 final cursor: 75563008 {{(pid=75080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:27:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1271607709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1271607709',id=25,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGEyzTF/B823LkyDU5gfGCuteT4fw75ySbVBKx+2tT0hOUi9Rmtt937/xjcCneA2bSTThW3EBbFbXM26bm1fIZOeGSIiFiMwCwlEia7YhFfTC54hx2NA1hMW/7xxyngiLg==',key_name='tempest-keypair-755329848',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6350b8a7b0ce4af7b83a280c0c1ec3e6',ramdisk_id='',reservation_id='r-33v9h4hw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-132988477',owner_user_name='tempest-AttachVolumeShelveTestJSON-132988477-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:27:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72a1c29faca44a4095dbda09561e5a91',uuid=06d40106-075c-4b29-bfc5-a0224ece1d45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "address": "fa:16:3e:e1:1a:b2", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b00d45c-4f", "ovs_interfaceid": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Converting VIF {"id": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "address": "fa:16:3e:e1:1a:b2", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b00d45c-4f", "ovs_interfaceid": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1a:b2,bridge_name='br-int',has_traffic_filtering=True,id=5b00d45c-4fed-41ce-b3c1-67d45830034b,network=Network(b94a6985-25b3-480e-b79f-b753c8b23fa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b00d45c-4f') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.objects.instance [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lazy-loading 'pci_devices' on Instance uuid 06d40106-075c-4b29-bfc5-a0224ece1d45 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/743326af1c1b89416c168e55cb540fe715fcd5cd --force-share --output=json" returned: 0 in 0.242s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/743326af1c1b89416c168e55cb540fe715fcd5cd,backing_fmt=raw /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk.rescue {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:27:35 user nova-compute[75080]:   <uuid>06d40106-075c-4b29-bfc5-a0224ece1d45</uuid>
Dec 05 15:27:35 user nova-compute[75080]:   <name>instance-00000019</name>
Dec 05 15:27:35 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:27:35 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:27:35 user nova-compute[75080]:   <metadata>
Dec 05 15:27:35 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:27:35 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:27:35 user nova-compute[75080]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1271607709</nova:name>
Dec 05 15:27:35 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:27:35</nova:creationTime>
Dec 05 15:27:35 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:27:35 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:27:35 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:27:35 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:27:35 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:27:35 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:27:35 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:27:35 user nova-compute[75080]:       <nova:owner>
Dec 05 15:27:35 user nova-compute[75080]:         <nova:user uuid="72a1c29faca44a4095dbda09561e5a91">tempest-AttachVolumeShelveTestJSON-132988477-project-member</nova:user>
Dec 05 15:27:35 user nova-compute[75080]:         <nova:project uuid="6350b8a7b0ce4af7b83a280c0c1ec3e6">tempest-AttachVolumeShelveTestJSON-132988477</nova:project>
Dec 05 15:27:35 user nova-compute[75080]:       </nova:owner>
Dec 05 15:27:35 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:27:35 user nova-compute[75080]:       <nova:ports>
Dec 05 15:27:35 user nova-compute[75080]:         <nova:port uuid="5b00d45c-4fed-41ce-b3c1-67d45830034b">
Dec 05 15:27:35 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 05 15:27:35 user nova-compute[75080]:         </nova:port>
Dec 05 15:27:35 user nova-compute[75080]:       </nova:ports>
Dec 05 15:27:35 user nova-compute[75080]:     </nova:instance>
Dec 05 15:27:35 user nova-compute[75080]:   </metadata>
Dec 05 15:27:35 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:27:35 user nova-compute[75080]:     <system>
Dec 05 15:27:35 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:27:35 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:27:35 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:27:35 user nova-compute[75080]:       <entry name="serial">06d40106-075c-4b29-bfc5-a0224ece1d45</entry>
Dec 05 15:27:35 user nova-compute[75080]:       <entry name="uuid">06d40106-075c-4b29-bfc5-a0224ece1d45</entry>
Dec 05 15:27:35 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:27:35 user nova-compute[75080]:     </system>
Dec 05 15:27:35 user nova-compute[75080]:   </sysinfo>
Dec 05 15:27:35 user nova-compute[75080]:   <os>
Dec 05 15:27:35 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:27:35 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:27:35 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:27:35 user nova-compute[75080]:   </os>
Dec 05 15:27:35 user nova-compute[75080]:   <features>
Dec 05 15:27:35 user nova-compute[75080]:     <acpi/>
Dec 05 15:27:35 user nova-compute[75080]:     <apic/>
Dec 05 15:27:35 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:27:35 user nova-compute[75080]:   </features>
Dec 05 15:27:35 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:27:35 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:27:35 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:27:35 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:27:35 user nova-compute[75080]:   </clock>
Dec 05 15:27:35 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:27:35 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:27:35 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:27:35 user nova-compute[75080]:   </cpu>
Dec 05 15:27:35 user nova-compute[75080]:   <devices>
Dec 05 15:27:35 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:27:35 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:27:35 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45/disk"/>
Dec 05 15:27:35 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:27:35 user nova-compute[75080]:     </disk>
Dec 05 15:27:35 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:27:35 user nova-compute[75080]:       <mac address="fa:16:3e:e1:1a:b2"/>
Dec 05 15:27:35 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:27:35 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:27:35 user nova-compute[75080]:       <target dev="tap5b00d45c-4f"/>
Dec 05 15:27:35 user nova-compute[75080]:     </interface>
Dec 05 15:27:35 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:27:35 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45/console.log" append="off"/>
Dec 05 15:27:35 user nova-compute[75080]:     </serial>
Dec 05 15:27:35 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:27:35 user nova-compute[75080]:     <video>
Dec 05 15:27:35 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:27:35 user nova-compute[75080]:     </video>
Dec 05 15:27:35 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:27:35 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:27:35 user nova-compute[75080]:     </rng>
Dec 05 15:27:35 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:27:35 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:27:35 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:27:35 user nova-compute[75080]:     </memballoon>
Dec 05 15:27:35 user nova-compute[75080]:   </devices>
Dec 05 15:27:35 user nova-compute[75080]: </domain>
Dec 05 15:27:35 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:27:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1271607709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1271607709',id=25,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGEyzTF/B823LkyDU5gfGCuteT4fw75ySbVBKx+2tT0hOUi9Rmtt937/xjcCneA2bSTThW3EBbFbXM26bm1fIZOeGSIiFiMwCwlEia7YhFfTC54hx2NA1hMW/7xxyngiLg==',key_name='tempest-keypair-755329848',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6350b8a7b0ce4af7b83a280c0c1ec3e6',ramdisk_id='',reservation_id='r-33v9h4hw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-132988477',owner_user_name='tempest-AttachVolumeShelveTestJSON-132988477-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:27:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72a1c29faca44a4095dbda09561e5a91',uuid=06d40106-075c-4b29-bfc5-a0224ece1d45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "address": "fa:16:3e:e1:1a:b2", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b00d45c-4f", "ovs_interfaceid": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Converting VIF {"id": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "address": "fa:16:3e:e1:1a:b2", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b00d45c-4f", "ovs_interfaceid": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1a:b2,bridge_name='br-int',has_traffic_filtering=True,id=5b00d45c-4fed-41ce-b3c1-67d45830034b,network=Network(b94a6985-25b3-480e-b79f-b753c8b23fa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b00d45c-4f') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG os_vif [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1a:b2,bridge_name='br-int',has_traffic_filtering=True,id=5b00d45c-4fed-41ce-b3c1-67d45830034b,network=Network(b94a6985-25b3-480e-b79f-b753c8b23fa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b00d45c-4f') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/743326af1c1b89416c168e55cb540fe715fcd5cd,backing_fmt=raw /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk.rescue" returned: 0 in 0.065s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e14c3219-9cff-5136-97b4-911a534ba506', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lock "743326af1c1b89416c168e55cb540fe715fcd5cd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.313s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.objects.instance [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lazy-loading 'migration_context' on Instance uuid 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.objects.base [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Object Instance<60b8e21f-5fbd-4bc5-95ad-8d743ec796f7> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Start _get_guest_xml network_info=[{"id": "6b187ba9-e311-4d40-8aa9-8f00feb45d88", "address": "fa:16:3e:3b:1f:ec", "network": {"id": "98270770-6a03-4b54-9160-a049184a508d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1275663774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1275663774-network", "vif_mac": "fa:16:3e:3b:1f:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecf8f0b6db8b4faeb2c3f5b580e05600", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b187ba9-e3", "ovs_interfaceid": "6b187ba9-e311-4d40-8aa9-8f00feb45d88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'dc874935-1536-4160-ae5a-5a19675a07be', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KesDLzjB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '60b8e21f-5fbd-4bc5-95ad-8d743ec796f7', 'attached_at': '', 'detached_at': '', 'volume_id': 'd99fb99a-13b8-4dd8-a129-b0c0e68e9960', 'serial': 'd99fb99a-13b8-4dd8-a129-b0c0e68e9960'}, 'device_type': 'disk', 'attachment_id': '9888f253-fcb4-470b-ae2a-ef70db4028d2', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.objects.instance [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lazy-loading 'resources' on Instance uuid 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b00d45c-4f, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b00d45c-4f, col_values=(('qos', UUID('25bb60fe-ec6c-4a1b-ad25-077f26c156d9')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b00d45c-4f, col_values=(('external_ids', {'iface-id': '5b00d45c-4fed-41ce-b3c1-67d45830034b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:1a:b2', 'vm-uuid': '06d40106-075c-4b29-bfc5-a0224ece1d45'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.objects.base [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Object Instance<60b8e21f-5fbd-4bc5-95ad-8d743ec796f7> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.objects.instance [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lazy-loading 'numa_topology' on Instance uuid 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:35 user nova-compute[75080]: INFO os_vif [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1a:b2,bridge_name='br-int',has_traffic_filtering=True,id=5b00d45c-4fed-41ce-b3c1-67d45830034b,network=Network(b94a6985-25b3-480e-b79f-b753c8b23fa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b00d45c-4f')
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.objects.base [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Object Instance<60b8e21f-5fbd-4bc5-95ad-8d743ec796f7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:27:35 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:27:35 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.objects.instance [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lazy-loading 'vcpu_model' on Instance uuid 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.objects.base [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Object Instance<60b8e21f-5fbd-4bc5-95ad-8d743ec796f7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KesDLzjB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:27:35 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:27:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:27:35 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:27:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:27:35 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] No VIF found with MAC fa:16:3e:e1:1a:b2, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 -p 172.16.0.220:3260" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[218f7796-2306-48a2-91c1-1d56b67fec41]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = KesDLzjB\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Dec 05 15:27:35 user nova-compute[75080]: node.name = iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960
Dec 05 15:27:35 user nova-compute[75080]: node.tpgt = -1
Dec 05 15:27:35 user nova-compute[75080]: node.startup = automatic
Dec 05 15:27:35 user nova-compute[75080]: node.leading_login = No
Dec 05 15:27:35 user nova-compute[75080]: iface.iscsi_ifacename = default
Dec 05 15:27:35 user nova-compute[75080]: iface.net_ifacename = <empty>
Dec 05 15:27:35 user nova-compute[75080]: iface.ipaddress = <empty>
Dec 05 15:27:35 user nova-compute[75080]: iface.prefix_len = 0
Dec 05 15:27:35 user nova-compute[75080]: iface.hwaddress = <empty>
Dec 05 15:27:35 user nova-compute[75080]: iface.transport_name = tcp
Dec 05 15:27:35 user nova-compute[75080]: iface.initiatorname = <empty>
Dec 05 15:27:35 user nova-compute[75080]: iface.state = <empty>
Dec 05 15:27:35 user nova-compute[75080]: iface.vlan_id = 0
Dec 05 15:27:35 user nova-compute[75080]: iface.vlan_priority = 0
Dec 05 15:27:35 user nova-compute[75080]: iface.vlan_state = <empty>
Dec 05 15:27:35 user nova-compute[75080]: iface.iface_num = 0
Dec 05 15:27:35 user nova-compute[75080]: iface.mtu = 0
Dec 05 15:27:35 user nova-compute[75080]: iface.port = 0
Dec 05 15:27:35 user nova-compute[75080]: iface.bootproto = <empty>
Dec 05 15:27:35 user nova-compute[75080]: iface.subnet_mask = <empty>
Dec 05 15:27:35 user nova-compute[75080]: iface.gateway = <empty>
Dec 05 15:27:35 user nova-compute[75080]: iface.dhcp_alt_client_id_state = <empty>
Dec 05 15:27:35 user nova-compute[75080]: iface.dhcp_alt_client_id = <empty>
Dec 05 15:27:35 user nova-compute[75080]: iface.dhcp_dns = <empty>
Dec 05 15:27:35 user nova-compute[75080]: iface.dhcp_learn_iqn = <empty>
Dec 05 15:27:35 user nova-compute[75080]: iface.dhcp_req_vendor_id_state = <empty>
Dec 05 15:27:35 user nova-compute[75080]: iface.dhcp_vendor_id_state = <empty>
Dec 05 15:27:35 user nova-compute[75080]: iface.dhcp_vendor_id = <empty>
Dec 05 15:27:35 user nova-compute[75080]: iface.dhcp_slp_da = <empty>
Dec 05 15:27:35 user nova-compute[75080]: iface.fragmentation = <empty>
Dec 05 15:27:35 user nova-compute[75080]: iface.gratuitous_arp = <empty>
Dec 05 15:27:35 user nova-compute[75080]: iface.incoming_forwarding = <empty>
Dec 05 15:27:35 user nova-compute[75080]: iface.tos_state = <empty>
Dec 05 15:27:35 user nova-compute[75080]: iface.tos = 0
Dec 05 15:27:35 user nova-compute[75080]: iface.ttl = 0
Dec 05 15:27:35 user nova-compute[75080]: iface.delayed_ack = <empty>
Dec 05 15:27:35 user nova-compute[75080]: iface.tcp_nagle = <empty>
Dec 05 15:27:35 user nova-compute[75080]: iface.tcp_wsf_state = <empty>
Dec 05 15:27:35 user nova-compute[75080]: iface.tcp_wsf = 0
Dec 05 15:27:35 user nova-compute[75080]: iface.tcp_timer_scale = 0
Dec 05 15:27:35 user nova-compute[75080]: iface.tcp_timestamp = <empty>
Dec 05 15:27:35 user nova-compute[75080]: iface.redirect = <empty>
Dec 05 15:27:35 user nova-compute[75080]: iface.def_task_mgmt_timeout = 0
Dec 05 15:27:35 user nova-compute[75080]: iface.header_digest = <empty>
Dec 05 15:27:35 user nova-compute[75080]: iface.data_digest = <empty>
Dec 05 15:27:35 user nova-compute[75080]: iface.immediate_data = <empty>
Dec 05 15:27:35 user nova-compute[75080]: iface.initial_r2t = <empty>
Dec 05 15:27:35 user nova-compute[75080]: iface.data_seq_inorder = <empty>
Dec 05 15:27:35 user nova-compute[75080]: iface.data_pdu_inorder = <empty>
Dec 05 15:27:35 user nova-compute[75080]: iface.erl = 0
Dec 05 15:27:35 user nova-compute[75080]: iface.max_receive_data_len = 0
Dec 05 15:27:35 user nova-compute[75080]: iface.first_burst_len = 0
Dec 05 15:27:35 user nova-compute[75080]: iface.max_outstanding_r2t = 0
Dec 05 15:27:35 user nova-compute[75080]: iface.max_burst_len = 0
Dec 05 15:27:35 user nova-compute[75080]: iface.chap_auth = <empty>
Dec 05 15:27:35 user nova-compute[75080]: iface.bidi_chap = <empty>
Dec 05 15:27:35 user nova-compute[75080]: iface.strict_login_compliance = <empty>
Dec 05 15:27:35 user nova-compute[75080]: iface.discovery_auth = <empty>
Dec 05 15:27:35 user nova-compute[75080]: iface.discovery_logout = <empty>
Dec 05 15:27:35 user nova-compute[75080]: node.discovery_address = <empty>
Dec 05 15:27:35 user nova-compute[75080]: node.discovery_port = 0
Dec 05 15:27:35 user nova-compute[75080]: node.discovery_type = static
Dec 05 15:27:35 user nova-compute[75080]: node.session.initial_cmdsn = 0
Dec 05 15:27:35 user nova-compute[75080]: node.session.initial_login_retry_max = 8
Dec 05 15:27:35 user nova-compute[75080]: node.session.xmit_thread_priority = -20
Dec 05 15:27:35 user nova-compute[75080]: node.session.cmds_max = 128
Dec 05 15:27:35 user nova-compute[75080]: node.session.queue_depth = 32
Dec 05 15:27:35 user nova-compute[75080]: node.session.nr_sessions = 1
Dec 05 15:27:35 user nova-compute[75080]: node.session.auth.authmethod = CHAP
Dec 05 15:27:35 user nova-compute[75080]: node.session.auth.username = KesDLzjB
Dec 05 15:27:35 user nova-compute[75080]: node.session.auth.password = ***
Dec 05 15:27:35 user nova-compute[75080]: node.session.auth.username_in = <empty>
Dec 05 15:27:35 user nova-compute[75080]: node.session.auth.password_in = <empty>
Dec 05 15:27:35 user nova-compute[75080]: node.session.auth.chap_algs = MD5
Dec 05 15:27:35 user nova-compute[75080]: node.session.timeo.replacement_timeout = 120
Dec 05 15:27:35 user nova-compute[75080]: node.session.err_timeo.abort_timeout = 15
Dec 05 15:27:35 user nova-compute[75080]: node.session.err_timeo.lu_reset_timeout = 30
Dec 05 15:27:35 user nova-compute[75080]: node.session.err_timeo.tgt_reset_timeout = 30
Dec 05 15:27:35 user nova-compute[75080]: node.session.err_timeo.host_reset_timeout = 60
Dec 05 15:27:35 user nova-compute[75080]: node.session.iscsi.FastAbort = Yes
Dec 05 15:27:35 user nova-compute[75080]: node.session.iscsi.InitialR2T = No
Dec 05 15:27:35 user nova-compute[75080]: node.session.iscsi.ImmediateData = Yes
Dec 05 15:27:35 user nova-compute[75080]: node.session.iscsi.FirstBurstLength = 262144
Dec 05 15:27:35 user nova-compute[75080]: node.session.iscsi.MaxBurstLength = 16776192
Dec 05 15:27:35 user nova-compute[75080]: node.session.iscsi.DefaultTime2Retain = 0
Dec 05 15:27:35 user nova-compute[75080]: node.session.iscsi.DefaultTime2Wait = 2
Dec 05 15:27:35 user nova-compute[75080]: node.session.iscsi.MaxConnections = 1
Dec 05 15:27:35 user nova-compute[75080]: node.session.iscsi.MaxOutstandingR2T = 1
Dec 05 15:27:35 user nova-compute[75080]: node.session.iscsi.ERL = 0
Dec 05 15:27:35 user nova-compute[75080]: node.session.scan = manual
Dec 05 15:27:35 user nova-compute[75080]: node.session.reopen_max = 0
Dec 05 15:27:35 user nova-compute[75080]: node.conn[0].address = 172.16.0.220
Dec 05 15:27:35 user nova-compute[75080]: node.conn[0].port = 3260
Dec 05 15:27:35 user nova-compute[75080]: node.conn[0].startup = manual
Dec 05 15:27:35 user nova-compute[75080]: node.conn[0].tcp.window_size = 524288
Dec 05 15:27:35 user nova-compute[75080]: node.conn[0].tcp.type_of_service = 0
Dec 05 15:27:35 user nova-compute[75080]: node.conn[0].timeo.logout_timeout = 15
Dec 05 15:27:35 user nova-compute[75080]: node.conn[0].timeo.login_timeout = 15
Dec 05 15:27:35 user nova-compute[75080]: node.conn[0].timeo.auth_timeout = 45
Dec 05 15:27:35 user nova-compute[75080]: node.conn[0].timeo.noop_out_interval = 5
Dec 05 15:27:35 user nova-compute[75080]: node.conn[0].timeo.noop_out_timeout = 5
Dec 05 15:27:35 user nova-compute[75080]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Dec 05 15:27:35 user nova-compute[75080]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Dec 05 15:27:35 user nova-compute[75080]: node.conn[0].iscsi.HeaderDigest = None
Dec 05 15:27:35 user nova-compute[75080]: node.conn[0].iscsi.DataDigest = None
Dec 05 15:27:35 user nova-compute[75080]: node.conn[0].iscsi.IFMarker = No
Dec 05 15:27:35 user nova-compute[75080]: node.conn[0].iscsi.OFMarker = No
Dec 05 15:27:35 user nova-compute[75080]: # END RECORD
Dec 05 15:27:35 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:27:35 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Took 0.66 seconds to deallocate network for instance.
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[89864815-666f-466f-9559-122d781a13a8]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b13431-b2a9-418e-91a5-2b10f81320eb]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KesDLzjB {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KesDLzjB" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51b96ce-c138-4919-a90b-ce46e43e3317]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KesDLzjB'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-80d9dd5f-de1f-4dcd-b2a6-e9d966d89821 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedf3b50-b3b0-4265-8ef4-21767617e161]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:27:35 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-80d9dd5f-de1f-4dcd-b2a6-e9d966d89821 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[366818b4-d865-4cdd-bbfb-31d9898c472b]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:27:35 user nova-compute[75080]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:27:35 user nova-compute[75080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)
Dec 05 15:27:35 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:27:35 user nova-compute[75080]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:27:35 user nova-compute[75080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)
Dec 05 15:27:35 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.186s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] HCTL ('33', '0', '0', 0) found on session 28 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ea65f3-6db8-417c-88be-aae0252ee2be]: (4, ('0 0 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Searching for a device in session 28 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KesDLzjB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.247s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] <== connect_volume: return (249ms) {'type': 'block', 'scsi_wwn': '23331663838616364', 'path': '/dev/sdb'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:27:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331663838616364', 'path': '/dev/sdb'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:27:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-44459294',display_name='tempest-ServerStableDeviceRescueTest-server-44459294',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-44459294',id=19,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPWS3/W2vhVnzZ3NaYXtEquVmBoozY3zOCiGSaoCx4S9+RZI8lcD2eBXGHkJL7aTNIcbbWFdKvFHZ3EJ7KZ38K040A64F6R0O0DMD87IGDq0dpPKOqp9lZ2b8iXtRJnSg==',key_name='tempest-keypair-110561965',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:23:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ecf8f0b6db8b4faeb2c3f5b580e05600',ramdisk_id='',reservation_id='r-9pxkj28l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-701514044',owner_user_name='tempest-ServerStableDeviceRescueTest-701514044-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:25:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='180f6d2698714da0b8585c593d91412f',uuid=60b8e21f-5fbd-4bc5-95ad-8d743ec796f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b187ba9-e311-4d40-8aa9-8f00feb45d88", "address": "fa:16:3e:3b:1f:ec", "network": {"id": "98270770-6a03-4b54-9160-a049184a508d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1275663774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1275663774-network", "vif_mac": "fa:16:3e:3b:1f:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecf8f0b6db8b4faeb2c3f5b580e05600", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b187ba9-e3", "ovs_interfaceid": "6b187ba9-e311-4d40-8aa9-8f00feb45d88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:27:36 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Converting VIF {"id": "6b187ba9-e311-4d40-8aa9-8f00feb45d88", "address": "fa:16:3e:3b:1f:ec", "network": {"id": "98270770-6a03-4b54-9160-a049184a508d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1275663774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1275663774-network", "vif_mac": "fa:16:3e:3b:1f:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecf8f0b6db8b4faeb2c3f5b580e05600", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b187ba9-e3", "ovs_interfaceid": "6b187ba9-e311-4d40-8aa9-8f00feb45d88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:27:36 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:1f:ec,bridge_name='br-int',has_traffic_filtering=True,id=6b187ba9-e311-4d40-8aa9-8f00feb45d88,network=Network(98270770-6a03-4b54-9160-a049184a508d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b187ba9-e3') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:27:36 user nova-compute[75080]: DEBUG nova.objects.instance [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lazy-loading 'pci_devices' on Instance uuid 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:27:36 user nova-compute[75080]: DEBUG nova.objects.base [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Object Instance<60b8e21f-5fbd-4bc5-95ad-8d743ec796f7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:27:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:27:36 user nova-compute[75080]:   <uuid>60b8e21f-5fbd-4bc5-95ad-8d743ec796f7</uuid>
Dec 05 15:27:36 user nova-compute[75080]:   <name>instance-00000013</name>
Dec 05 15:27:36 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:27:36 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:27:36 user nova-compute[75080]:   <metadata>
Dec 05 15:27:36 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:27:36 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:27:36 user nova-compute[75080]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-44459294</nova:name>
Dec 05 15:27:36 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:27:35</nova:creationTime>
Dec 05 15:27:36 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:27:36 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:27:36 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:27:36 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:27:36 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:27:36 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:27:36 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:27:36 user nova-compute[75080]:       <nova:owner>
Dec 05 15:27:36 user nova-compute[75080]:         <nova:user uuid="180f6d2698714da0b8585c593d91412f">tempest-ServerStableDeviceRescueTest-701514044-project-member</nova:user>
Dec 05 15:27:36 user nova-compute[75080]:         <nova:project uuid="ecf8f0b6db8b4faeb2c3f5b580e05600">tempest-ServerStableDeviceRescueTest-701514044</nova:project>
Dec 05 15:27:36 user nova-compute[75080]:       </nova:owner>
Dec 05 15:27:36 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:27:36 user nova-compute[75080]:       <nova:ports>
Dec 05 15:27:36 user nova-compute[75080]:         <nova:port uuid="6b187ba9-e311-4d40-8aa9-8f00feb45d88">
Dec 05 15:27:36 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 05 15:27:36 user nova-compute[75080]:         </nova:port>
Dec 05 15:27:36 user nova-compute[75080]:       </nova:ports>
Dec 05 15:27:36 user nova-compute[75080]:     </nova:instance>
Dec 05 15:27:36 user nova-compute[75080]:   </metadata>
Dec 05 15:27:36 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:27:36 user nova-compute[75080]:     <system>
Dec 05 15:27:36 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:27:36 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:27:36 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:27:36 user nova-compute[75080]:       <entry name="serial">60b8e21f-5fbd-4bc5-95ad-8d743ec796f7</entry>
Dec 05 15:27:36 user nova-compute[75080]:       <entry name="uuid">60b8e21f-5fbd-4bc5-95ad-8d743ec796f7</entry>
Dec 05 15:27:36 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:27:36 user nova-compute[75080]:     </system>
Dec 05 15:27:36 user nova-compute[75080]:   </sysinfo>
Dec 05 15:27:36 user nova-compute[75080]:   <os>
Dec 05 15:27:36 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:27:36 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:27:36 user nova-compute[75080]:   </os>
Dec 05 15:27:36 user nova-compute[75080]:   <features>
Dec 05 15:27:36 user nova-compute[75080]:     <acpi/>
Dec 05 15:27:36 user nova-compute[75080]:     <apic/>
Dec 05 15:27:36 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:27:36 user nova-compute[75080]:   </features>
Dec 05 15:27:36 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:27:36 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:27:36 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:27:36 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:27:36 user nova-compute[75080]:   </clock>
Dec 05 15:27:36 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:27:36 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:27:36 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:27:36 user nova-compute[75080]:   </cpu>
Dec 05 15:27:36 user nova-compute[75080]:   <devices>
Dec 05 15:27:36 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:27:36 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:27:36 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk"/>
Dec 05 15:27:36 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:27:36 user nova-compute[75080]:     </disk>
Dec 05 15:27:36 user nova-compute[75080]:     <disk type="block" device="disk">
Dec 05 15:27:36 user nova-compute[75080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:27:36 user nova-compute[75080]:       <source dev="/dev/sdb"/>
Dec 05 15:27:36 user nova-compute[75080]:       <target dev="vdb" bus="virtio"/>
Dec 05 15:27:36 user nova-compute[75080]:       <serial>d99fb99a-13b8-4dd8-a129-b0c0e68e9960</serial>
Dec 05 15:27:36 user nova-compute[75080]:     </disk>
Dec 05 15:27:36 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:27:36 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:27:36 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk.rescue"/>
Dec 05 15:27:36 user nova-compute[75080]:       <target dev="vdc" bus="virtio"/>
Dec 05 15:27:36 user nova-compute[75080]:       <boot order="1"/>
Dec 05 15:27:36 user nova-compute[75080]:     </disk>
Dec 05 15:27:36 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:27:36 user nova-compute[75080]:       <mac address="fa:16:3e:3b:1f:ec"/>
Dec 05 15:27:36 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:27:36 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:27:36 user nova-compute[75080]:       <target dev="tap6b187ba9-e3"/>
Dec 05 15:27:36 user nova-compute[75080]:     </interface>
Dec 05 15:27:36 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:27:36 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/console.log" append="off"/>
Dec 05 15:27:36 user nova-compute[75080]:     </serial>
Dec 05 15:27:36 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:27:36 user nova-compute[75080]:     <video>
Dec 05 15:27:36 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:27:36 user nova-compute[75080]:     </video>
Dec 05 15:27:36 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:27:36 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:27:36 user nova-compute[75080]:     </rng>
Dec 05 15:27:36 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:27:36 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:27:36 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:27:36 user nova-compute[75080]:     </memballoon>
Dec 05 15:27:36 user nova-compute[75080]:   </devices>
Dec 05 15:27:36 user nova-compute[75080]: </domain>
Dec 05 15:27:36 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:27:36 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Instance destroyed successfully.
Dec 05 15:27:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:27:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:27:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:27:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] No VIF found with MAC fa:16:3e:3b:1f:ec, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:27:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:27:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:36 user nova-compute[75080]: DEBUG nova.privsep.utils [None req-80d9dd5f-de1f-4dcd-b2a6-e9d966d89821 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75080) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 15:27:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-80d9dd5f-de1f-4dcd-b2a6-e9d966d89821 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpr61lrgz6/d8f983b011324716845b3c6fb54219e4.delta /opt/stack/data/nova/instances/snapshots/tmpr61lrgz6/d8f983b011324716845b3c6fb54219e4 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:36 user nova-compute[75080]: DEBUG nova.compute.manager [req-4dfe6dfd-3a12-47cc-83f3-e8e4ace3f04b req-fb7a5f6d-d0c1-4a01-a258-729c2ac1cdc7 service nova] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Received event network-vif-deleted-f70f0dca-a0a5-4b2f-b6ef-84422347dd49 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:27:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-80d9dd5f-de1f-4dcd-b2a6-e9d966d89821 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpr61lrgz6/d8f983b011324716845b3c6fb54219e4.delta /opt/stack/data/nova/instances/snapshots/tmpr61lrgz6/d8f983b011324716845b3c6fb54219e4" returned: 0 in 0.426s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:36 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-80d9dd5f-de1f-4dcd-b2a6-e9d966d89821 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Snapshot extracted, beginning image upload
Dec 05 15:27:36 user nova-compute[75080]: INFO nova.compute.manager [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] [instance: 845ee1b9-b8d5-4ac2-a8e2-792c037934b0] Took 0.92 seconds to detach 1 volumes for instance.
Dec 05 15:27:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:27:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:37 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:27:37 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:27:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.460s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:37 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Deleted allocations for instance 845ee1b9-b8d5-4ac2-a8e2-792c037934b0
Dec 05 15:27:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f682ae93-3037-43c2-9c22-fc47d35aab5c tempest-DeleteServersTestJSON-1556760987 tempest-DeleteServersTestJSON-1556760987-project-member] Lock "845ee1b9-b8d5-4ac2-a8e2-792c037934b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.800s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:37 user nova-compute[75080]: INFO nova.compute.manager [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Rescuing
Dec 05 15:27:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "refresh_cache-ab882db7-e6d7-44ca-9ea4-ae2fa68f7929" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:27:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquired lock "refresh_cache-ab882db7-e6d7-44ca-9ea4-ae2fa68f7929" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:27:37 user nova-compute[75080]: DEBUG nova.network.neutron [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:27:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:27:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:41 user nova-compute[75080]: DEBUG nova.compute.manager [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:27:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:27:41 user nova-compute[75080]: DEBUG nova.compute.manager [req-af9c983d-3634-4da5-ac5c-2e08d5f95870 req-cc405b32-e52b-4e20-acb9-8e86392f8966 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Received event network-vif-plugged-5b00d45c-4fed-41ce-b3c1-67d45830034b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:27:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-af9c983d-3634-4da5-ac5c-2e08d5f95870 req-cc405b32-e52b-4e20-acb9-8e86392f8966 service nova] Acquiring lock "06d40106-075c-4b29-bfc5-a0224ece1d45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-af9c983d-3634-4da5-ac5c-2e08d5f95870 req-cc405b32-e52b-4e20-acb9-8e86392f8966 service nova] Lock "06d40106-075c-4b29-bfc5-a0224ece1d45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-af9c983d-3634-4da5-ac5c-2e08d5f95870 req-cc405b32-e52b-4e20-acb9-8e86392f8966 service nova] Lock "06d40106-075c-4b29-bfc5-a0224ece1d45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:41 user nova-compute[75080]: DEBUG nova.compute.manager [req-af9c983d-3634-4da5-ac5c-2e08d5f95870 req-cc405b32-e52b-4e20-acb9-8e86392f8966 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] No waiting events found dispatching network-vif-plugged-5b00d45c-4fed-41ce-b3c1-67d45830034b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:27:41 user nova-compute[75080]: WARNING nova.compute.manager [req-af9c983d-3634-4da5-ac5c-2e08d5f95870 req-cc405b32-e52b-4e20-acb9-8e86392f8966 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Received unexpected event network-vif-plugged-5b00d45c-4fed-41ce-b3c1-67d45830034b for instance with vm_state building and task_state spawning.
Dec 05 15:27:41 user nova-compute[75080]: DEBUG nova.compute.manager [req-cb14b096-7077-40a1-b454-df6f307a9149 req-477eeb72-8b7c-4ebb-8870-c0225eca64af service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Received event network-vif-plugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:27:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-cb14b096-7077-40a1-b454-df6f307a9149 req-477eeb72-8b7c-4ebb-8870-c0225eca64af service nova] Acquiring lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-cb14b096-7077-40a1-b454-df6f307a9149 req-477eeb72-8b7c-4ebb-8870-c0225eca64af service nova] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-cb14b096-7077-40a1-b454-df6f307a9149 req-477eeb72-8b7c-4ebb-8870-c0225eca64af service nova] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:41 user nova-compute[75080]: DEBUG nova.compute.manager [req-cb14b096-7077-40a1-b454-df6f307a9149 req-477eeb72-8b7c-4ebb-8870-c0225eca64af service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] No waiting events found dispatching network-vif-plugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:27:41 user nova-compute[75080]: WARNING nova.compute.manager [req-cb14b096-7077-40a1-b454-df6f307a9149 req-477eeb72-8b7c-4ebb-8870-c0225eca64af service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Received unexpected event network-vif-plugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 for instance with vm_state active and task_state rescuing.
Dec 05 15:27:41 user nova-compute[75080]: DEBUG nova.compute.manager [req-35246b3c-7fbe-43b6-aa44-f372f0824315 req-575ee8e3-bf61-453c-953a-47ed50267f01 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Received event network-vif-plugged-5b00d45c-4fed-41ce-b3c1-67d45830034b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:27:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-35246b3c-7fbe-43b6-aa44-f372f0824315 req-575ee8e3-bf61-453c-953a-47ed50267f01 service nova] Acquiring lock "06d40106-075c-4b29-bfc5-a0224ece1d45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-35246b3c-7fbe-43b6-aa44-f372f0824315 req-575ee8e3-bf61-453c-953a-47ed50267f01 service nova] Lock "06d40106-075c-4b29-bfc5-a0224ece1d45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-35246b3c-7fbe-43b6-aa44-f372f0824315 req-575ee8e3-bf61-453c-953a-47ed50267f01 service nova] Lock "06d40106-075c-4b29-bfc5-a0224ece1d45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:41 user nova-compute[75080]: DEBUG nova.compute.manager [req-35246b3c-7fbe-43b6-aa44-f372f0824315 req-575ee8e3-bf61-453c-953a-47ed50267f01 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] No waiting events found dispatching network-vif-plugged-5b00d45c-4fed-41ce-b3c1-67d45830034b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:27:41 user nova-compute[75080]: WARNING nova.compute.manager [req-35246b3c-7fbe-43b6-aa44-f372f0824315 req-575ee8e3-bf61-453c-953a-47ed50267f01 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Received unexpected event network-vif-plugged-5b00d45c-4fed-41ce-b3c1-67d45830034b for instance with vm_state building and task_state spawning.
Dec 05 15:27:41 user nova-compute[75080]: DEBUG nova.compute.manager [req-028b07da-d1a0-4783-861d-059dbeb1c925 req-514481a1-575b-481f-8d17-eaa39282068c service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Received event network-vif-plugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:27:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-028b07da-d1a0-4783-861d-059dbeb1c925 req-514481a1-575b-481f-8d17-eaa39282068c service nova] Acquiring lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-028b07da-d1a0-4783-861d-059dbeb1c925 req-514481a1-575b-481f-8d17-eaa39282068c service nova] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-028b07da-d1a0-4783-861d-059dbeb1c925 req-514481a1-575b-481f-8d17-eaa39282068c service nova] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:41 user nova-compute[75080]: DEBUG nova.compute.manager [req-028b07da-d1a0-4783-861d-059dbeb1c925 req-514481a1-575b-481f-8d17-eaa39282068c service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] No waiting events found dispatching network-vif-plugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:27:41 user nova-compute[75080]: WARNING nova.compute.manager [req-028b07da-d1a0-4783-861d-059dbeb1c925 req-514481a1-575b-481f-8d17-eaa39282068c service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Received unexpected event network-vif-plugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 for instance with vm_state active and task_state rescuing.
Dec 05 15:27:41 user nova-compute[75080]: DEBUG nova.compute.manager [None req-a1e3f8cf-b27f-455d-8615-0fb1432ace3f tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:27:41 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Instance spawned successfully.
Dec 05 15:27:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:27:41 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:27:41 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:27:41 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=8240MB free_disk=25.17022705078125GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:27:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:27:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:27:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:27:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:27:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:27:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:27:41 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-80d9dd5f-de1f-4dcd-b2a6-e9d966d89821 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Snapshot image upload complete
Dec 05 15:27:41 user nova-compute[75080]: INFO nova.compute.manager [None req-80d9dd5f-de1f-4dcd-b2a6-e9d966d89821 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Took 9.64 seconds to snapshot the instance on the hypervisor.
Dec 05 15:27:42 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Applying migration context for instance 412e1e40-082a-429e-9d35-013b72322761 as it has an incoming, in-progress migration 6a14dafe-5a94-4c59-bb53-5aac3920fec0. Migration status is finished {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Dec 05 15:27:42 user nova-compute[75080]: INFO nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 412e1e40-082a-429e-9d35-013b72322761] Updating resource usage from migration 6a14dafe-5a94-4c59-bb53-5aac3920fec0
Dec 05 15:27:42 user nova-compute[75080]: INFO nova.compute.manager [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Took 10.30 seconds to spawn the instance on the hypervisor.
Dec 05 15:27:42 user nova-compute[75080]: DEBUG nova.compute.manager [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:27:42 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance eedd1529-4feb-4f85-8625-0c20d8e0359d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:27:42 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 07b025ff-4a9d-48a2-b950-b8f2d165f33c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:27:42 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:27:42 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance c9836958-96d4-4b3e-a45c-fbb97846dbd4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:27:42 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance ab882db7-e6d7-44ca-9ea4-ae2fa68f7929 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:27:42 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Migration 6a14dafe-5a94-4c59-bb53-5aac3920fec0 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1712}}
Dec 05 15:27:42 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 412e1e40-082a-429e-9d35-013b72322761 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:27:42 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 06d40106-075c-4b29-bfc5-a0224ece1d45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:27:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:42 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 2ed540ae-41c0-4baf-bf69-52213850fb95 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1764}}
Dec 05 15:27:42 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:27:42 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=26GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:27:42 user nova-compute[75080]: INFO nova.compute.manager [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Took 11.24 seconds to build instance.
Dec 05 15:27:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Acquiring lock "2ed540ae-41c0-4baf-bf69-52213850fb95" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "2ed540ae-41c0-4baf-bf69-52213850fb95" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:42 user nova-compute[75080]: DEBUG nova.compute.manager [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:27:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c315d3ba-52cd-43c1-a7f9-e9cc4a7596e4 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "06d40106-075c-4b29-bfc5-a0224ece1d45" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.383s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:42 user nova-compute[75080]: DEBUG nova.network.neutron [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Updating instance_info_cache with network_info: [{"id": "af017697-07fb-4000-87d4-87f84dbd53bc", "address": "fa:16:3e:48:4c:fd", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf017697-07", "ovs_interfaceid": "af017697-07fb-4000-87d4-87f84dbd53bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:27:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Releasing lock "refresh_cache-ab882db7-e6d7-44ca-9ea4-ae2fa68f7929" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:27:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:42 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:27:42 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:27:42 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:27:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.713s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.268s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:42 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:27:42 user nova-compute[75080]: INFO nova.compute.claims [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Claim successful on node user
Dec 05 15:27:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:43 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Instance destroyed successfully.
Dec 05 15:27:43 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:27:43 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Attempting a stable device rescue
Dec 05 15:27:43 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:27:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.606s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:43 user nova-compute[75080]: DEBUG nova.compute.manager [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:27:43 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75080) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 05 15:27:43 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Instance directory exists: not creating {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 05 15:27:43 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Creating image(s)
Dec 05 15:27:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "/opt/stack/data/nova/instances/ab882db7-e6d7-44ca-9ea4-ae2fa68f7929/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "/opt/stack/data/nova/instances/ab882db7-e6d7-44ca-9ea4-ae2fa68f7929/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "/opt/stack/data/nova/instances/ab882db7-e6d7-44ca-9ea4-ae2fa68f7929/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:43 user nova-compute[75080]: DEBUG nova.objects.instance [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lazy-loading 'trusted_certs' on Instance uuid ab882db7-e6d7-44ca-9ea4-ae2fa68f7929 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:27:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "00d562a34d978f94f36ce8eac0c1b4637d3be4b1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "00d562a34d978f94f36ce8eac0c1b4637d3be4b1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:43 user nova-compute[75080]: DEBUG nova.compute.manager [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:27:43 user nova-compute[75080]: DEBUG nova.network.neutron [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:27:43 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:27:43 user nova-compute[75080]: DEBUG nova.compute.manager [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:27:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00d562a34d978f94f36ce8eac0c1b4637d3be4b1.part --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:44 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:27:44 user nova-compute[75080]: DEBUG nova.policy [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f34ec988b5943aeb8d3b5ae512cb417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc899a7995f64588957e55ca0129c812', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:27:44 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:27:44 user nova-compute[75080]: DEBUG nova.compute.manager [req-bc17576e-f9e7-4188-8b06-2b08db1a6702 req-b1742775-9d02-4325-9788-55f9dcc965e4 service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Received event network-vif-unplugged-af017697-07fb-4000-87d4-87f84dbd53bc {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:27:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-bc17576e-f9e7-4188-8b06-2b08db1a6702 req-b1742775-9d02-4325-9788-55f9dcc965e4 service nova] Acquiring lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-bc17576e-f9e7-4188-8b06-2b08db1a6702 req-b1742775-9d02-4325-9788-55f9dcc965e4 service nova] Lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-bc17576e-f9e7-4188-8b06-2b08db1a6702 req-b1742775-9d02-4325-9788-55f9dcc965e4 service nova] Lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:44 user nova-compute[75080]: DEBUG nova.compute.manager [req-bc17576e-f9e7-4188-8b06-2b08db1a6702 req-b1742775-9d02-4325-9788-55f9dcc965e4 service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] No waiting events found dispatching network-vif-unplugged-af017697-07fb-4000-87d4-87f84dbd53bc {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:27:44 user nova-compute[75080]: WARNING nova.compute.manager [req-bc17576e-f9e7-4188-8b06-2b08db1a6702 req-b1742775-9d02-4325-9788-55f9dcc965e4 service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Received unexpected event network-vif-unplugged-af017697-07fb-4000-87d4-87f84dbd53bc for instance with vm_state active and task_state rescuing.
Dec 05 15:27:44 user nova-compute[75080]: DEBUG nova.compute.manager [req-bc17576e-f9e7-4188-8b06-2b08db1a6702 req-b1742775-9d02-4325-9788-55f9dcc965e4 service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Received event network-vif-plugged-af017697-07fb-4000-87d4-87f84dbd53bc {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:27:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-bc17576e-f9e7-4188-8b06-2b08db1a6702 req-b1742775-9d02-4325-9788-55f9dcc965e4 service nova] Acquiring lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-bc17576e-f9e7-4188-8b06-2b08db1a6702 req-b1742775-9d02-4325-9788-55f9dcc965e4 service nova] Lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-bc17576e-f9e7-4188-8b06-2b08db1a6702 req-b1742775-9d02-4325-9788-55f9dcc965e4 service nova] Lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:44 user nova-compute[75080]: DEBUG nova.compute.manager [req-bc17576e-f9e7-4188-8b06-2b08db1a6702 req-b1742775-9d02-4325-9788-55f9dcc965e4 service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] No waiting events found dispatching network-vif-plugged-af017697-07fb-4000-87d4-87f84dbd53bc {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:27:44 user nova-compute[75080]: WARNING nova.compute.manager [req-bc17576e-f9e7-4188-8b06-2b08db1a6702 req-b1742775-9d02-4325-9788-55f9dcc965e4 service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Received unexpected event network-vif-plugged-af017697-07fb-4000-87d4-87f84dbd53bc for instance with vm_state active and task_state rescuing.
Dec 05 15:27:44 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:27:44 user nova-compute[75080]: DEBUG nova.compute.manager [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:27:44 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:27:44 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Creating image(s)
Dec 05 15:27:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Acquiring lock "/opt/stack/data/nova/instances/2ed540ae-41c0-4baf-bf69-52213850fb95/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "/opt/stack/data/nova/instances/2ed540ae-41c0-4baf-bf69-52213850fb95/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "/opt/stack/data/nova/instances/2ed540ae-41c0-4baf-bf69-52213850fb95/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Acquiring lock "d9aa3c5f8b5c503db2afd90145ce9213ead0dc0c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "d9aa3c5f8b5c503db2afd90145ce9213ead0dc0c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00d562a34d978f94f36ce8eac0c1b4637d3be4b1.part --force-share --output=json" returned: 0 in 0.225s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:44 user nova-compute[75080]: DEBUG nova.virt.images [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] b876a853-555d-4268-9a06-2970d5b41b5c was qcow2, converting to raw {{(pid=75080) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 05 15:27:44 user nova-compute[75080]: DEBUG nova.privsep.utils [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75080) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 15:27:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/00d562a34d978f94f36ce8eac0c1b4637d3be4b1.part /opt/stack/data/nova/instances/_base/00d562a34d978f94f36ce8eac0c1b4637d3be4b1.converted {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9aa3c5f8b5c503db2afd90145ce9213ead0dc0c.part --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:45 user nova-compute[75080]: DEBUG nova.network.neutron [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Successfully created port: 322cb506-f3d1-49d4-956b-9cef1c9325cd {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:27:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/00d562a34d978f94f36ce8eac0c1b4637d3be4b1.part /opt/stack/data/nova/instances/_base/00d562a34d978f94f36ce8eac0c1b4637d3be4b1.converted" returned: 0 in 1.002s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00d562a34d978f94f36ce8eac0c1b4637d3be4b1.converted --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9aa3c5f8b5c503db2afd90145ce9213ead0dc0c.part --force-share --output=json" returned: 0 in 0.196s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:45 user nova-compute[75080]: DEBUG nova.virt.images [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] 949511f6-f43c-4a22-ac01-e6ed2acc4d9a was qcow2, converting to raw {{(pid=75080) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 05 15:27:45 user nova-compute[75080]: DEBUG nova.privsep.utils [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75080) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 15:27:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d9aa3c5f8b5c503db2afd90145ce9213ead0dc0c.part /opt/stack/data/nova/instances/_base/d9aa3c5f8b5c503db2afd90145ce9213ead0dc0c.converted {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00d562a34d978f94f36ce8eac0c1b4637d3be4b1.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "00d562a34d978f94f36ce8eac0c1b4637d3be4b1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.380s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "00d562a34d978f94f36ce8eac0c1b4637d3be4b1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "00d562a34d978f94f36ce8eac0c1b4637d3be4b1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00d562a34d978f94f36ce8eac0c1b4637d3be4b1 --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d9aa3c5f8b5c503db2afd90145ce9213ead0dc0c.part /opt/stack/data/nova/instances/_base/d9aa3c5f8b5c503db2afd90145ce9213ead0dc0c.converted" returned: 0 in 0.240s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9aa3c5f8b5c503db2afd90145ce9213ead0dc0c.converted --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00d562a34d978f94f36ce8eac0c1b4637d3be4b1 --force-share --output=json" returned: 0 in 0.235s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00d562a34d978f94f36ce8eac0c1b4637d3be4b1,backing_fmt=raw /opt/stack/data/nova/instances/ab882db7-e6d7-44ca-9ea4-ae2fa68f7929/disk.rescue {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00d562a34d978f94f36ce8eac0c1b4637d3be4b1,backing_fmt=raw /opt/stack/data/nova/instances/ab882db7-e6d7-44ca-9ea4-ae2fa68f7929/disk.rescue" returned: 0 in 0.075s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "00d562a34d978f94f36ce8eac0c1b4637d3be4b1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.318s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:45 user nova-compute[75080]: DEBUG nova.objects.instance [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lazy-loading 'migration_context' on Instance uuid ab882db7-e6d7-44ca-9ea4-ae2fa68f7929 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:27:45 user nova-compute[75080]: DEBUG nova.objects.base [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Object Instance<ab882db7-e6d7-44ca-9ea4-ae2fa68f7929> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:27:45 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:27:45 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Start _get_guest_xml network_info=[{"id": "af017697-07fb-4000-87d4-87f84dbd53bc", "address": "fa:16:3e:48:4c:fd", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "vif_mac": "fa:16:3e:48:4c:fd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf017697-07", "ovs_interfaceid": "af017697-07fb-4000-87d4-87f84dbd53bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b876a853-555d-4268-9a06-2970d5b41b5c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eTtyOlSx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'ab882db7-e6d7-44ca-9ea4-ae2fa68f7929', 'attached_at': '', 'detached_at': '', 'volume_id': '2b7c6bb1-e02f-431a-97d7-ea24d61bb399', 'serial': '2b7c6bb1-e02f-431a-97d7-ea24d61bb399'}, 'device_type': 'disk', 'attachment_id': '53765958-32d0-4029-ad8b-cb3b97317862', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:27:45 user nova-compute[75080]: DEBUG nova.objects.instance [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lazy-loading 'resources' on Instance uuid ab882db7-e6d7-44ca-9ea4-ae2fa68f7929 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:27:45 user nova-compute[75080]: DEBUG nova.objects.base [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Object Instance<ab882db7-e6d7-44ca-9ea4-ae2fa68f7929> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.objects.instance [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lazy-loading 'numa_topology' on Instance uuid ab882db7-e6d7-44ca-9ea4-ae2fa68f7929 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.objects.base [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Object Instance<ab882db7-e6d7-44ca-9ea4-ae2fa68f7929> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:27:46 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:27:46 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.objects.instance [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lazy-loading 'vcpu_model' on Instance uuid ab882db7-e6d7-44ca-9ea4-ae2fa68f7929 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.objects.base [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Object Instance<ab882db7-e6d7-44ca-9ea4-ae2fa68f7929> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eTtyOlSx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:27:46 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:27:46 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:27:46 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:27:46 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:27:46 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9aa3c5f8b5c503db2afd90145ce9213ead0dc0c.converted --force-share --output=json" returned: 0 in 0.279s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "d9aa3c5f8b5c503db2afd90145ce9213ead0dc0c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.749s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9aa3c5f8b5c503db2afd90145ce9213ead0dc0c --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e1b32e-b36c-4d01-a8f9-ab34cd32dc86]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = eTtyOlSx\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Dec 05 15:27:46 user nova-compute[75080]: node.name = iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399
Dec 05 15:27:46 user nova-compute[75080]: node.tpgt = -1
Dec 05 15:27:46 user nova-compute[75080]: node.startup = automatic
Dec 05 15:27:46 user nova-compute[75080]: node.leading_login = No
Dec 05 15:27:46 user nova-compute[75080]: iface.iscsi_ifacename = default
Dec 05 15:27:46 user nova-compute[75080]: iface.net_ifacename = <empty>
Dec 05 15:27:46 user nova-compute[75080]: iface.ipaddress = <empty>
Dec 05 15:27:46 user nova-compute[75080]: iface.prefix_len = 0
Dec 05 15:27:46 user nova-compute[75080]: iface.hwaddress = <empty>
Dec 05 15:27:46 user nova-compute[75080]: iface.transport_name = tcp
Dec 05 15:27:46 user nova-compute[75080]: iface.initiatorname = <empty>
Dec 05 15:27:46 user nova-compute[75080]: iface.state = <empty>
Dec 05 15:27:46 user nova-compute[75080]: iface.vlan_id = 0
Dec 05 15:27:46 user nova-compute[75080]: iface.vlan_priority = 0
Dec 05 15:27:46 user nova-compute[75080]: iface.vlan_state = <empty>
Dec 05 15:27:46 user nova-compute[75080]: iface.iface_num = 0
Dec 05 15:27:46 user nova-compute[75080]: iface.mtu = 0
Dec 05 15:27:46 user nova-compute[75080]: iface.port = 0
Dec 05 15:27:46 user nova-compute[75080]: iface.bootproto = <empty>
Dec 05 15:27:46 user nova-compute[75080]: iface.subnet_mask = <empty>
Dec 05 15:27:46 user nova-compute[75080]: iface.gateway = <empty>
Dec 05 15:27:46 user nova-compute[75080]: iface.dhcp_alt_client_id_state = <empty>
Dec 05 15:27:46 user nova-compute[75080]: iface.dhcp_alt_client_id = <empty>
Dec 05 15:27:46 user nova-compute[75080]: iface.dhcp_dns = <empty>
Dec 05 15:27:46 user nova-compute[75080]: iface.dhcp_learn_iqn = <empty>
Dec 05 15:27:46 user nova-compute[75080]: iface.dhcp_req_vendor_id_state = <empty>
Dec 05 15:27:46 user nova-compute[75080]: iface.dhcp_vendor_id_state = <empty>
Dec 05 15:27:46 user nova-compute[75080]: iface.dhcp_vendor_id = <empty>
Dec 05 15:27:46 user nova-compute[75080]: iface.dhcp_slp_da = <empty>
Dec 05 15:27:46 user nova-compute[75080]: iface.fragmentation = <empty>
Dec 05 15:27:46 user nova-compute[75080]: iface.gratuitous_arp = <empty>
Dec 05 15:27:46 user nova-compute[75080]: iface.incoming_forwarding = <empty>
Dec 05 15:27:46 user nova-compute[75080]: iface.tos_state = <empty>
Dec 05 15:27:46 user nova-compute[75080]: iface.tos = 0
Dec 05 15:27:46 user nova-compute[75080]: iface.ttl = 0
Dec 05 15:27:46 user nova-compute[75080]: iface.delayed_ack = <empty>
Dec 05 15:27:46 user nova-compute[75080]: iface.tcp_nagle = <empty>
Dec 05 15:27:46 user nova-compute[75080]: iface.tcp_wsf_state = <empty>
Dec 05 15:27:46 user nova-compute[75080]: iface.tcp_wsf = 0
Dec 05 15:27:46 user nova-compute[75080]: iface.tcp_timer_scale = 0
Dec 05 15:27:46 user nova-compute[75080]: iface.tcp_timestamp = <empty>
Dec 05 15:27:46 user nova-compute[75080]: iface.redirect = <empty>
Dec 05 15:27:46 user nova-compute[75080]: iface.def_task_mgmt_timeout = 0
Dec 05 15:27:46 user nova-compute[75080]: iface.header_digest = <empty>
Dec 05 15:27:46 user nova-compute[75080]: iface.data_digest = <empty>
Dec 05 15:27:46 user nova-compute[75080]: iface.immediate_data = <empty>
Dec 05 15:27:46 user nova-compute[75080]: iface.initial_r2t = <empty>
Dec 05 15:27:46 user nova-compute[75080]: iface.data_seq_inorder = <empty>
Dec 05 15:27:46 user nova-compute[75080]: iface.data_pdu_inorder = <empty>
Dec 05 15:27:46 user nova-compute[75080]: iface.erl = 0
Dec 05 15:27:46 user nova-compute[75080]: iface.max_receive_data_len = 0
Dec 05 15:27:46 user nova-compute[75080]: iface.first_burst_len = 0
Dec 05 15:27:46 user nova-compute[75080]: iface.max_outstanding_r2t = 0
Dec 05 15:27:46 user nova-compute[75080]: iface.max_burst_len = 0
Dec 05 15:27:46 user nova-compute[75080]: iface.chap_auth = <empty>
Dec 05 15:27:46 user nova-compute[75080]: iface.bidi_chap = <empty>
Dec 05 15:27:46 user nova-compute[75080]: iface.strict_login_compliance = <empty>
Dec 05 15:27:46 user nova-compute[75080]: iface.discovery_auth = <empty>
Dec 05 15:27:46 user nova-compute[75080]: iface.discovery_logout = <empty>
Dec 05 15:27:46 user nova-compute[75080]: node.discovery_address = <empty>
Dec 05 15:27:46 user nova-compute[75080]: node.discovery_port = 0
Dec 05 15:27:46 user nova-compute[75080]: node.discovery_type = static
Dec 05 15:27:46 user nova-compute[75080]: node.session.initial_cmdsn = 0
Dec 05 15:27:46 user nova-compute[75080]: node.session.initial_login_retry_max = 8
Dec 05 15:27:46 user nova-compute[75080]: node.session.xmit_thread_priority = -20
Dec 05 15:27:46 user nova-compute[75080]: node.session.cmds_max = 128
Dec 05 15:27:46 user nova-compute[75080]: node.session.queue_depth = 32
Dec 05 15:27:46 user nova-compute[75080]: node.session.nr_sessions = 1
Dec 05 15:27:46 user nova-compute[75080]: node.session.auth.authmethod = CHAP
Dec 05 15:27:46 user nova-compute[75080]: node.session.auth.username = eTtyOlSx
Dec 05 15:27:46 user nova-compute[75080]: node.session.auth.password = ***
Dec 05 15:27:46 user nova-compute[75080]: node.session.auth.username_in = <empty>
Dec 05 15:27:46 user nova-compute[75080]: node.session.auth.password_in = <empty>
Dec 05 15:27:46 user nova-compute[75080]: node.session.auth.chap_algs = MD5
Dec 05 15:27:46 user nova-compute[75080]: node.session.timeo.replacement_timeout = 120
Dec 05 15:27:46 user nova-compute[75080]: node.session.err_timeo.abort_timeout = 15
Dec 05 15:27:46 user nova-compute[75080]: node.session.err_timeo.lu_reset_timeout = 30
Dec 05 15:27:46 user nova-compute[75080]: node.session.err_timeo.tgt_reset_timeout = 30
Dec 05 15:27:46 user nova-compute[75080]: node.session.err_timeo.host_reset_timeout = 60
Dec 05 15:27:46 user nova-compute[75080]: node.session.iscsi.FastAbort = Yes
Dec 05 15:27:46 user nova-compute[75080]: node.session.iscsi.InitialR2T = No
Dec 05 15:27:46 user nova-compute[75080]: node.session.iscsi.ImmediateData = Yes
Dec 05 15:27:46 user nova-compute[75080]: node.session.iscsi.FirstBurstLength = 262144
Dec 05 15:27:46 user nova-compute[75080]: node.session.iscsi.MaxBurstLength = 16776192
Dec 05 15:27:46 user nova-compute[75080]: node.session.iscsi.DefaultTime2Retain = 0
Dec 05 15:27:46 user nova-compute[75080]: node.session.iscsi.DefaultTime2Wait = 2
Dec 05 15:27:46 user nova-compute[75080]: node.session.iscsi.MaxConnections = 1
Dec 05 15:27:46 user nova-compute[75080]: node.session.iscsi.MaxOutstandingR2T = 1
Dec 05 15:27:46 user nova-compute[75080]: node.session.iscsi.ERL = 0
Dec 05 15:27:46 user nova-compute[75080]: node.session.scan = manual
Dec 05 15:27:46 user nova-compute[75080]: node.session.reopen_max = 0
Dec 05 15:27:46 user nova-compute[75080]: node.conn[0].address = 172.16.0.220
Dec 05 15:27:46 user nova-compute[75080]: node.conn[0].port = 3260
Dec 05 15:27:46 user nova-compute[75080]: node.conn[0].startup = manual
Dec 05 15:27:46 user nova-compute[75080]: node.conn[0].tcp.window_size = 524288
Dec 05 15:27:46 user nova-compute[75080]: node.conn[0].tcp.type_of_service = 0
Dec 05 15:27:46 user nova-compute[75080]: node.conn[0].timeo.logout_timeout = 15
Dec 05 15:27:46 user nova-compute[75080]: node.conn[0].timeo.login_timeout = 15
Dec 05 15:27:46 user nova-compute[75080]: node.conn[0].timeo.auth_timeout = 45
Dec 05 15:27:46 user nova-compute[75080]: node.conn[0].timeo.noop_out_interval = 5
Dec 05 15:27:46 user nova-compute[75080]: node.conn[0].timeo.noop_out_timeout = 5
Dec 05 15:27:46 user nova-compute[75080]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Dec 05 15:27:46 user nova-compute[75080]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Dec 05 15:27:46 user nova-compute[75080]: node.conn[0].iscsi.HeaderDigest = None
Dec 05 15:27:46 user nova-compute[75080]: node.conn[0].iscsi.DataDigest = None
Dec 05 15:27:46 user nova-compute[75080]: node.conn[0].iscsi.IFMarker = No
Dec 05 15:27:46 user nova-compute[75080]: node.conn[0].iscsi.OFMarker = No
Dec 05 15:27:46 user nova-compute[75080]: # END RECORD
Dec 05 15:27:46 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f8277e-7646-4506-a60f-9fbcb710d65b]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db4c8c1-2d10-4647-8e62-a8385368ee3e]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eTtyOlSx {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.network.neutron [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Successfully updated port: 322cb506-f3d1-49d4-956b-9cef1c9325cd {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eTtyOlSx" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4601f2-65b4-4ae2-95d9-431c7d394c00]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eTtyOlSx'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Acquiring lock "refresh_cache-2ed540ae-41c0-4baf-bf69-52213850fb95" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Acquired lock "refresh_cache-2ed540ae-41c0-4baf-bf69-52213850fb95" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.network.neutron [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb03d858-0a9d-48da-b0b5-73a0e758ece3]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.compute.manager [req-23294120-2fd2-4244-8cb5-8e1fc40e23a2 req-82ab75c7-58c4-4132-89bf-05e973fb07d8 service nova] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Received event network-changed-322cb506-f3d1-49d4-956b-9cef1c9325cd {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.compute.manager [req-23294120-2fd2-4244-8cb5-8e1fc40e23a2 req-82ab75c7-58c4-4132-89bf-05e973fb07d8 service nova] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Refreshing instance network info cache due to event network-changed-322cb506-f3d1-49d4-956b-9cef1c9325cd. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-23294120-2fd2-4244-8cb5-8e1fc40e23a2 req-82ab75c7-58c4-4132-89bf-05e973fb07d8 service nova] Acquiring lock "refresh_cache-2ed540ae-41c0-4baf-bf69-52213850fb95" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba31ff7-0b16-44d4-a50f-d930bac71ece]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:27:46 user nova-compute[75080]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:27:46 user nova-compute[75080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)
Dec 05 15:27:46 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:27:46 user nova-compute[75080]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:27:46 user nova-compute[75080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)
Dec 05 15:27:46 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.195s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] HCTL ('38', '0', '0', 0) found on session 24 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Scanning host 38 c: 0, t: 0, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a4cb9e-8a43-47ae-bc96-5dff451b9e6a]: (4, ('0 0 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Searching for a device in session 24 and hctl ('38', '0', '0', 0) yield: sdg {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eTtyOlSx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.225s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] <== connect_volume: return (227ms) {'type': 'block', 'scsi_wwn': '23263323431313863', 'path': '/dev/sdg'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263323431313863', 'path': '/dev/sdg'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9aa3c5f8b5c503db2afd90145ce9213ead0dc0c --force-share --output=json" returned: 0 in 0.230s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Acquiring lock "d9aa3c5f8b5c503db2afd90145ce9213ead0dc0c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "d9aa3c5f8b5c503db2afd90145ce9213ead0dc0c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9aa3c5f8b5c503db2afd90145ce9213ead0dc0c --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:25:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1586887461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1586887461',id=24,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:26:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97145ab79b414c4fb8772c71e9414581',ramdisk_id='',reservation_id='r-ibun0y2c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2060228993',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:26:08Z,user_data=None,user_id='829d709c32db431199af609ddbc8b090',uuid=ab882db7-e6d7-44ca-9ea4-ae2fa68f7929,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af017697-07fb-4000-87d4-87f84dbd53bc", "address": "fa:16:3e:48:4c:fd", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "vif_mac": "fa:16:3e:48:4c:fd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf017697-07", "ovs_interfaceid": "af017697-07fb-4000-87d4-87f84dbd53bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Converting VIF {"id": "af017697-07fb-4000-87d4-87f84dbd53bc", "address": "fa:16:3e:48:4c:fd", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "vif_mac": "fa:16:3e:48:4c:fd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf017697-07", "ovs_interfaceid": "af017697-07fb-4000-87d4-87f84dbd53bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:4c:fd,bridge_name='br-int',has_traffic_filtering=True,id=af017697-07fb-4000-87d4-87f84dbd53bc,network=Network(61aa968d-7e44-4ef2-955f-2e5441416f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf017697-07') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.objects.instance [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lazy-loading 'pci_devices' on Instance uuid ab882db7-e6d7-44ca-9ea4-ae2fa68f7929 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.network.neutron [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.objects.base [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Object Instance<ab882db7-e6d7-44ca-9ea4-ae2fa68f7929> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:27:46 user nova-compute[75080]:   <uuid>ab882db7-e6d7-44ca-9ea4-ae2fa68f7929</uuid>
Dec 05 15:27:46 user nova-compute[75080]:   <name>instance-00000018</name>
Dec 05 15:27:46 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:27:46 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:27:46 user nova-compute[75080]:   <metadata>
Dec 05 15:27:46 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:27:46 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:27:46 user nova-compute[75080]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1586887461</nova:name>
Dec 05 15:27:46 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:27:46</nova:creationTime>
Dec 05 15:27:46 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:27:46 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:27:46 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:27:46 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:27:46 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:27:46 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:27:46 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:27:46 user nova-compute[75080]:       <nova:owner>
Dec 05 15:27:46 user nova-compute[75080]:         <nova:user uuid="829d709c32db431199af609ddbc8b090">tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member</nova:user>
Dec 05 15:27:46 user nova-compute[75080]:         <nova:project uuid="97145ab79b414c4fb8772c71e9414581">tempest-ServerBootFromVolumeStableRescueTest-2060228993</nova:project>
Dec 05 15:27:46 user nova-compute[75080]:       </nova:owner>
Dec 05 15:27:46 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:27:46 user nova-compute[75080]:       <nova:ports>
Dec 05 15:27:46 user nova-compute[75080]:         <nova:port uuid="af017697-07fb-4000-87d4-87f84dbd53bc">
Dec 05 15:27:46 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 05 15:27:46 user nova-compute[75080]:         </nova:port>
Dec 05 15:27:46 user nova-compute[75080]:       </nova:ports>
Dec 05 15:27:46 user nova-compute[75080]:     </nova:instance>
Dec 05 15:27:46 user nova-compute[75080]:   </metadata>
Dec 05 15:27:46 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:27:46 user nova-compute[75080]:     <system>
Dec 05 15:27:46 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:27:46 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:27:46 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:27:46 user nova-compute[75080]:       <entry name="serial">ab882db7-e6d7-44ca-9ea4-ae2fa68f7929</entry>
Dec 05 15:27:46 user nova-compute[75080]:       <entry name="uuid">ab882db7-e6d7-44ca-9ea4-ae2fa68f7929</entry>
Dec 05 15:27:46 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:27:46 user nova-compute[75080]:     </system>
Dec 05 15:27:46 user nova-compute[75080]:   </sysinfo>
Dec 05 15:27:46 user nova-compute[75080]:   <os>
Dec 05 15:27:46 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:27:46 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:27:46 user nova-compute[75080]:   </os>
Dec 05 15:27:46 user nova-compute[75080]:   <features>
Dec 05 15:27:46 user nova-compute[75080]:     <acpi/>
Dec 05 15:27:46 user nova-compute[75080]:     <apic/>
Dec 05 15:27:46 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:27:46 user nova-compute[75080]:   </features>
Dec 05 15:27:46 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:27:46 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:27:46 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:27:46 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:27:46 user nova-compute[75080]:   </clock>
Dec 05 15:27:46 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:27:46 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:27:46 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:27:46 user nova-compute[75080]:   </cpu>
Dec 05 15:27:46 user nova-compute[75080]:   <devices>
Dec 05 15:27:46 user nova-compute[75080]:     <disk type="block" device="disk">
Dec 05 15:27:46 user nova-compute[75080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:27:46 user nova-compute[75080]:       <source dev="/dev/sdg"/>
Dec 05 15:27:46 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:27:46 user nova-compute[75080]:       <serial>2b7c6bb1-e02f-431a-97d7-ea24d61bb399</serial>
Dec 05 15:27:46 user nova-compute[75080]:     </disk>
Dec 05 15:27:46 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:27:46 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:27:46 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/ab882db7-e6d7-44ca-9ea4-ae2fa68f7929/disk.rescue"/>
Dec 05 15:27:46 user nova-compute[75080]:       <target dev="vdb" bus="virtio"/>
Dec 05 15:27:46 user nova-compute[75080]:       <boot order="1"/>
Dec 05 15:27:46 user nova-compute[75080]:     </disk>
Dec 05 15:27:46 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:27:46 user nova-compute[75080]:       <mac address="fa:16:3e:48:4c:fd"/>
Dec 05 15:27:46 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:27:46 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:27:46 user nova-compute[75080]:       <target dev="tapaf017697-07"/>
Dec 05 15:27:46 user nova-compute[75080]:     </interface>
Dec 05 15:27:46 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:27:46 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/ab882db7-e6d7-44ca-9ea4-ae2fa68f7929/console.log" append="off"/>
Dec 05 15:27:46 user nova-compute[75080]:     </serial>
Dec 05 15:27:46 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:27:46 user nova-compute[75080]:     <video>
Dec 05 15:27:46 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:27:46 user nova-compute[75080]:     </video>
Dec 05 15:27:46 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:27:46 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:27:46 user nova-compute[75080]:     </rng>
Dec 05 15:27:46 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:27:46 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:27:46 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:27:46 user nova-compute[75080]:     </memballoon>
Dec 05 15:27:46 user nova-compute[75080]:   </devices>
Dec 05 15:27:46 user nova-compute[75080]: </domain>
Dec 05 15:27:46 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:27:46 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Instance destroyed successfully.
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] No VIF found with MAC fa:16:3e:48:4c:fd, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9aa3c5f8b5c503db2afd90145ce9213ead0dc0c --force-share --output=json" returned: 0 in 0.229s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d9aa3c5f8b5c503db2afd90145ce9213ead0dc0c,backing_fmt=raw /opt/stack/data/nova/instances/2ed540ae-41c0-4baf-bf69-52213850fb95/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d9aa3c5f8b5c503db2afd90145ce9213ead0dc0c,backing_fmt=raw /opt/stack/data/nova/instances/2ed540ae-41c0-4baf-bf69-52213850fb95/disk 1073741824" returned: 0 in 0.094s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "d9aa3c5f8b5c503db2afd90145ce9213ead0dc0c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.327s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9aa3c5f8b5c503db2afd90145ce9213ead0dc0c --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.network.neutron [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Updating instance_info_cache with network_info: [{"id": "322cb506-f3d1-49d4-956b-9cef1c9325cd", "address": "fa:16:3e:53:0c:12", "network": {"id": "60895755-a5e0-4195-ace1-7627829ca044", "bridge": "br-int", "label": "tempest-TestStampPattern-2093692741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc899a7995f64588957e55ca0129c812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap322cb506-f3", "ovs_interfaceid": "322cb506-f3d1-49d4-956b-9cef1c9325cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9aa3c5f8b5c503db2afd90145ce9213ead0dc0c --force-share --output=json" returned: 0 in 0.211s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Ensure instance console log exists: /opt/stack/data/nova/instances/2ed540ae-41c0-4baf-bf69-52213850fb95/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Releasing lock "refresh_cache-2ed540ae-41c0-4baf-bf69-52213850fb95" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.compute.manager [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Instance network_info: |[{"id": "322cb506-f3d1-49d4-956b-9cef1c9325cd", "address": "fa:16:3e:53:0c:12", "network": {"id": "60895755-a5e0-4195-ace1-7627829ca044", "bridge": "br-int", "label": "tempest-TestStampPattern-2093692741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc899a7995f64588957e55ca0129c812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap322cb506-f3", "ovs_interfaceid": "322cb506-f3d1-49d4-956b-9cef1c9325cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-23294120-2fd2-4244-8cb5-8e1fc40e23a2 req-82ab75c7-58c4-4132-89bf-05e973fb07d8 service nova] Acquired lock "refresh_cache-2ed540ae-41c0-4baf-bf69-52213850fb95" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.network.neutron [req-23294120-2fd2-4244-8cb5-8e1fc40e23a2 req-82ab75c7-58c4-4132-89bf-05e973fb07d8 service nova] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Refreshing network info cache for port 322cb506-f3d1-49d4-956b-9cef1c9325cd {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Start _get_guest_xml network_info=[{"id": "322cb506-f3d1-49d4-956b-9cef1c9325cd", "address": "fa:16:3e:53:0c:12", "network": {"id": "60895755-a5e0-4195-ace1-7627829ca044", "bridge": "br-int", "label": "tempest-TestStampPattern-2093692741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc899a7995f64588957e55ca0129c812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap322cb506-f3", "ovs_interfaceid": "322cb506-f3d1-49d4-956b-9cef1c9325cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='cffe3b7e9b421fa2e979fc36a2477aff',container_format='bare',created_at=2023-12-05T15:27:32Z,direct_url=<?>,disk_format='qcow2',id=949511f6-f43c-4a22-ac01-e6ed2acc4d9a,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-85841039',owner='bc899a7995f64588957e55ca0129c812',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-12-05T15:27:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '949511f6-f43c-4a22-ac01-e6ed2acc4d9a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:27:46 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:27:46 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='cffe3b7e9b421fa2e979fc36a2477aff',container_format='bare',created_at=2023-12-05T15:27:32Z,direct_url=<?>,disk_format='qcow2',id=949511f6-f43c-4a22-ac01-e6ed2acc4d9a,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-85841039',owner='bc899a7995f64588957e55ca0129c812',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-12-05T15:27:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:27:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2008392424',display_name='tempest-TestStampPattern-server-2008392424',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2008392424',id=26,image_ref='949511f6-f43c-4a22-ac01-e6ed2acc4d9a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHAMA1CXZez7MdPSph5S9i392ZBdQjLqQOb8hqMfYY669vYgo8ML8BR0YzkdsvotEWD0HqSrUCtIg33ZSIHfujV9PM0Cii8jO16lDVcp4/zZGFDnycYQV610lx2OhuUeWQ==',key_name='tempest-TestStampPattern-113655159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc899a7995f64588957e55ca0129c812',ramdisk_id='',reservation_id='r-2z0y1qs6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='c9836958-96d4-4b3e-a45c-fbb97846dbd4',image_min_disk='1',image_min_ram='0',image_owner_id='bc899a7995f64588957e55ca0129c812',image_owner_project_name='tempest-TestStampPattern-1734509700',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1734509700-project-member',image_user_id='3f34ec988b5943aeb8d3b5ae512cb417',network_allocated='True',owner_project_name='tempest-TestStampPattern-1734509700',owner_user_name='tempest-TestStampPattern-1734509700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:27:43Z,user_data=None,user_id='3f34ec988b5943aeb8d3b5ae512cb417',uuid=2ed540ae-41c0-4baf-bf69-52213850fb95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "322cb506-f3d1-49d4-956b-9cef1c9325cd", "address": "fa:16:3e:53:0c:12", "network": {"id": "60895755-a5e0-4195-ace1-7627829ca044", "bridge": "br-int", "label": "tempest-TestStampPattern-2093692741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc899a7995f64588957e55ca0129c812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap322cb506-f3", "ovs_interfaceid": "322cb506-f3d1-49d4-956b-9cef1c9325cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Converting VIF {"id": "322cb506-f3d1-49d4-956b-9cef1c9325cd", "address": "fa:16:3e:53:0c:12", "network": {"id": "60895755-a5e0-4195-ace1-7627829ca044", "bridge": "br-int", "label": "tempest-TestStampPattern-2093692741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc899a7995f64588957e55ca0129c812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap322cb506-f3", "ovs_interfaceid": "322cb506-f3d1-49d4-956b-9cef1c9325cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:0c:12,bridge_name='br-int',has_traffic_filtering=True,id=322cb506-f3d1-49d4-956b-9cef1c9325cd,network=Network(60895755-a5e0-4195-ace1-7627829ca044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap322cb506-f3') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:27:46 user nova-compute[75080]: DEBUG nova.objects.instance [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ed540ae-41c0-4baf-bf69-52213850fb95 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:27:47 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:27:47 user nova-compute[75080]:   <uuid>2ed540ae-41c0-4baf-bf69-52213850fb95</uuid>
Dec 05 15:27:47 user nova-compute[75080]:   <name>instance-0000001a</name>
Dec 05 15:27:47 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:27:47 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:27:47 user nova-compute[75080]:   <metadata>
Dec 05 15:27:47 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:27:47 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:27:47 user nova-compute[75080]:       <nova:name>tempest-TestStampPattern-server-2008392424</nova:name>
Dec 05 15:27:47 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:27:46</nova:creationTime>
Dec 05 15:27:47 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:27:47 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:27:47 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:27:47 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:27:47 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:27:47 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:27:47 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:27:47 user nova-compute[75080]:       <nova:owner>
Dec 05 15:27:47 user nova-compute[75080]:         <nova:user uuid="3f34ec988b5943aeb8d3b5ae512cb417">tempest-TestStampPattern-1734509700-project-member</nova:user>
Dec 05 15:27:47 user nova-compute[75080]:         <nova:project uuid="bc899a7995f64588957e55ca0129c812">tempest-TestStampPattern-1734509700</nova:project>
Dec 05 15:27:47 user nova-compute[75080]:       </nova:owner>
Dec 05 15:27:47 user nova-compute[75080]:       <nova:root type="image" uuid="949511f6-f43c-4a22-ac01-e6ed2acc4d9a"/>
Dec 05 15:27:47 user nova-compute[75080]:       <nova:ports>
Dec 05 15:27:47 user nova-compute[75080]:         <nova:port uuid="322cb506-f3d1-49d4-956b-9cef1c9325cd">
Dec 05 15:27:47 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 05 15:27:47 user nova-compute[75080]:         </nova:port>
Dec 05 15:27:47 user nova-compute[75080]:       </nova:ports>
Dec 05 15:27:47 user nova-compute[75080]:     </nova:instance>
Dec 05 15:27:47 user nova-compute[75080]:   </metadata>
Dec 05 15:27:47 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:27:47 user nova-compute[75080]:     <system>
Dec 05 15:27:47 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:27:47 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:27:47 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:27:47 user nova-compute[75080]:       <entry name="serial">2ed540ae-41c0-4baf-bf69-52213850fb95</entry>
Dec 05 15:27:47 user nova-compute[75080]:       <entry name="uuid">2ed540ae-41c0-4baf-bf69-52213850fb95</entry>
Dec 05 15:27:47 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:27:47 user nova-compute[75080]:     </system>
Dec 05 15:27:47 user nova-compute[75080]:   </sysinfo>
Dec 05 15:27:47 user nova-compute[75080]:   <os>
Dec 05 15:27:47 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:27:47 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:27:47 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:27:47 user nova-compute[75080]:   </os>
Dec 05 15:27:47 user nova-compute[75080]:   <features>
Dec 05 15:27:47 user nova-compute[75080]:     <acpi/>
Dec 05 15:27:47 user nova-compute[75080]:     <apic/>
Dec 05 15:27:47 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:27:47 user nova-compute[75080]:   </features>
Dec 05 15:27:47 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:27:47 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:27:47 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:27:47 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:27:47 user nova-compute[75080]:   </clock>
Dec 05 15:27:47 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:27:47 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:27:47 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:27:47 user nova-compute[75080]:   </cpu>
Dec 05 15:27:47 user nova-compute[75080]:   <devices>
Dec 05 15:27:47 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:27:47 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:27:47 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/2ed540ae-41c0-4baf-bf69-52213850fb95/disk"/>
Dec 05 15:27:47 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:27:47 user nova-compute[75080]:     </disk>
Dec 05 15:27:47 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:27:47 user nova-compute[75080]:       <mac address="fa:16:3e:53:0c:12"/>
Dec 05 15:27:47 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:27:47 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:27:47 user nova-compute[75080]:       <target dev="tap322cb506-f3"/>
Dec 05 15:27:47 user nova-compute[75080]:     </interface>
Dec 05 15:27:47 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:27:47 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/2ed540ae-41c0-4baf-bf69-52213850fb95/console.log" append="off"/>
Dec 05 15:27:47 user nova-compute[75080]:     </serial>
Dec 05 15:27:47 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:27:47 user nova-compute[75080]:     <video>
Dec 05 15:27:47 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:27:47 user nova-compute[75080]:     </video>
Dec 05 15:27:47 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:27:47 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:27:47 user nova-compute[75080]:     </rng>
Dec 05 15:27:47 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:27:47 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:27:47 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:27:47 user nova-compute[75080]:     </memballoon>
Dec 05 15:27:47 user nova-compute[75080]:   </devices>
Dec 05 15:27:47 user nova-compute[75080]: </domain>
Dec 05 15:27:47 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:27:47 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:27:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2008392424',display_name='tempest-TestStampPattern-server-2008392424',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2008392424',id=26,image_ref='949511f6-f43c-4a22-ac01-e6ed2acc4d9a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHAMA1CXZez7MdPSph5S9i392ZBdQjLqQOb8hqMfYY669vYgo8ML8BR0YzkdsvotEWD0HqSrUCtIg33ZSIHfujV9PM0Cii8jO16lDVcp4/zZGFDnycYQV610lx2OhuUeWQ==',key_name='tempest-TestStampPattern-113655159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc899a7995f64588957e55ca0129c812',ramdisk_id='',reservation_id='r-2z0y1qs6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='c9836958-96d4-4b3e-a45c-fbb97846dbd4',image_min_disk='1',image_min_ram='0',image_owner_id='bc899a7995f64588957e55ca0129c812',image_owner_project_name='tempest-TestStampPattern-1734509700',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1734509700-project-member',image_user_id='3f34ec988b5943aeb8d3b5ae512cb417',network_allocated='True',owner_project_name='tempest-TestStampPattern-1734509700',owner_user_name='tempest-TestStampPattern-1734509700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:27:43Z,user_data=None,user_id='3f34ec988b5943aeb8d3b5ae512cb417',uuid=2ed540ae-41c0-4baf-bf69-52213850fb95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "322cb506-f3d1-49d4-956b-9cef1c9325cd", "address": "fa:16:3e:53:0c:12", "network": {"id": "60895755-a5e0-4195-ace1-7627829ca044", "bridge": "br-int", "label": "tempest-TestStampPattern-2093692741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc899a7995f64588957e55ca0129c812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap322cb506-f3", "ovs_interfaceid": "322cb506-f3d1-49d4-956b-9cef1c9325cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:27:47 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Converting VIF {"id": "322cb506-f3d1-49d4-956b-9cef1c9325cd", "address": "fa:16:3e:53:0c:12", "network": {"id": "60895755-a5e0-4195-ace1-7627829ca044", "bridge": "br-int", "label": "tempest-TestStampPattern-2093692741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc899a7995f64588957e55ca0129c812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap322cb506-f3", "ovs_interfaceid": "322cb506-f3d1-49d4-956b-9cef1c9325cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:27:47 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:0c:12,bridge_name='br-int',has_traffic_filtering=True,id=322cb506-f3d1-49d4-956b-9cef1c9325cd,network=Network(60895755-a5e0-4195-ace1-7627829ca044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap322cb506-f3') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:27:47 user nova-compute[75080]: DEBUG os_vif [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:0c:12,bridge_name='br-int',has_traffic_filtering=True,id=322cb506-f3d1-49d4-956b-9cef1c9325cd,network=Network(60895755-a5e0-4195-ace1-7627829ca044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap322cb506-f3') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:27:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:27:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:27:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e88fb445-3fde-5c2e-9ca8-39bbd55edc62', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:27:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:27:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap322cb506-f3, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:27:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap322cb506-f3, col_values=(('qos', UUID('a9045707-83fd-46b9-a1dc-e9c85ad9a691')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:27:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap322cb506-f3, col_values=(('external_ids', {'iface-id': '322cb506-f3d1-49d4-956b-9cef1c9325cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:0c:12', 'vm-uuid': '2ed540ae-41c0-4baf-bf69-52213850fb95'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:27:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:27:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:47 user nova-compute[75080]: INFO os_vif [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:0c:12,bridge_name='br-int',has_traffic_filtering=True,id=322cb506-f3d1-49d4-956b-9cef1c9325cd,network=Network(60895755-a5e0-4195-ace1-7627829ca044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap322cb506-f3')
Dec 05 15:27:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:47 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:27:47 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] No VIF found with MAC fa:16:3e:53:0c:12, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:27:47 user nova-compute[75080]: DEBUG nova.network.neutron [req-23294120-2fd2-4244-8cb5-8e1fc40e23a2 req-82ab75c7-58c4-4132-89bf-05e973fb07d8 service nova] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Updated VIF entry in instance network info cache for port 322cb506-f3d1-49d4-956b-9cef1c9325cd. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:27:47 user nova-compute[75080]: DEBUG nova.network.neutron [req-23294120-2fd2-4244-8cb5-8e1fc40e23a2 req-82ab75c7-58c4-4132-89bf-05e973fb07d8 service nova] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Updating instance_info_cache with network_info: [{"id": "322cb506-f3d1-49d4-956b-9cef1c9325cd", "address": "fa:16:3e:53:0c:12", "network": {"id": "60895755-a5e0-4195-ace1-7627829ca044", "bridge": "br-int", "label": "tempest-TestStampPattern-2093692741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc899a7995f64588957e55ca0129c812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap322cb506-f3", "ovs_interfaceid": "322cb506-f3d1-49d4-956b-9cef1c9325cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:27:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-23294120-2fd2-4244-8cb5-8e1fc40e23a2 req-82ab75c7-58c4-4132-89bf-05e973fb07d8 service nova] Releasing lock "refresh_cache-2ed540ae-41c0-4baf-bf69-52213850fb95" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:27:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:49 user nova-compute[75080]: DEBUG nova.compute.manager [req-8d93cbe7-f3ab-47a4-8e88-047b964e9b78 req-e4756751-eb57-4978-af1b-6ee3c9bd5367 service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Received event network-vif-plugged-af017697-07fb-4000-87d4-87f84dbd53bc {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:27:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8d93cbe7-f3ab-47a4-8e88-047b964e9b78 req-e4756751-eb57-4978-af1b-6ee3c9bd5367 service nova] Acquiring lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8d93cbe7-f3ab-47a4-8e88-047b964e9b78 req-e4756751-eb57-4978-af1b-6ee3c9bd5367 service nova] Lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8d93cbe7-f3ab-47a4-8e88-047b964e9b78 req-e4756751-eb57-4978-af1b-6ee3c9bd5367 service nova] Lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:49 user nova-compute[75080]: DEBUG nova.compute.manager [req-8d93cbe7-f3ab-47a4-8e88-047b964e9b78 req-e4756751-eb57-4978-af1b-6ee3c9bd5367 service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] No waiting events found dispatching network-vif-plugged-af017697-07fb-4000-87d4-87f84dbd53bc {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:27:49 user nova-compute[75080]: WARNING nova.compute.manager [req-8d93cbe7-f3ab-47a4-8e88-047b964e9b78 req-e4756751-eb57-4978-af1b-6ee3c9bd5367 service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Received unexpected event network-vif-plugged-af017697-07fb-4000-87d4-87f84dbd53bc for instance with vm_state active and task_state rescuing.
Dec 05 15:27:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-703245a9-d05b-4cec-bc41-c39b588529d5 req-aed542d9-0c95-4ecf-b718-23bf68cf6a10 service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Received event network-vif-plugged-af017697-07fb-4000-87d4-87f84dbd53bc {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:27:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-703245a9-d05b-4cec-bc41-c39b588529d5 req-aed542d9-0c95-4ecf-b718-23bf68cf6a10 service nova] Acquiring lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-703245a9-d05b-4cec-bc41-c39b588529d5 req-aed542d9-0c95-4ecf-b718-23bf68cf6a10 service nova] Lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-703245a9-d05b-4cec-bc41-c39b588529d5 req-aed542d9-0c95-4ecf-b718-23bf68cf6a10 service nova] Lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-703245a9-d05b-4cec-bc41-c39b588529d5 req-aed542d9-0c95-4ecf-b718-23bf68cf6a10 service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] No waiting events found dispatching network-vif-plugged-af017697-07fb-4000-87d4-87f84dbd53bc {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:27:51 user nova-compute[75080]: WARNING nova.compute.manager [req-703245a9-d05b-4cec-bc41-c39b588529d5 req-aed542d9-0c95-4ecf-b718-23bf68cf6a10 service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Received unexpected event network-vif-plugged-af017697-07fb-4000-87d4-87f84dbd53bc for instance with vm_state active and task_state rescuing.
Dec 05 15:27:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-703245a9-d05b-4cec-bc41-c39b588529d5 req-aed542d9-0c95-4ecf-b718-23bf68cf6a10 service nova] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Received event network-vif-plugged-322cb506-f3d1-49d4-956b-9cef1c9325cd {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:27:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-703245a9-d05b-4cec-bc41-c39b588529d5 req-aed542d9-0c95-4ecf-b718-23bf68cf6a10 service nova] Acquiring lock "2ed540ae-41c0-4baf-bf69-52213850fb95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-703245a9-d05b-4cec-bc41-c39b588529d5 req-aed542d9-0c95-4ecf-b718-23bf68cf6a10 service nova] Lock "2ed540ae-41c0-4baf-bf69-52213850fb95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-703245a9-d05b-4cec-bc41-c39b588529d5 req-aed542d9-0c95-4ecf-b718-23bf68cf6a10 service nova] Lock "2ed540ae-41c0-4baf-bf69-52213850fb95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-703245a9-d05b-4cec-bc41-c39b588529d5 req-aed542d9-0c95-4ecf-b718-23bf68cf6a10 service nova] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] No waiting events found dispatching network-vif-plugged-322cb506-f3d1-49d4-956b-9cef1c9325cd {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:27:51 user nova-compute[75080]: WARNING nova.compute.manager [req-703245a9-d05b-4cec-bc41-c39b588529d5 req-aed542d9-0c95-4ecf-b718-23bf68cf6a10 service nova] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Received unexpected event network-vif-plugged-322cb506-f3d1-49d4-956b-9cef1c9325cd for instance with vm_state building and task_state spawning.
Dec 05 15:27:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-703245a9-d05b-4cec-bc41-c39b588529d5 req-aed542d9-0c95-4ecf-b718-23bf68cf6a10 service nova] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Received event network-vif-plugged-322cb506-f3d1-49d4-956b-9cef1c9325cd {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:27:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-703245a9-d05b-4cec-bc41-c39b588529d5 req-aed542d9-0c95-4ecf-b718-23bf68cf6a10 service nova] Acquiring lock "2ed540ae-41c0-4baf-bf69-52213850fb95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:27:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-703245a9-d05b-4cec-bc41-c39b588529d5 req-aed542d9-0c95-4ecf-b718-23bf68cf6a10 service nova] Lock "2ed540ae-41c0-4baf-bf69-52213850fb95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:27:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-703245a9-d05b-4cec-bc41-c39b588529d5 req-aed542d9-0c95-4ecf-b718-23bf68cf6a10 service nova] Lock "2ed540ae-41c0-4baf-bf69-52213850fb95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-703245a9-d05b-4cec-bc41-c39b588529d5 req-aed542d9-0c95-4ecf-b718-23bf68cf6a10 service nova] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] No waiting events found dispatching network-vif-plugged-322cb506-f3d1-49d4-956b-9cef1c9325cd {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:27:51 user nova-compute[75080]: WARNING nova.compute.manager [req-703245a9-d05b-4cec-bc41-c39b588529d5 req-aed542d9-0c95-4ecf-b718-23bf68cf6a10 service nova] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Received unexpected event network-vif-plugged-322cb506-f3d1-49d4-956b-9cef1c9325cd for instance with vm_state building and task_state spawning.
Dec 05 15:27:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:52 user nova-compute[75080]: DEBUG nova.compute.manager [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:27:52 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:27:52 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Instance spawned successfully.
Dec 05 15:27:52 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:27:52 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:27:52 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:27:52 user nova-compute[75080]: DEBUG nova.compute.manager [None req-6282112e-495a-4f92-805f-1078d433aba8 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:27:52 user nova-compute[75080]: INFO nova.compute.manager [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Took 8.31 seconds to spawn the instance on the hypervisor.
Dec 05 15:27:52 user nova-compute[75080]: DEBUG nova.compute.manager [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:27:52 user nova-compute[75080]: INFO nova.compute.manager [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Took 10.52 seconds to build instance.
Dec 05 15:27:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a5bb22d1-d676-4d43-9a6d-ec05b1207d51 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "2ed540ae-41c0-4baf-bf69-52213850fb95" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.639s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:27:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:27:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "729c6c3a-9959-42dd-b698-949ad0d571f8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:28:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "729c6c3a-9959-42dd-b698-949ad0d571f8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:28:12 user nova-compute[75080]: DEBUG nova.compute.manager [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:28:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:28:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:28:12 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:28:12 user nova-compute[75080]: INFO nova.compute.claims [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Claim successful on node user
Dec 05 15:28:12 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:28:12 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:28:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.390s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:28:12 user nova-compute[75080]: DEBUG nova.compute.manager [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:28:12 user nova-compute[75080]: DEBUG nova.compute.manager [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:28:12 user nova-compute[75080]: DEBUG nova.network.neutron [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:28:12 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:28:12 user nova-compute[75080]: DEBUG nova.compute.manager [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:28:12 user nova-compute[75080]: INFO nova.virt.block_device [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Booting with volume 59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b at /dev/vda
Dec 05 15:28:12 user nova-compute[75080]: DEBUG nova.policy [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '15be5b54cc8346bb86683e4ed2fbba9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11227acd507347ae9c5a3bc710707f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:28:12 user nova-compute[75080]: DEBUG os_brick.utils [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:28:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:12 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9ee43c-ece2-4200-93b6-4ed4f15f0572]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:12 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ef57f3-c604-4ff8-a72e-998fe7fc4410]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:12 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f85d3c-9d21-43b1-b97e-064b24d0623c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:12 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[707ea89e-52a3-47db-8e95-7085f4e8840e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:28:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:28:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:28:12 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:28:12 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab0cc0f-7045-44b6-9927-ab785aa06048]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:28:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:28:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:28:12 user nova-compute[75080]: DEBUG os_brick.utils [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:28:12 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Updating existing volume attachment record: 22a448dc-c450-4f6e-bd42-1d4004516e66 {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:28:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:13 user nova-compute[75080]: DEBUG nova.network.neutron [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Successfully created port: a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:28:14 user nova-compute[75080]: DEBUG nova.network.neutron [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Successfully updated port: a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:28:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "refresh_cache-729c6c3a-9959-42dd-b698-949ad0d571f8" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:28:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquired lock "refresh_cache-729c6c3a-9959-42dd-b698-949ad0d571f8" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:28:14 user nova-compute[75080]: DEBUG nova.network.neutron [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:28:14 user nova-compute[75080]: DEBUG nova.network.neutron [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:28:14 user nova-compute[75080]: DEBUG nova.compute.manager [req-0db6b1d9-64c4-4e8c-99ba-a0424dc39cee req-1ed9625a-145c-43c9-af19-55b510c9c4bc service nova] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Received event network-changed-a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:28:14 user nova-compute[75080]: DEBUG nova.compute.manager [req-0db6b1d9-64c4-4e8c-99ba-a0424dc39cee req-1ed9625a-145c-43c9-af19-55b510c9c4bc service nova] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Refreshing instance network info cache due to event network-changed-a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:28:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0db6b1d9-64c4-4e8c-99ba-a0424dc39cee req-1ed9625a-145c-43c9-af19-55b510c9c4bc service nova] Acquiring lock "refresh_cache-729c6c3a-9959-42dd-b698-949ad0d571f8" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:28:14 user nova-compute[75080]: DEBUG nova.network.neutron [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Updating instance_info_cache with network_info: [{"id": "a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b", "address": "fa:16:3e:cd:64:15", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0bb5ab6-1e", "ovs_interfaceid": "a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:28:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Releasing lock "refresh_cache-729c6c3a-9959-42dd-b698-949ad0d571f8" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:28:14 user nova-compute[75080]: DEBUG nova.compute.manager [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Instance network_info: |[{"id": "a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b", "address": "fa:16:3e:cd:64:15", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0bb5ab6-1e", "ovs_interfaceid": "a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:28:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0db6b1d9-64c4-4e8c-99ba-a0424dc39cee req-1ed9625a-145c-43c9-af19-55b510c9c4bc service nova] Acquired lock "refresh_cache-729c6c3a-9959-42dd-b698-949ad0d571f8" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:28:14 user nova-compute[75080]: DEBUG nova.network.neutron [req-0db6b1d9-64c4-4e8c-99ba-a0424dc39cee req-1ed9625a-145c-43c9-af19-55b510c9c4bc service nova] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Refreshing network info cache for port a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:28:14 user nova-compute[75080]: DEBUG nova.network.neutron [req-0db6b1d9-64c4-4e8c-99ba-a0424dc39cee req-1ed9625a-145c-43c9-af19-55b510c9c4bc service nova] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Updated VIF entry in instance network info cache for port a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:28:14 user nova-compute[75080]: DEBUG nova.network.neutron [req-0db6b1d9-64c4-4e8c-99ba-a0424dc39cee req-1ed9625a-145c-43c9-af19-55b510c9c4bc service nova] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Updating instance_info_cache with network_info: [{"id": "a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b", "address": "fa:16:3e:cd:64:15", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0bb5ab6-1e", "ovs_interfaceid": "a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:28:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0db6b1d9-64c4-4e8c-99ba-a0424dc39cee req-1ed9625a-145c-43c9-af19-55b510c9c4bc service nova] Releasing lock "refresh_cache-729c6c3a-9959-42dd-b698-949ad0d571f8" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:28:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG nova.compute.manager [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:28:22 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Creating image(s)
Dec 05 15:28:22 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Did not create local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Ensure instance console log exists: /opt/stack/data/nova/instances/729c6c3a-9959-42dd-b698-949ad0d571f8/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Start _get_guest_xml network_info=[{"id": "a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b", "address": "fa:16:3e:cd:64:15", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0bb5ab6-1e", "ovs_interfaceid": "a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UuagHdeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '729c6c3a-9959-42dd-b698-949ad0d571f8', 'attached_at': '', 'detached_at': '', 'volume_id': '59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b', 'serial': '59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b'}, 'device_type': 'disk', 'attachment_id': '22a448dc-c450-4f6e-bd42-1d4004516e66', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:28:22 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:28:22 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:28:22 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UuagHdeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:28:22 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:28:22 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:28:22 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:28:22 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:28:22 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:28:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b264b1ae-7cde-4d4a-95e4-5eaaf7e45143]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:28:22 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd08509-cb02-4a81-8202-fdd2b6a73881]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b] added
Dec 05 15:28:22 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[976dbe2c-eb1b-4313-aeb0-9bbf42e11826]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba183165-8eff-45e5-846d-16cdbf5d4f1e]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:28:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UuagHdeV {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UuagHdeV" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:23 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d012a51a-7e52-4576-a202-235a4ff7ae49]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:23 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UuagHdeV'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:28:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:23 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14ccfa1-0f4e-4d6a-a0f9-38b113c04ac7]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:23 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:28:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:23 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8642a2-a946-4946-af06-531cef2b6e80]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:23 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:28:23 user nova-compute[75080]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:28:23 user nova-compute[75080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)
Dec 05 15:28:23 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:28:23 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:28:23 user nova-compute[75080]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:28:23 user nova-compute[75080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)
Dec 05 15:28:23 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:28:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:23 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab00918-9c2b-45cd-bc8e-385fb6696c42]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:23 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b, portal: 172.16.0.220,3260]
Dec 05 15:28:23 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b, portal: 172.16.0.220,3260] successful.
Dec 05 15:28:23 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:28:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:23 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee91f943-e187-4873-8f86-c11d66a1f83d]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:23 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:28:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:23 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb461bb7-8a6e-4a73-89d8-f7cb0234bdd5]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:23 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:28:23 user nova-compute[75080]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:28:23 user nova-compute[75080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)
Dec 05 15:28:23 user nova-compute[75080]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:28:23 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:28:23 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:28:23 user nova-compute[75080]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:28:23 user nova-compute[75080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)
Dec 05 15:28:23 user nova-compute[75080]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:28:23 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:28:23 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:28:23 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:28:23 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:28:23 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:28:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:23 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abb172e-a0b2-4a0a-a96d-7711f492c190]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:23 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:28:23 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UuagHdeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:28:23 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:28:23 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75080) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG nova.network.neutron [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Port 78547a5f-e10d-4a62-8d35-5584ce87d2c5 binding to destination host user is already ACTIVE {{(pid=75080) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Acquiring lock "refresh_cache-412e1e40-082a-429e-9d35-013b72322761" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Acquired lock "refresh_cache-412e1e40-082a-429e-9d35-013b72322761" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG nova.network.neutron [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23339616232633030', 'path': '/dev/sdd'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339616232633030', 'path': '/dev/sdd'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:28:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-999285683',display_name='tempest-TestVolumeBootPattern-server-999285683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-999285683',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbodyAsCj/LsLD4+fqj081LHmxK6h/6lXtC6JTYG6GWTlsJ9L34SglBGh22zHQ6DhZ8jkeGO+vsFyUrlKxX0aNv4V7kDdiXAt2Ew2tgqS8jk69Jg7JlqDhZvfUPpLsuMg==',key_name='tempest-TestVolumeBootPattern-1935536975',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11227acd507347ae9c5a3bc710707f84',ramdisk_id='',reservation_id='r-z1nvqdp8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-23416231',owner_user_name='tempest-TestVolumeBootPattern-23416231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:28:13Z,user_data=None,user_id='15be5b54cc8346bb86683e4ed2fbba9e',uuid=729c6c3a-9959-42dd-b698-949ad0d571f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b", "address": "fa:16:3e:cd:64:15", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0bb5ab6-1e", "ovs_interfaceid": "a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Converting VIF {"id": "a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b", "address": "fa:16:3e:cd:64:15", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0bb5ab6-1e", "ovs_interfaceid": "a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:64:15,bridge_name='br-int',has_traffic_filtering=True,id=a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0bb5ab6-1e') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG nova.objects.instance [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lazy-loading 'pci_devices' on Instance uuid 729c6c3a-9959-42dd-b698-949ad0d571f8 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:28:24 user nova-compute[75080]:   <uuid>729c6c3a-9959-42dd-b698-949ad0d571f8</uuid>
Dec 05 15:28:24 user nova-compute[75080]:   <name>instance-0000001b</name>
Dec 05 15:28:24 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:28:24 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:28:24 user nova-compute[75080]:   <metadata>
Dec 05 15:28:24 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:28:24 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:28:24 user nova-compute[75080]:       <nova:name>tempest-TestVolumeBootPattern-server-999285683</nova:name>
Dec 05 15:28:24 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:28:22</nova:creationTime>
Dec 05 15:28:24 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:28:24 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:28:24 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:28:24 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:28:24 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:28:24 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:28:24 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:28:24 user nova-compute[75080]:       <nova:owner>
Dec 05 15:28:24 user nova-compute[75080]:         <nova:user uuid="15be5b54cc8346bb86683e4ed2fbba9e">tempest-TestVolumeBootPattern-23416231-project-member</nova:user>
Dec 05 15:28:24 user nova-compute[75080]:         <nova:project uuid="11227acd507347ae9c5a3bc710707f84">tempest-TestVolumeBootPattern-23416231</nova:project>
Dec 05 15:28:24 user nova-compute[75080]:       </nova:owner>
Dec 05 15:28:24 user nova-compute[75080]:       <nova:ports>
Dec 05 15:28:24 user nova-compute[75080]:         <nova:port uuid="a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b">
Dec 05 15:28:24 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 05 15:28:24 user nova-compute[75080]:         </nova:port>
Dec 05 15:28:24 user nova-compute[75080]:       </nova:ports>
Dec 05 15:28:24 user nova-compute[75080]:     </nova:instance>
Dec 05 15:28:24 user nova-compute[75080]:   </metadata>
Dec 05 15:28:24 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:28:24 user nova-compute[75080]:     <system>
Dec 05 15:28:24 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:28:24 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:28:24 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:28:24 user nova-compute[75080]:       <entry name="serial">729c6c3a-9959-42dd-b698-949ad0d571f8</entry>
Dec 05 15:28:24 user nova-compute[75080]:       <entry name="uuid">729c6c3a-9959-42dd-b698-949ad0d571f8</entry>
Dec 05 15:28:24 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:28:24 user nova-compute[75080]:     </system>
Dec 05 15:28:24 user nova-compute[75080]:   </sysinfo>
Dec 05 15:28:24 user nova-compute[75080]:   <os>
Dec 05 15:28:24 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:28:24 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:28:24 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:28:24 user nova-compute[75080]:   </os>
Dec 05 15:28:24 user nova-compute[75080]:   <features>
Dec 05 15:28:24 user nova-compute[75080]:     <acpi/>
Dec 05 15:28:24 user nova-compute[75080]:     <apic/>
Dec 05 15:28:24 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:28:24 user nova-compute[75080]:   </features>
Dec 05 15:28:24 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:28:24 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:28:24 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:28:24 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:28:24 user nova-compute[75080]:   </clock>
Dec 05 15:28:24 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:28:24 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:28:24 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:28:24 user nova-compute[75080]:   </cpu>
Dec 05 15:28:24 user nova-compute[75080]:   <devices>
Dec 05 15:28:24 user nova-compute[75080]:     <disk type="block" device="disk">
Dec 05 15:28:24 user nova-compute[75080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:28:24 user nova-compute[75080]:       <source dev="/dev/sdd"/>
Dec 05 15:28:24 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:28:24 user nova-compute[75080]:       <serial>59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b</serial>
Dec 05 15:28:24 user nova-compute[75080]:     </disk>
Dec 05 15:28:24 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:28:24 user nova-compute[75080]:       <mac address="fa:16:3e:cd:64:15"/>
Dec 05 15:28:24 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:28:24 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:28:24 user nova-compute[75080]:       <target dev="tapa0bb5ab6-1e"/>
Dec 05 15:28:24 user nova-compute[75080]:     </interface>
Dec 05 15:28:24 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:28:24 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/729c6c3a-9959-42dd-b698-949ad0d571f8/console.log" append="off"/>
Dec 05 15:28:24 user nova-compute[75080]:     </serial>
Dec 05 15:28:24 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:28:24 user nova-compute[75080]:     <video>
Dec 05 15:28:24 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:28:24 user nova-compute[75080]:     </video>
Dec 05 15:28:24 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:28:24 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:28:24 user nova-compute[75080]:     </rng>
Dec 05 15:28:24 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:28:24 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:28:24 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:28:24 user nova-compute[75080]:     </memballoon>
Dec 05 15:28:24 user nova-compute[75080]:   </devices>
Dec 05 15:28:24 user nova-compute[75080]: </domain>
Dec 05 15:28:24 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:28:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-999285683',display_name='tempest-TestVolumeBootPattern-server-999285683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-999285683',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbodyAsCj/LsLD4+fqj081LHmxK6h/6lXtC6JTYG6GWTlsJ9L34SglBGh22zHQ6DhZ8jkeGO+vsFyUrlKxX0aNv4V7kDdiXAt2Ew2tgqS8jk69Jg7JlqDhZvfUPpLsuMg==',key_name='tempest-TestVolumeBootPattern-1935536975',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11227acd507347ae9c5a3bc710707f84',ramdisk_id='',reservation_id='r-z1nvqdp8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-23416231',owner_user_name='tempest-TestVolumeBootPattern-23416231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:28:13Z,user_data=None,user_id='15be5b54cc8346bb86683e4ed2fbba9e',uuid=729c6c3a-9959-42dd-b698-949ad0d571f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b", "address": "fa:16:3e:cd:64:15", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0bb5ab6-1e", "ovs_interfaceid": "a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Converting VIF {"id": "a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b", "address": "fa:16:3e:cd:64:15", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0bb5ab6-1e", "ovs_interfaceid": "a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:64:15,bridge_name='br-int',has_traffic_filtering=True,id=a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0bb5ab6-1e') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG os_vif [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:64:15,bridge_name='br-int',has_traffic_filtering=True,id=a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0bb5ab6-1e') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '013f1f16-1acb-55f9-9457-08f016e40f60', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0bb5ab6-1e, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa0bb5ab6-1e, col_values=(('qos', UUID('e7bbd81b-304f-4e90-97e1-7f97d980f39e')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa0bb5ab6-1e, col_values=(('external_ids', {'iface-id': 'a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:64:15', 'vm-uuid': '729c6c3a-9959-42dd-b698-949ad0d571f8'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:24 user nova-compute[75080]: INFO os_vif [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:64:15,bridge_name='br-int',has_traffic_filtering=True,id=a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0bb5ab6-1e')
Dec 05 15:28:24 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] No VIF found with MAC fa:16:3e:cd:64:15, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG nova.network.neutron [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Updating instance_info_cache with network_info: [{"id": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "address": "fa:16:3e:ab:04:37", "network": {"id": "3f7b7f16-6cc0-45b9-9f9c-efd112a71092", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-47517680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00d040579ca46338e01b8110a0ebc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78547a5f-e1", "ovs_interfaceid": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Releasing lock "refresh_cache-412e1e40-082a-429e-9d35-013b72322761" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Creating tmpfile /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/tmphjqqpffg to verify with other compute node that the instance is on the same shared storage. {{(pid=75080) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9630}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG nova.compute.manager [req-5e654f70-32ee-47bb-bca4-d5e76766dc6f req-e81c3aee-524e-46ec-995d-041decb7e02a service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] Received event network-vif-unplugged-78547a5f-e10d-4a62-8d35-5584ce87d2c5 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5e654f70-32ee-47bb-bca4-d5e76766dc6f req-e81c3aee-524e-46ec-995d-041decb7e02a service nova] Acquiring lock "412e1e40-082a-429e-9d35-013b72322761-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5e654f70-32ee-47bb-bca4-d5e76766dc6f req-e81c3aee-524e-46ec-995d-041decb7e02a service nova] Lock "412e1e40-082a-429e-9d35-013b72322761-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5e654f70-32ee-47bb-bca4-d5e76766dc6f req-e81c3aee-524e-46ec-995d-041decb7e02a service nova] Lock "412e1e40-082a-429e-9d35-013b72322761-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:28:24 user nova-compute[75080]: DEBUG nova.compute.manager [req-5e654f70-32ee-47bb-bca4-d5e76766dc6f req-e81c3aee-524e-46ec-995d-041decb7e02a service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] No waiting events found dispatching network-vif-unplugged-78547a5f-e10d-4a62-8d35-5584ce87d2c5 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:28:24 user nova-compute[75080]: WARNING nova.compute.manager [req-5e654f70-32ee-47bb-bca4-d5e76766dc6f req-e81c3aee-524e-46ec-995d-041decb7e02a service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] Received unexpected event network-vif-unplugged-78547a5f-e10d-4a62-8d35-5584ce87d2c5 for instance with vm_state resized and task_state resize_reverting.
Dec 05 15:28:25 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 412e1e40-082a-429e-9d35-013b72322761] Instance destroyed successfully.
Dec 05 15:28:25 user nova-compute[75080]: DEBUG nova.objects.instance [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lazy-loading 'resources' on Instance uuid 412e1e40-082a-429e-9d35-013b72322761 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:22:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1475628522',display_name='tempest-ServerActionsTestOtherB-server-1475628522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1475628522',id=17,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwmHJwK89ZUQ4UynGDWrkxG5H0hE1b2MJmPt/rTqIdK43uWLaFbVA/0/Nip6RjSnsKkWhAWpaEvyfqDY42bj2ESHH8OvSzPeboVnwtrtWSkYdz3jR4YJhIMViK+6gUdwg==',key_name='tempest-keypair-508009308',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:26:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c00d040579ca46338e01b8110a0ebc05',ramdisk_id='',reservation_id='r-col74in8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1903161286',owner_user_name='tempest-ServerActionsTestOtherB-1903161286-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:26:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='512e60f95c314913959f037132353c9e',uuid=412e1e40-082a-429e-9d35-013b72322761,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "address": "fa:16:3e:ab:04:37", "network": {"id": "3f7b7f16-6cc0-45b9-9f9c-efd112a71092", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-47517680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00d040579ca46338e01b8110a0ebc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78547a5f-e1", "ovs_interfaceid": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Converting VIF {"id": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "address": "fa:16:3e:ab:04:37", "network": {"id": "3f7b7f16-6cc0-45b9-9f9c-efd112a71092", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-47517680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00d040579ca46338e01b8110a0ebc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78547a5f-e1", "ovs_interfaceid": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:04:37,bridge_name='br-int',has_traffic_filtering=True,id=78547a5f-e10d-4a62-8d35-5584ce87d2c5,network=Network(3f7b7f16-6cc0-45b9-9f9c-efd112a71092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78547a5f-e1') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG os_vif [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:04:37,bridge_name='br-int',has_traffic_filtering=True,id=78547a5f-e10d-4a62-8d35-5584ce87d2c5,network=Network(3f7b7f16-6cc0-45b9-9f9c-efd112a71092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78547a5f-e1') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78547a5f-e1, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2070c5cf-2fea-44b4-82b2-3bbaef025e43) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:25 user nova-compute[75080]: INFO os_vif [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:04:37,bridge_name='br-int',has_traffic_filtering=True,id=78547a5f-e10d-4a62-8d35-5584ce87d2c5,network=Network(3f7b7f16-6cc0-45b9-9f9c-efd112a71092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78547a5f-e1')
Dec 05 15:28:25 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BMaNUgCf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:28:25 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:28:25 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[51179087-f2bd-489e-9ea9-aaa37de05241]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:28:25 user nova-compute[75080]: No targets found.
Dec 05 15:28:25 user nova-compute[75080]: iSNS:
Dec 05 15:28:25 user nova-compute[75080]: No targets found.
Dec 05 15:28:25 user nova-compute[75080]: STATIC:
Dec 05 15:28:25 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399
Dec 05 15:28:25 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:28:25 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:28:25 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960
Dec 05 15:28:25 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:28:25 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:28:25 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b
Dec 05 15:28:25 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:28:25 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:28:25 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb
Dec 05 15:28:25 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:28:25 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:28:25 user nova-compute[75080]: FIRMWARE:
Dec 05 15:28:25 user nova-compute[75080]: No targets found.
Dec 05 15:28:25 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:28:25 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:28:25 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c3034c-76fc-4ed9-be70-45cee7e6647c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d28f38-71ca-495a-846a-87db33e49d3f]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:28:25 user nova-compute[75080]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:28:25 user nova-compute[75080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)
Dec 05 15:28:25 user nova-compute[75080]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:28:25 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:28:25 user nova-compute[75080]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:28:25 user nova-compute[75080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)
Dec 05 15:28:25 user nova-compute[75080]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:28:25 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f665c448430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb'): ({'sdc'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Removing single pathed devices sdc {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0b5055-f890-423f-94f2-96391bc51e20]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d1cf90-34c5-44aa-97ba-7283f2d27bc5]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Flushing IO for device /dev/sdc {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc0490c-6ca9-453c-a78c-8d2c3fc7bb52]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f96d71-5538-4c63-a915-755d56b60716]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] SCSI volumes sdc have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ec48a7-32a7-4804-b465-fb63eee64cb9]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:26 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9da30b-a9f5-4c98-a66d-ed1e2e29b47c]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:26 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb, portal: 172.16.0.220,3260]
Dec 05 15:28:26 user nova-compute[75080]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb, portal: 172.16.0.220,3260] successful.
Dec 05 15:28:26 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:28:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:26 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1429b5a6-a70e-4f5b-8d31-88db1d42154a]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:26 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:28:26 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:28:26 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] <== disconnect_volume: return (339ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:28:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:28:26 user nova-compute[75080]: DEBUG nova.compute.manager [req-573b08b8-ee64-48cd-aa8b-551d44481092 req-8587eabc-50e9-4903-bc35-8d2033acb209 service nova] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Received event network-vif-plugged-a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:28:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-573b08b8-ee64-48cd-aa8b-551d44481092 req-8587eabc-50e9-4903-bc35-8d2033acb209 service nova] Acquiring lock "729c6c3a-9959-42dd-b698-949ad0d571f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:28:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-573b08b8-ee64-48cd-aa8b-551d44481092 req-8587eabc-50e9-4903-bc35-8d2033acb209 service nova] Lock "729c6c3a-9959-42dd-b698-949ad0d571f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:28:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-573b08b8-ee64-48cd-aa8b-551d44481092 req-8587eabc-50e9-4903-bc35-8d2033acb209 service nova] Lock "729c6c3a-9959-42dd-b698-949ad0d571f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:28:26 user nova-compute[75080]: DEBUG nova.compute.manager [req-573b08b8-ee64-48cd-aa8b-551d44481092 req-8587eabc-50e9-4903-bc35-8d2033acb209 service nova] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] No waiting events found dispatching network-vif-plugged-a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:28:26 user nova-compute[75080]: WARNING nova.compute.manager [req-573b08b8-ee64-48cd-aa8b-551d44481092 req-8587eabc-50e9-4903-bc35-8d2033acb209 service nova] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Received unexpected event network-vif-plugged-a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b for instance with vm_state building and task_state spawning.
Dec 05 15:28:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:27 user nova-compute[75080]: DEBUG nova.compute.manager [req-f3a4522c-f9e1-40af-89fe-9229f3f19ec4 req-b99d593a-eb72-4852-bd3d-7422f9951db2 service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] Received event network-vif-plugged-78547a5f-e10d-4a62-8d35-5584ce87d2c5 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:28:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f3a4522c-f9e1-40af-89fe-9229f3f19ec4 req-b99d593a-eb72-4852-bd3d-7422f9951db2 service nova] Acquiring lock "412e1e40-082a-429e-9d35-013b72322761-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:28:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f3a4522c-f9e1-40af-89fe-9229f3f19ec4 req-b99d593a-eb72-4852-bd3d-7422f9951db2 service nova] Lock "412e1e40-082a-429e-9d35-013b72322761-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:28:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f3a4522c-f9e1-40af-89fe-9229f3f19ec4 req-b99d593a-eb72-4852-bd3d-7422f9951db2 service nova] Lock "412e1e40-082a-429e-9d35-013b72322761-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:28:27 user nova-compute[75080]: DEBUG nova.compute.manager [req-f3a4522c-f9e1-40af-89fe-9229f3f19ec4 req-b99d593a-eb72-4852-bd3d-7422f9951db2 service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] No waiting events found dispatching network-vif-plugged-78547a5f-e10d-4a62-8d35-5584ce87d2c5 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:28:27 user nova-compute[75080]: WARNING nova.compute.manager [req-f3a4522c-f9e1-40af-89fe-9229f3f19ec4 req-b99d593a-eb72-4852-bd3d-7422f9951db2 service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] Received unexpected event network-vif-plugged-78547a5f-e10d-4a62-8d35-5584ce87d2c5 for instance with vm_state resized and task_state resize_reverting.
Dec 05 15:28:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:28:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:28:27 user nova-compute[75080]: DEBUG nova.objects.instance [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lazy-loading 'migration_context' on Instance uuid 412e1e40-082a-429e-9d35-013b72322761 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:28:27 user nova-compute[75080]: DEBUG nova.objects.base [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Object Instance<412e1e40-082a-429e-9d35-013b72322761> lazy-loaded attributes: resources,migration_context {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:28:27 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:28:27 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:28:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.442s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:28:27 user nova-compute[75080]: INFO nova.compute.manager [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Swapping old allocation on dict_keys(['21b770fa-b774-46c9-9415-db26064ccd0f']) held by migration 6a14dafe-5a94-4c59-bb53-5aac3920fec0 for instance
Dec 05 15:28:27 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Overwriting current allocation {'allocations': {'21b770fa-b774-46c9-9415-db26064ccd0f': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 31}}, 'project_id': 'c00d040579ca46338e01b8110a0ebc05', 'user_id': '512e60f95c314913959f037132353c9e', 'consumer_generation': 1} on consumer 412e1e40-082a-429e-9d35-013b72322761 {{(pid=75080) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Dec 05 15:28:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Acquiring lock "refresh_cache-412e1e40-082a-429e-9d35-013b72322761" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:28:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Acquired lock "refresh_cache-412e1e40-082a-429e-9d35-013b72322761" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:28:28 user nova-compute[75080]: DEBUG nova.network.neutron [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:28:28 user nova-compute[75080]: DEBUG nova.compute.manager [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:28:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:28:28 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Instance spawned successfully.
Dec 05 15:28:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:28:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:28:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:28:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:28:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:28:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:28:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:28:28 user nova-compute[75080]: DEBUG nova.compute.manager [req-1a7c73d5-206e-4017-978c-2a93a908d2ac req-8a260614-024c-4e14-9775-a624bd5e32fd service nova] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Received event network-vif-plugged-a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:28:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-1a7c73d5-206e-4017-978c-2a93a908d2ac req-8a260614-024c-4e14-9775-a624bd5e32fd service nova] Acquiring lock "729c6c3a-9959-42dd-b698-949ad0d571f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:28:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-1a7c73d5-206e-4017-978c-2a93a908d2ac req-8a260614-024c-4e14-9775-a624bd5e32fd service nova] Lock "729c6c3a-9959-42dd-b698-949ad0d571f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:28:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-1a7c73d5-206e-4017-978c-2a93a908d2ac req-8a260614-024c-4e14-9775-a624bd5e32fd service nova] Lock "729c6c3a-9959-42dd-b698-949ad0d571f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:28:28 user nova-compute[75080]: DEBUG nova.compute.manager [req-1a7c73d5-206e-4017-978c-2a93a908d2ac req-8a260614-024c-4e14-9775-a624bd5e32fd service nova] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] No waiting events found dispatching network-vif-plugged-a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:28:28 user nova-compute[75080]: WARNING nova.compute.manager [req-1a7c73d5-206e-4017-978c-2a93a908d2ac req-8a260614-024c-4e14-9775-a624bd5e32fd service nova] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Received unexpected event network-vif-plugged-a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b for instance with vm_state building and task_state spawning.
Dec 05 15:28:28 user nova-compute[75080]: INFO nova.compute.manager [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Took 5.58 seconds to spawn the instance on the hypervisor.
Dec 05 15:28:28 user nova-compute[75080]: DEBUG nova.compute.manager [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:28:28 user nova-compute[75080]: INFO nova.compute.manager [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Took 16.36 seconds to build instance.
Dec 05 15:28:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-10c5bf45-2c92-4b65-8607-de1234ab5922 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "729c6c3a-9959-42dd-b698-949ad0d571f8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.464s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:28:28 user nova-compute[75080]: DEBUG nova.network.neutron [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Updating instance_info_cache with network_info: [{"id": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "address": "fa:16:3e:ab:04:37", "network": {"id": "3f7b7f16-6cc0-45b9-9f9c-efd112a71092", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-47517680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00d040579ca46338e01b8110a0ebc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78547a5f-e1", "ovs_interfaceid": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:28:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Releasing lock "refresh_cache-412e1e40-082a-429e-9d35-013b72322761" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:28:28 user nova-compute[75080]: DEBUG os_brick.utils [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:28:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3b4376-58c1-4b06-9172-15a10b9b00b5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a4965c-3c3a-414a-a2c0-ca5238b1be68]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[541a2a8d-d2e5-4b0d-8b5c-946a1d58f35c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba4ceb3-9ec6-47fc-a560-5e0f9bcda777]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:28:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:28:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:28:29 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:28:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[050327fe-25eb-480f-b9fc-aee38edfe33f]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:28:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:28:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:28:29 user nova-compute[75080]: DEBUG os_brick.utils [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:28:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:29 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:28:30 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:28:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:31 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:28:31 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:28:31 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:28:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:32 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:28:32 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:28:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-07b025ff-4a9d-48a2-b950-b8f2d165f33c" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:28:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-07b025ff-4a9d-48a2-b950-b8f2d165f33c" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:28:32 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 15:28:33 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Updating instance_info_cache with network_info: [{"id": "b499a54e-2aab-4f63-a634-66c6a627bb4a", "address": "fa:16:3e:14:03:09", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb499a54e-2a", "ovs_interfaceid": "b499a54e-2aab-4f63-a634-66c6a627bb4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:28:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-07b025ff-4a9d-48a2-b950-b8f2d165f33c" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:28:33 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 15:28:33 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:28:33 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:28:33 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Cleaning up deleted instances {{(pid=75080) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 05 15:28:33 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] There are 0 instances to clean {{(pid=75080) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 05 15:28:34 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:28:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:28:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:28:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:28:34 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:28:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:28:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:28:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed540ae-41c0-4baf-bf69-52213850fb95/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed540ae-41c0-4baf-bf69-52213850fb95/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed540ae-41c0-4baf-bf69-52213850fb95/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed540ae-41c0-4baf-bf69-52213850fb95/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:28:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab882db7-e6d7-44ca-9ea4-ae2fa68f7929/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab882db7-e6d7-44ca-9ea4-ae2fa68f7929/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab882db7-e6d7-44ca-9ea4-ae2fa68f7929/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab882db7-e6d7-44ca-9ea4-ae2fa68f7929/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:38 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:28:38 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:28:38 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=7852MB free_disk=24.92609405517578GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:28:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:28:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:28:38 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance eedd1529-4feb-4f85-8625-0c20d8e0359d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:28:38 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 07b025ff-4a9d-48a2-b950-b8f2d165f33c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:28:38 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:28:38 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance c9836958-96d4-4b3e-a45c-fbb97846dbd4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:28:38 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance ab882db7-e6d7-44ca-9ea4-ae2fa68f7929 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:28:38 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 412e1e40-082a-429e-9d35-013b72322761 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:28:38 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 06d40106-075c-4b29-bfc5-a0224ece1d45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:28:38 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 2ed540ae-41c0-4baf-bf69-52213850fb95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:28:38 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 729c6c3a-9959-42dd-b698-949ad0d571f8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:28:38 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:28:38 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:28:38 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing inventories for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 05 15:28:38 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Updating ProviderTree inventory for provider 21b770fa-b774-46c9-9415-db26064ccd0f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 05 15:28:38 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Updating inventory in ProviderTree for provider 21b770fa-b774-46c9-9415-db26064ccd0f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 15:28:38 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing aggregate associations for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f, aggregates: None {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 05 15:28:38 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing trait associations for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f, traits: COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.791s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Starting finish_revert_migration {{(pid=75080) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11822}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Start _get_guest_xml network_info=[{"id": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "address": "fa:16:3e:ab:04:37", "network": {"id": "3f7b7f16-6cc0-45b9-9f9c-efd112a71092", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-47517680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00d040579ca46338e01b8110a0ebc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78547a5f-e1", "ovs_interfaceid": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BMaNUgCf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '412e1e40-082a-429e-9d35-013b72322761', 'attached_at': '2023-12-05T15:28:39.000000', 'detached_at': '', 'volume_id': '64d9a505-3db3-49e1-b76d-68f48f59c4cb', 'serial': '64d9a505-3db3-49e1-b76d-68f48f59c4cb'}, 'device_type': 'disk', 'attachment_id': 'd1a0550a-438e-496f-9a16-707b066a8c26', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:28:39 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:28:39 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:28:39 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG nova.objects.instance [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lazy-loading 'vcpu_model' on Instance uuid 412e1e40-082a-429e-9d35-013b72322761 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BMaNUgCf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:28:39 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:28:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:28:39 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:28:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:28:39 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:28:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[018d92ca-2118-42bd-b435-1c60a857f188]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:28:39 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[78baf340-f8c0-4877-aa8e-531c91ef84dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb] added
Dec 05 15:28:39 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[73190497-59a0-4805-a9f5-6a824b93380f]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36d143b-b53f-44bf-b21b-230ad9a3e917]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BMaNUgCf {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BMaNUgCf" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d076d1-5769-437e-9a53-1695fa2ce2bf]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BMaNUgCf'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4a210d-3f86-4093-a1b8-05478bfd52b0]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3893ef73-c085-4927-92fb-ef7957e6a382]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:28:39 user nova-compute[75080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)
Dec 05 15:28:39 user nova-compute[75080]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:28:39 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:28:39 user nova-compute[75080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)
Dec 05 15:28:39 user nova-compute[75080]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:28:39 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ac3c24-da73-4746-82fc-3fd46da8343e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb, portal: 172.16.0.220,3260]
Dec 05 15:28:39 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb, portal: 172.16.0.220,3260] successful.
Dec 05 15:28:39 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[89cead78-f9b1-404a-8a10-956116579944]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d9ff7b-032b-4602-9f48-8a7501d8cb3c]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:28:39 user nova-compute[75080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)
Dec 05 15:28:39 user nova-compute[75080]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:28:39 user nova-compute[75080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:28:39 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:28:39 user nova-compute[75080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)
Dec 05 15:28:39 user nova-compute[75080]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:28:39 user nova-compute[75080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:28:39 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcabf68d-2b05-403f-bb68-213b96922f62]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:28:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BMaNUgCf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "011d3446-577a-4f5c-b8f0-ef04940cad17" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG nova.compute.manager [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:28:40 user nova-compute[75080]: INFO nova.compute.claims [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Claim successful on node user
Dec 05 15:28:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26535306436353734', 'path': '/dev/sdc'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535306436353734', 'path': '/dev/sdc'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:22:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1475628522',display_name='tempest-ServerActionsTestOtherB-server-1475628522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1475628522',id=17,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwmHJwK89ZUQ4UynGDWrkxG5H0hE1b2MJmPt/rTqIdK43uWLaFbVA/0/Nip6RjSnsKkWhAWpaEvyfqDY42bj2ESHH8OvSzPeboVnwtrtWSkYdz3jR4YJhIMViK+6gUdwg==',key_name='tempest-keypair-508009308',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:26:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c00d040579ca46338e01b8110a0ebc05',ramdisk_id='',reservation_id='r-col74in8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1903161286',owner_user_name='tempest-ServerActionsTestOtherB-1903161286-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:28:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='512e60f95c314913959f037132353c9e',uuid=412e1e40-082a-429e-9d35-013b72322761,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "address": "fa:16:3e:ab:04:37", "network": {"id": "3f7b7f16-6cc0-45b9-9f9c-efd112a71092", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-47517680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00d040579ca46338e01b8110a0ebc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78547a5f-e1", "ovs_interfaceid": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Converting VIF {"id": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "address": "fa:16:3e:ab:04:37", "network": {"id": "3f7b7f16-6cc0-45b9-9f9c-efd112a71092", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-47517680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00d040579ca46338e01b8110a0ebc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78547a5f-e1", "ovs_interfaceid": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:04:37,bridge_name='br-int',has_traffic_filtering=True,id=78547a5f-e10d-4a62-8d35-5584ce87d2c5,network=Network(3f7b7f16-6cc0-45b9-9f9c-efd112a71092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78547a5f-e1') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:28:40 user nova-compute[75080]:   <uuid>412e1e40-082a-429e-9d35-013b72322761</uuid>
Dec 05 15:28:40 user nova-compute[75080]:   <name>instance-00000011</name>
Dec 05 15:28:40 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:28:40 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:28:40 user nova-compute[75080]:   <metadata>
Dec 05 15:28:40 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:28:40 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:28:40 user nova-compute[75080]:       <nova:name>tempest-ServerActionsTestOtherB-server-1475628522</nova:name>
Dec 05 15:28:40 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:28:39</nova:creationTime>
Dec 05 15:28:40 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:28:40 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:28:40 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:28:40 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:28:40 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:28:40 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:28:40 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:28:40 user nova-compute[75080]:       <nova:owner>
Dec 05 15:28:40 user nova-compute[75080]:         <nova:user uuid="512e60f95c314913959f037132353c9e">tempest-ServerActionsTestOtherB-1903161286-project-member</nova:user>
Dec 05 15:28:40 user nova-compute[75080]:         <nova:project uuid="c00d040579ca46338e01b8110a0ebc05">tempest-ServerActionsTestOtherB-1903161286</nova:project>
Dec 05 15:28:40 user nova-compute[75080]:       </nova:owner>
Dec 05 15:28:40 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:28:40 user nova-compute[75080]:       <nova:ports>
Dec 05 15:28:40 user nova-compute[75080]:         <nova:port uuid="78547a5f-e10d-4a62-8d35-5584ce87d2c5">
Dec 05 15:28:40 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 05 15:28:40 user nova-compute[75080]:         </nova:port>
Dec 05 15:28:40 user nova-compute[75080]:       </nova:ports>
Dec 05 15:28:40 user nova-compute[75080]:     </nova:instance>
Dec 05 15:28:40 user nova-compute[75080]:   </metadata>
Dec 05 15:28:40 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:28:40 user nova-compute[75080]:     <system>
Dec 05 15:28:40 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:28:40 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:28:40 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:28:40 user nova-compute[75080]:       <entry name="serial">412e1e40-082a-429e-9d35-013b72322761</entry>
Dec 05 15:28:40 user nova-compute[75080]:       <entry name="uuid">412e1e40-082a-429e-9d35-013b72322761</entry>
Dec 05 15:28:40 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:28:40 user nova-compute[75080]:     </system>
Dec 05 15:28:40 user nova-compute[75080]:   </sysinfo>
Dec 05 15:28:40 user nova-compute[75080]:   <os>
Dec 05 15:28:40 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:28:40 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:28:40 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:28:40 user nova-compute[75080]:   </os>
Dec 05 15:28:40 user nova-compute[75080]:   <features>
Dec 05 15:28:40 user nova-compute[75080]:     <acpi/>
Dec 05 15:28:40 user nova-compute[75080]:     <apic/>
Dec 05 15:28:40 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:28:40 user nova-compute[75080]:   </features>
Dec 05 15:28:40 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:28:40 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:28:40 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:28:40 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:28:40 user nova-compute[75080]:   </clock>
Dec 05 15:28:40 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:28:40 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:28:40 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:28:40 user nova-compute[75080]:   </cpu>
Dec 05 15:28:40 user nova-compute[75080]:   <devices>
Dec 05 15:28:40 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:28:40 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:28:40 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk"/>
Dec 05 15:28:40 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:28:40 user nova-compute[75080]:     </disk>
Dec 05 15:28:40 user nova-compute[75080]:     <disk type="block" device="disk">
Dec 05 15:28:40 user nova-compute[75080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:28:40 user nova-compute[75080]:       <source dev="/dev/sdc"/>
Dec 05 15:28:40 user nova-compute[75080]:       <target dev="vdb" bus="virtio"/>
Dec 05 15:28:40 user nova-compute[75080]:       <serial>64d9a505-3db3-49e1-b76d-68f48f59c4cb</serial>
Dec 05 15:28:40 user nova-compute[75080]:     </disk>
Dec 05 15:28:40 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:28:40 user nova-compute[75080]:       <mac address="fa:16:3e:ab:04:37"/>
Dec 05 15:28:40 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:28:40 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:28:40 user nova-compute[75080]:       <target dev="tap78547a5f-e1"/>
Dec 05 15:28:40 user nova-compute[75080]:     </interface>
Dec 05 15:28:40 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:28:40 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/console.log" append="off"/>
Dec 05 15:28:40 user nova-compute[75080]:     </serial>
Dec 05 15:28:40 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:28:40 user nova-compute[75080]:     <video>
Dec 05 15:28:40 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:28:40 user nova-compute[75080]:     </video>
Dec 05 15:28:40 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:28:40 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:28:40 user nova-compute[75080]:     </rng>
Dec 05 15:28:40 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:28:40 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:28:40 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:28:40 user nova-compute[75080]:     </memballoon>
Dec 05 15:28:40 user nova-compute[75080]:   </devices>
Dec 05 15:28:40 user nova-compute[75080]: </domain>
Dec 05 15:28:40 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:22:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1475628522',display_name='tempest-ServerActionsTestOtherB-server-1475628522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1475628522',id=17,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwmHJwK89ZUQ4UynGDWrkxG5H0hE1b2MJmPt/rTqIdK43uWLaFbVA/0/Nip6RjSnsKkWhAWpaEvyfqDY42bj2ESHH8OvSzPeboVnwtrtWSkYdz3jR4YJhIMViK+6gUdwg==',key_name='tempest-keypair-508009308',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:26:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c00d040579ca46338e01b8110a0ebc05',ramdisk_id='',reservation_id='r-col74in8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1903161286',owner_user_name='tempest-ServerActionsTestOtherB-1903161286-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:28:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='512e60f95c314913959f037132353c9e',uuid=412e1e40-082a-429e-9d35-013b72322761,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "address": "fa:16:3e:ab:04:37", "network": {"id": "3f7b7f16-6cc0-45b9-9f9c-efd112a71092", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-47517680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00d040579ca46338e01b8110a0ebc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78547a5f-e1", "ovs_interfaceid": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Converting VIF {"id": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "address": "fa:16:3e:ab:04:37", "network": {"id": "3f7b7f16-6cc0-45b9-9f9c-efd112a71092", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-47517680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00d040579ca46338e01b8110a0ebc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78547a5f-e1", "ovs_interfaceid": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:04:37,bridge_name='br-int',has_traffic_filtering=True,id=78547a5f-e10d-4a62-8d35-5584ce87d2c5,network=Network(3f7b7f16-6cc0-45b9-9f9c-efd112a71092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78547a5f-e1') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG os_vif [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:04:37,bridge_name='br-int',has_traffic_filtering=True,id=78547a5f-e10d-4a62-8d35-5584ce87d2c5,network=Network(3f7b7f16-6cc0-45b9-9f9c-efd112a71092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78547a5f-e1') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '41ed10b0-ba5b-52f0-a9c7-7087de9df1c3', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78547a5f-e1, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap78547a5f-e1, col_values=(('qos', UUID('03008ec0-9178-4b01-bd31-97a1fc77cb09')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap78547a5f-e1, col_values=(('external_ids', {'iface-id': '78547a5f-e10d-4a62-8d35-5584ce87d2c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:04:37', 'vm-uuid': '412e1e40-082a-429e-9d35-013b72322761'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:40 user nova-compute[75080]: INFO os_vif [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:04:37,bridge_name='br-int',has_traffic_filtering=True,id=78547a5f-e10d-4a62-8d35-5584ce87d2c5,network=Network(3f7b7f16-6cc0-45b9-9f9c-efd112a71092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78547a5f-e1')
Dec 05 15:28:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG nova.compute.manager [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG nova.compute.manager [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG nova.network.neutron [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:28:40 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:28:40 user nova-compute[75080]: DEBUG nova.compute.manager [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG nova.policy [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7a02caebbfe541209b87adcbf848ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01b18b2a93b457c8e160447d44a673e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG nova.compute.manager [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:28:40 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Creating image(s)
Dec 05 15:28:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "/opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "/opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "/opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:28:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:41 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:28:41 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:28:41 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:28:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.259s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:28:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:28:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.183s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk 1073741824" returned: 0 in 0.074s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:28:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:41 user nova-compute[75080]: DEBUG nova.network.neutron [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Successfully created port: dfee0a0e-5241-4d51-879d-7667bb06344b {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:28:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.174s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:41 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Checking if we can resize image /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 15:28:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:28:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:28:41 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Cannot resize image /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 15:28:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:28:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Ensure instance console log exists: /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:28:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:28:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:28:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG nova.network.neutron [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Successfully updated port: dfee0a0e-5241-4d51-879d-7667bb06344b {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "refresh_cache-011d3446-577a-4f5c-b8f0-ef04940cad17" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquired lock "refresh_cache-011d3446-577a-4f5c-b8f0-ef04940cad17" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG nova.network.neutron [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG nova.compute.manager [req-f2a6bee2-3461-4fb1-8d23-392cf39e523f req-3261cb92-f942-41a8-a304-6c7f94940f7a service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Received event network-changed-dfee0a0e-5241-4d51-879d-7667bb06344b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG nova.compute.manager [req-f2a6bee2-3461-4fb1-8d23-392cf39e523f req-3261cb92-f942-41a8-a304-6c7f94940f7a service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Refreshing instance network info cache due to event network-changed-dfee0a0e-5241-4d51-879d-7667bb06344b. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f2a6bee2-3461-4fb1-8d23-392cf39e523f req-3261cb92-f942-41a8-a304-6c7f94940f7a service nova] Acquiring lock "refresh_cache-011d3446-577a-4f5c-b8f0-ef04940cad17" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG nova.network.neutron [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG nova.network.neutron [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Updating instance_info_cache with network_info: [{"id": "dfee0a0e-5241-4d51-879d-7667bb06344b", "address": "fa:16:3e:be:d6:bd", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfee0a0e-52", "ovs_interfaceid": "dfee0a0e-5241-4d51-879d-7667bb06344b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Releasing lock "refresh_cache-011d3446-577a-4f5c-b8f0-ef04940cad17" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG nova.compute.manager [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Instance network_info: |[{"id": "dfee0a0e-5241-4d51-879d-7667bb06344b", "address": "fa:16:3e:be:d6:bd", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfee0a0e-52", "ovs_interfaceid": "dfee0a0e-5241-4d51-879d-7667bb06344b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f2a6bee2-3461-4fb1-8d23-392cf39e523f req-3261cb92-f942-41a8-a304-6c7f94940f7a service nova] Acquired lock "refresh_cache-011d3446-577a-4f5c-b8f0-ef04940cad17" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG nova.network.neutron [req-f2a6bee2-3461-4fb1-8d23-392cf39e523f req-3261cb92-f942-41a8-a304-6c7f94940f7a service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Refreshing network info cache for port dfee0a0e-5241-4d51-879d-7667bb06344b {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Start _get_guest_xml network_info=[{"id": "dfee0a0e-5241-4d51-879d-7667bb06344b", "address": "fa:16:3e:be:d6:bd", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfee0a0e-52", "ovs_interfaceid": "dfee0a0e-5241-4d51-879d-7667bb06344b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:28:42 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:28:42 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:28:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:28:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-215552341',display_name='tempest-AttachVolumeTestJSON-server-215552341',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-215552341',id=28,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNR5WqP/N7bn4T+SXNEWvIjtaw5+s7Hk+R+FM8SRLh86FpF209SN9UyEjy0e1+2DKmJSUEmh664j9n8POCm+HUQ9EtbpXmMRPj40zHqJTQgREs+C9f2zqAuxq3d0+o2xbw==',key_name='tempest-keypair-1745876029',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a01b18b2a93b457c8e160447d44a673e',ramdisk_id='',reservation_id='r-oe6cj9ox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1911411330',owner_user_name='tempest-AttachVolumeTestJSON-1911411330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:28:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a02caebbfe541209b87adcbf848ede6',uuid=011d3446-577a-4f5c-b8f0-ef04940cad17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfee0a0e-5241-4d51-879d-7667bb06344b", "address": "fa:16:3e:be:d6:bd", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfee0a0e-52", "ovs_interfaceid": "dfee0a0e-5241-4d51-879d-7667bb06344b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Converting VIF {"id": "dfee0a0e-5241-4d51-879d-7667bb06344b", "address": "fa:16:3e:be:d6:bd", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfee0a0e-52", "ovs_interfaceid": "dfee0a0e-5241-4d51-879d-7667bb06344b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:d6:bd,bridge_name='br-int',has_traffic_filtering=True,id=dfee0a0e-5241-4d51-879d-7667bb06344b,network=Network(3037e443-f4eb-446e-8a80-53f409b02ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfee0a0e-52') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG nova.objects.instance [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lazy-loading 'pci_devices' on Instance uuid 011d3446-577a-4f5c-b8f0-ef04940cad17 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:28:42 user nova-compute[75080]:   <uuid>011d3446-577a-4f5c-b8f0-ef04940cad17</uuid>
Dec 05 15:28:42 user nova-compute[75080]:   <name>instance-0000001c</name>
Dec 05 15:28:42 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:28:42 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:28:42 user nova-compute[75080]:   <metadata>
Dec 05 15:28:42 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:28:42 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:28:42 user nova-compute[75080]:       <nova:name>tempest-AttachVolumeTestJSON-server-215552341</nova:name>
Dec 05 15:28:42 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:28:42</nova:creationTime>
Dec 05 15:28:42 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:28:42 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:28:42 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:28:42 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:28:42 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:28:42 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:28:42 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:28:42 user nova-compute[75080]:       <nova:owner>
Dec 05 15:28:42 user nova-compute[75080]:         <nova:user uuid="7a02caebbfe541209b87adcbf848ede6">tempest-AttachVolumeTestJSON-1911411330-project-member</nova:user>
Dec 05 15:28:42 user nova-compute[75080]:         <nova:project uuid="a01b18b2a93b457c8e160447d44a673e">tempest-AttachVolumeTestJSON-1911411330</nova:project>
Dec 05 15:28:42 user nova-compute[75080]:       </nova:owner>
Dec 05 15:28:42 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:28:42 user nova-compute[75080]:       <nova:ports>
Dec 05 15:28:42 user nova-compute[75080]:         <nova:port uuid="dfee0a0e-5241-4d51-879d-7667bb06344b">
Dec 05 15:28:42 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 05 15:28:42 user nova-compute[75080]:         </nova:port>
Dec 05 15:28:42 user nova-compute[75080]:       </nova:ports>
Dec 05 15:28:42 user nova-compute[75080]:     </nova:instance>
Dec 05 15:28:42 user nova-compute[75080]:   </metadata>
Dec 05 15:28:42 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:28:42 user nova-compute[75080]:     <system>
Dec 05 15:28:42 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:28:42 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:28:42 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:28:42 user nova-compute[75080]:       <entry name="serial">011d3446-577a-4f5c-b8f0-ef04940cad17</entry>
Dec 05 15:28:42 user nova-compute[75080]:       <entry name="uuid">011d3446-577a-4f5c-b8f0-ef04940cad17</entry>
Dec 05 15:28:42 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:28:42 user nova-compute[75080]:     </system>
Dec 05 15:28:42 user nova-compute[75080]:   </sysinfo>
Dec 05 15:28:42 user nova-compute[75080]:   <os>
Dec 05 15:28:42 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:28:42 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:28:42 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:28:42 user nova-compute[75080]:   </os>
Dec 05 15:28:42 user nova-compute[75080]:   <features>
Dec 05 15:28:42 user nova-compute[75080]:     <acpi/>
Dec 05 15:28:42 user nova-compute[75080]:     <apic/>
Dec 05 15:28:42 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:28:42 user nova-compute[75080]:   </features>
Dec 05 15:28:42 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:28:42 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:28:42 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:28:42 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:28:42 user nova-compute[75080]:   </clock>
Dec 05 15:28:42 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:28:42 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:28:42 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:28:42 user nova-compute[75080]:   </cpu>
Dec 05 15:28:42 user nova-compute[75080]:   <devices>
Dec 05 15:28:42 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:28:42 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:28:42 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk"/>
Dec 05 15:28:42 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:28:42 user nova-compute[75080]:     </disk>
Dec 05 15:28:42 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:28:42 user nova-compute[75080]:       <mac address="fa:16:3e:be:d6:bd"/>
Dec 05 15:28:42 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:28:42 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:28:42 user nova-compute[75080]:       <target dev="tapdfee0a0e-52"/>
Dec 05 15:28:42 user nova-compute[75080]:     </interface>
Dec 05 15:28:42 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:28:42 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/console.log" append="off"/>
Dec 05 15:28:42 user nova-compute[75080]:     </serial>
Dec 05 15:28:42 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:28:42 user nova-compute[75080]:     <video>
Dec 05 15:28:42 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:28:42 user nova-compute[75080]:     </video>
Dec 05 15:28:42 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:28:42 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:28:42 user nova-compute[75080]:     </rng>
Dec 05 15:28:42 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:28:42 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:28:42 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:28:42 user nova-compute[75080]:     </memballoon>
Dec 05 15:28:42 user nova-compute[75080]:   </devices>
Dec 05 15:28:42 user nova-compute[75080]: </domain>
Dec 05 15:28:42 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:28:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-215552341',display_name='tempest-AttachVolumeTestJSON-server-215552341',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-215552341',id=28,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNR5WqP/N7bn4T+SXNEWvIjtaw5+s7Hk+R+FM8SRLh86FpF209SN9UyEjy0e1+2DKmJSUEmh664j9n8POCm+HUQ9EtbpXmMRPj40zHqJTQgREs+C9f2zqAuxq3d0+o2xbw==',key_name='tempest-keypair-1745876029',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a01b18b2a93b457c8e160447d44a673e',ramdisk_id='',reservation_id='r-oe6cj9ox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1911411330',owner_user_name='tempest-AttachVolumeTestJSON-1911411330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:28:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a02caebbfe541209b87adcbf848ede6',uuid=011d3446-577a-4f5c-b8f0-ef04940cad17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfee0a0e-5241-4d51-879d-7667bb06344b", "address": "fa:16:3e:be:d6:bd", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfee0a0e-52", "ovs_interfaceid": "dfee0a0e-5241-4d51-879d-7667bb06344b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Converting VIF {"id": "dfee0a0e-5241-4d51-879d-7667bb06344b", "address": "fa:16:3e:be:d6:bd", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfee0a0e-52", "ovs_interfaceid": "dfee0a0e-5241-4d51-879d-7667bb06344b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:d6:bd,bridge_name='br-int',has_traffic_filtering=True,id=dfee0a0e-5241-4d51-879d-7667bb06344b,network=Network(3037e443-f4eb-446e-8a80-53f409b02ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfee0a0e-52') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG os_vif [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:d6:bd,bridge_name='br-int',has_traffic_filtering=True,id=dfee0a0e-5241-4d51-879d-7667bb06344b,network=Network(3037e443-f4eb-446e-8a80-53f409b02ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfee0a0e-52') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c37e27ee-77ec-598d-b20d-199d1e8f87a2', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfee0a0e-52, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdfee0a0e-52, col_values=(('qos', UUID('edcfe03b-9ac9-44c4-bc58-a73ec84fe265')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdfee0a0e-52, col_values=(('external_ids', {'iface-id': 'dfee0a0e-5241-4d51-879d-7667bb06344b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:d6:bd', 'vm-uuid': '011d3446-577a-4f5c-b8f0-ef04940cad17'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:42 user nova-compute[75080]: INFO os_vif [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:d6:bd,bridge_name='br-int',has_traffic_filtering=True,id=dfee0a0e-5241-4d51-879d-7667bb06344b,network=Network(3037e443-f4eb-446e-8a80-53f409b02ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfee0a0e-52')
Dec 05 15:28:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] No VIF found with MAC fa:16:3e:be:d6:bd, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG nova.compute.manager [req-938a0d8b-34c1-4789-80b4-20e30f8d251d req-d8ed152f-d93f-46fe-85ef-530d26f9d987 service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] Received event network-vif-plugged-78547a5f-e10d-4a62-8d35-5584ce87d2c5 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-938a0d8b-34c1-4789-80b4-20e30f8d251d req-d8ed152f-d93f-46fe-85ef-530d26f9d987 service nova] Acquiring lock "412e1e40-082a-429e-9d35-013b72322761-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-938a0d8b-34c1-4789-80b4-20e30f8d251d req-d8ed152f-d93f-46fe-85ef-530d26f9d987 service nova] Lock "412e1e40-082a-429e-9d35-013b72322761-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-938a0d8b-34c1-4789-80b4-20e30f8d251d req-d8ed152f-d93f-46fe-85ef-530d26f9d987 service nova] Lock "412e1e40-082a-429e-9d35-013b72322761-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:28:42 user nova-compute[75080]: DEBUG nova.compute.manager [req-938a0d8b-34c1-4789-80b4-20e30f8d251d req-d8ed152f-d93f-46fe-85ef-530d26f9d987 service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] No waiting events found dispatching network-vif-plugged-78547a5f-e10d-4a62-8d35-5584ce87d2c5 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:28:42 user nova-compute[75080]: WARNING nova.compute.manager [req-938a0d8b-34c1-4789-80b4-20e30f8d251d req-d8ed152f-d93f-46fe-85ef-530d26f9d987 service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] Received unexpected event network-vif-plugged-78547a5f-e10d-4a62-8d35-5584ce87d2c5 for instance with vm_state resized and task_state resize_reverting.
Dec 05 15:28:43 user nova-compute[75080]: DEBUG nova.network.neutron [req-f2a6bee2-3461-4fb1-8d23-392cf39e523f req-3261cb92-f942-41a8-a304-6c7f94940f7a service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Updated VIF entry in instance network info cache for port dfee0a0e-5241-4d51-879d-7667bb06344b. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:28:43 user nova-compute[75080]: DEBUG nova.network.neutron [req-f2a6bee2-3461-4fb1-8d23-392cf39e523f req-3261cb92-f942-41a8-a304-6c7f94940f7a service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Updating instance_info_cache with network_info: [{"id": "dfee0a0e-5241-4d51-879d-7667bb06344b", "address": "fa:16:3e:be:d6:bd", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfee0a0e-52", "ovs_interfaceid": "dfee0a0e-5241-4d51-879d-7667bb06344b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:28:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f2a6bee2-3461-4fb1-8d23-392cf39e523f req-3261cb92-f942-41a8-a304-6c7f94940f7a service nova] Releasing lock "refresh_cache-011d3446-577a-4f5c-b8f0-ef04940cad17" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:28:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:44 user nova-compute[75080]: DEBUG nova.compute.manager [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:28:44 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 412e1e40-082a-429e-9d35-013b72322761] Instance running successfully.
Dec 05 15:28:44 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] finish_revert_migration finished successfully. {{(pid=75080) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11866}}
Dec 05 15:28:44 user nova-compute[75080]: INFO nova.compute.manager [None req-07a6fe57-6073-48af-af6e-5305e612f841 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Updating instance to original state: 'active'
Dec 05 15:28:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:44 user nova-compute[75080]: DEBUG nova.compute.manager [req-0928afcf-2eae-4707-82b9-4d1d48b2ecbd req-4a819d70-3ca1-4d9c-929f-ee6af4819344 service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] Received event network-vif-plugged-78547a5f-e10d-4a62-8d35-5584ce87d2c5 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:28:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0928afcf-2eae-4707-82b9-4d1d48b2ecbd req-4a819d70-3ca1-4d9c-929f-ee6af4819344 service nova] Acquiring lock "412e1e40-082a-429e-9d35-013b72322761-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:28:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0928afcf-2eae-4707-82b9-4d1d48b2ecbd req-4a819d70-3ca1-4d9c-929f-ee6af4819344 service nova] Lock "412e1e40-082a-429e-9d35-013b72322761-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:28:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0928afcf-2eae-4707-82b9-4d1d48b2ecbd req-4a819d70-3ca1-4d9c-929f-ee6af4819344 service nova] Lock "412e1e40-082a-429e-9d35-013b72322761-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:28:44 user nova-compute[75080]: DEBUG nova.compute.manager [req-0928afcf-2eae-4707-82b9-4d1d48b2ecbd req-4a819d70-3ca1-4d9c-929f-ee6af4819344 service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] No waiting events found dispatching network-vif-plugged-78547a5f-e10d-4a62-8d35-5584ce87d2c5 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:28:44 user nova-compute[75080]: WARNING nova.compute.manager [req-0928afcf-2eae-4707-82b9-4d1d48b2ecbd req-4a819d70-3ca1-4d9c-929f-ee6af4819344 service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] Received unexpected event network-vif-plugged-78547a5f-e10d-4a62-8d35-5584ce87d2c5 for instance with vm_state active and task_state None.
Dec 05 15:28:44 user nova-compute[75080]: DEBUG nova.compute.manager [req-0928afcf-2eae-4707-82b9-4d1d48b2ecbd req-4a819d70-3ca1-4d9c-929f-ee6af4819344 service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Received event network-vif-plugged-dfee0a0e-5241-4d51-879d-7667bb06344b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:28:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0928afcf-2eae-4707-82b9-4d1d48b2ecbd req-4a819d70-3ca1-4d9c-929f-ee6af4819344 service nova] Acquiring lock "011d3446-577a-4f5c-b8f0-ef04940cad17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:28:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0928afcf-2eae-4707-82b9-4d1d48b2ecbd req-4a819d70-3ca1-4d9c-929f-ee6af4819344 service nova] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:28:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0928afcf-2eae-4707-82b9-4d1d48b2ecbd req-4a819d70-3ca1-4d9c-929f-ee6af4819344 service nova] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:28:44 user nova-compute[75080]: DEBUG nova.compute.manager [req-0928afcf-2eae-4707-82b9-4d1d48b2ecbd req-4a819d70-3ca1-4d9c-929f-ee6af4819344 service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] No waiting events found dispatching network-vif-plugged-dfee0a0e-5241-4d51-879d-7667bb06344b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:28:44 user nova-compute[75080]: WARNING nova.compute.manager [req-0928afcf-2eae-4707-82b9-4d1d48b2ecbd req-4a819d70-3ca1-4d9c-929f-ee6af4819344 service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Received unexpected event network-vif-plugged-dfee0a0e-5241-4d51-879d-7667bb06344b for instance with vm_state building and task_state spawning.
Dec 05 15:28:44 user nova-compute[75080]: DEBUG nova.compute.manager [req-0928afcf-2eae-4707-82b9-4d1d48b2ecbd req-4a819d70-3ca1-4d9c-929f-ee6af4819344 service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Received event network-vif-plugged-dfee0a0e-5241-4d51-879d-7667bb06344b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:28:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0928afcf-2eae-4707-82b9-4d1d48b2ecbd req-4a819d70-3ca1-4d9c-929f-ee6af4819344 service nova] Acquiring lock "011d3446-577a-4f5c-b8f0-ef04940cad17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:28:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0928afcf-2eae-4707-82b9-4d1d48b2ecbd req-4a819d70-3ca1-4d9c-929f-ee6af4819344 service nova] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:28:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0928afcf-2eae-4707-82b9-4d1d48b2ecbd req-4a819d70-3ca1-4d9c-929f-ee6af4819344 service nova] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:28:44 user nova-compute[75080]: DEBUG nova.compute.manager [req-0928afcf-2eae-4707-82b9-4d1d48b2ecbd req-4a819d70-3ca1-4d9c-929f-ee6af4819344 service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] No waiting events found dispatching network-vif-plugged-dfee0a0e-5241-4d51-879d-7667bb06344b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:28:44 user nova-compute[75080]: WARNING nova.compute.manager [req-0928afcf-2eae-4707-82b9-4d1d48b2ecbd req-4a819d70-3ca1-4d9c-929f-ee6af4819344 service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Received unexpected event network-vif-plugged-dfee0a0e-5241-4d51-879d-7667bb06344b for instance with vm_state building and task_state spawning.
Dec 05 15:28:46 user nova-compute[75080]: DEBUG nova.compute.manager [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:28:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:28:46 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Instance spawned successfully.
Dec 05 15:28:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:28:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:28:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:28:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:28:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:28:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:28:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:28:46 user nova-compute[75080]: INFO nova.compute.manager [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Took 5.56 seconds to spawn the instance on the hypervisor.
Dec 05 15:28:46 user nova-compute[75080]: DEBUG nova.compute.manager [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:28:46 user nova-compute[75080]: INFO nova.compute.manager [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Took 6.26 seconds to build instance.
Dec 05 15:28:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b6a83756-9397-4821-ace3-733cda2bf508 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.353s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:28:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:28:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:21 user nova-compute[75080]: DEBUG nova.compute.manager [req-e5d23771-0d31-48b0-a4e0-a947b9499948 req-18fd29f6-edce-4602-8820-fb9849ac6523 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Received event network-changed-5b00d45c-4fed-41ce-b3c1-67d45830034b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:29:21 user nova-compute[75080]: DEBUG nova.compute.manager [req-e5d23771-0d31-48b0-a4e0-a947b9499948 req-18fd29f6-edce-4602-8820-fb9849ac6523 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Refreshing instance network info cache due to event network-changed-5b00d45c-4fed-41ce-b3c1-67d45830034b. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:29:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-e5d23771-0d31-48b0-a4e0-a947b9499948 req-18fd29f6-edce-4602-8820-fb9849ac6523 service nova] Acquiring lock "refresh_cache-06d40106-075c-4b29-bfc5-a0224ece1d45" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:29:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-e5d23771-0d31-48b0-a4e0-a947b9499948 req-18fd29f6-edce-4602-8820-fb9849ac6523 service nova] Acquired lock "refresh_cache-06d40106-075c-4b29-bfc5-a0224ece1d45" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:29:21 user nova-compute[75080]: DEBUG nova.network.neutron [req-e5d23771-0d31-48b0-a4e0-a947b9499948 req-18fd29f6-edce-4602-8820-fb9849ac6523 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Refreshing network info cache for port 5b00d45c-4fed-41ce-b3c1-67d45830034b {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:29:21 user nova-compute[75080]: INFO nova.compute.manager [None req-c5946e93-d126-4bf6-8cc4-8b078b2fbb50 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Unrescuing
Dec 05 15:29:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c5946e93-d126-4bf6-8cc4-8b078b2fbb50 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Acquiring lock "refresh_cache-60b8e21f-5fbd-4bc5-95ad-8d743ec796f7" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:29:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c5946e93-d126-4bf6-8cc4-8b078b2fbb50 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Acquired lock "refresh_cache-60b8e21f-5fbd-4bc5-95ad-8d743ec796f7" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:29:21 user nova-compute[75080]: DEBUG nova.network.neutron [None req-c5946e93-d126-4bf6-8cc4-8b078b2fbb50 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:29:21 user nova-compute[75080]: DEBUG nova.network.neutron [req-e5d23771-0d31-48b0-a4e0-a947b9499948 req-18fd29f6-edce-4602-8820-fb9849ac6523 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Updated VIF entry in instance network info cache for port 5b00d45c-4fed-41ce-b3c1-67d45830034b. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:29:21 user nova-compute[75080]: DEBUG nova.network.neutron [req-e5d23771-0d31-48b0-a4e0-a947b9499948 req-18fd29f6-edce-4602-8820-fb9849ac6523 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Updating instance_info_cache with network_info: [{"id": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "address": "fa:16:3e:e1:1a:b2", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b00d45c-4f", "ovs_interfaceid": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:29:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-e5d23771-0d31-48b0-a4e0-a947b9499948 req-18fd29f6-edce-4602-8820-fb9849ac6523 service nova] Releasing lock "refresh_cache-06d40106-075c-4b29-bfc5-a0224ece1d45" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:29:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:22 user nova-compute[75080]: DEBUG nova.network.neutron [None req-c5946e93-d126-4bf6-8cc4-8b078b2fbb50 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Updating instance_info_cache with network_info: [{"id": "6b187ba9-e311-4d40-8aa9-8f00feb45d88", "address": "fa:16:3e:3b:1f:ec", "network": {"id": "98270770-6a03-4b54-9160-a049184a508d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1275663774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecf8f0b6db8b4faeb2c3f5b580e05600", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b187ba9-e3", "ovs_interfaceid": "6b187ba9-e311-4d40-8aa9-8f00feb45d88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:29:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c5946e93-d126-4bf6-8cc4-8b078b2fbb50 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Releasing lock "refresh_cache-60b8e21f-5fbd-4bc5-95ad-8d743ec796f7" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:29:22 user nova-compute[75080]: DEBUG nova.objects.instance [None req-c5946e93-d126-4bf6-8cc4-8b078b2fbb50 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lazy-loading 'flavor' on Instance uuid 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:29:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:23 user nova-compute[75080]: DEBUG nova.compute.manager [req-75a224c1-587a-42cb-bcc1-d71acb02f011 req-31a88c88-2a67-4884-a86e-04183358d8de service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Received event network-changed-6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:29:23 user nova-compute[75080]: DEBUG nova.compute.manager [req-75a224c1-587a-42cb-bcc1-d71acb02f011 req-31a88c88-2a67-4884-a86e-04183358d8de service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Refreshing instance network info cache due to event network-changed-6b187ba9-e311-4d40-8aa9-8f00feb45d88. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:29:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-75a224c1-587a-42cb-bcc1-d71acb02f011 req-31a88c88-2a67-4884-a86e-04183358d8de service nova] Acquiring lock "refresh_cache-60b8e21f-5fbd-4bc5-95ad-8d743ec796f7" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:29:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-75a224c1-587a-42cb-bcc1-d71acb02f011 req-31a88c88-2a67-4884-a86e-04183358d8de service nova] Acquired lock "refresh_cache-60b8e21f-5fbd-4bc5-95ad-8d743ec796f7" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:29:23 user nova-compute[75080]: DEBUG nova.network.neutron [req-75a224c1-587a-42cb-bcc1-d71acb02f011 req-31a88c88-2a67-4884-a86e-04183358d8de service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Refreshing network info cache for port 6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:29:23 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Instance destroyed successfully.
Dec 05 15:29:23 user nova-compute[75080]: DEBUG nova.compute.manager [req-2e87aa4c-60e8-418b-ad7f-8e039dc9a15c req-ed745e42-ce08-41ad-9e41-3595a2121341 service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Received event network-vif-unplugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:29:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2e87aa4c-60e8-418b-ad7f-8e039dc9a15c req-ed745e42-ce08-41ad-9e41-3595a2121341 service nova] Acquiring lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:29:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2e87aa4c-60e8-418b-ad7f-8e039dc9a15c req-ed745e42-ce08-41ad-9e41-3595a2121341 service nova] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:29:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2e87aa4c-60e8-418b-ad7f-8e039dc9a15c req-ed745e42-ce08-41ad-9e41-3595a2121341 service nova] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:29:23 user nova-compute[75080]: DEBUG nova.compute.manager [req-2e87aa4c-60e8-418b-ad7f-8e039dc9a15c req-ed745e42-ce08-41ad-9e41-3595a2121341 service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] No waiting events found dispatching network-vif-unplugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:29:23 user nova-compute[75080]: WARNING nova.compute.manager [req-2e87aa4c-60e8-418b-ad7f-8e039dc9a15c req-ed745e42-ce08-41ad-9e41-3595a2121341 service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Received unexpected event network-vif-unplugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 for instance with vm_state rescued and task_state unrescuing.
Dec 05 15:29:23 user nova-compute[75080]: DEBUG nova.compute.manager [req-2e87aa4c-60e8-418b-ad7f-8e039dc9a15c req-ed745e42-ce08-41ad-9e41-3595a2121341 service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Received event network-vif-plugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:29:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2e87aa4c-60e8-418b-ad7f-8e039dc9a15c req-ed745e42-ce08-41ad-9e41-3595a2121341 service nova] Acquiring lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:29:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2e87aa4c-60e8-418b-ad7f-8e039dc9a15c req-ed745e42-ce08-41ad-9e41-3595a2121341 service nova] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:29:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2e87aa4c-60e8-418b-ad7f-8e039dc9a15c req-ed745e42-ce08-41ad-9e41-3595a2121341 service nova] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:29:23 user nova-compute[75080]: DEBUG nova.compute.manager [req-2e87aa4c-60e8-418b-ad7f-8e039dc9a15c req-ed745e42-ce08-41ad-9e41-3595a2121341 service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] No waiting events found dispatching network-vif-plugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:29:23 user nova-compute[75080]: WARNING nova.compute.manager [req-2e87aa4c-60e8-418b-ad7f-8e039dc9a15c req-ed745e42-ce08-41ad-9e41-3595a2121341 service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Received unexpected event network-vif-plugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 for instance with vm_state rescued and task_state unrescuing.
Dec 05 15:29:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:29:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:29:23 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:29:23 user nova-compute[75080]: DEBUG nova.network.neutron [req-75a224c1-587a-42cb-bcc1-d71acb02f011 req-31a88c88-2a67-4884-a86e-04183358d8de service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Updated VIF entry in instance network info cache for port 6b187ba9-e311-4d40-8aa9-8f00feb45d88. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:29:23 user nova-compute[75080]: DEBUG nova.network.neutron [req-75a224c1-587a-42cb-bcc1-d71acb02f011 req-31a88c88-2a67-4884-a86e-04183358d8de service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Updating instance_info_cache with network_info: [{"id": "6b187ba9-e311-4d40-8aa9-8f00feb45d88", "address": "fa:16:3e:3b:1f:ec", "network": {"id": "98270770-6a03-4b54-9160-a049184a508d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1275663774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecf8f0b6db8b4faeb2c3f5b580e05600", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b187ba9-e3", "ovs_interfaceid": "6b187ba9-e311-4d40-8aa9-8f00feb45d88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:29:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-75a224c1-587a-42cb-bcc1-d71acb02f011 req-31a88c88-2a67-4884-a86e-04183358d8de service nova] Releasing lock "refresh_cache-60b8e21f-5fbd-4bc5-95ad-8d743ec796f7" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:29:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:29:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:29:23 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:29:23 user nova-compute[75080]: INFO nova.compute.claims [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Claim successful on node user
Dec 05 15:29:24 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:29:24 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:29:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.403s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:29:24 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:29:24 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:29:24 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:29:24 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:29:24 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:29:24 user nova-compute[75080]: DEBUG nova.policy [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8e99cb2f1c4541fd9a656e038f4afac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f49255d5b74f448dc941027afbf84a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:29:24 user nova-compute[75080]: INFO nova.virt.block_device [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Booting with volume 48df39ad-d50b-473c-9675-9c68d4cd1dd5 at /dev/vda
Dec 05 15:29:24 user nova-compute[75080]: DEBUG os_brick.utils [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:29:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:24 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1be2e6a-c4f6-450f-8bea-ccbe6a18b1be]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:29:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:24 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9428020-a1bf-4e3f-bd00-c8e68d422677]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:29:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:24 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fc9502-7708-48b2-b6a0-de606dd16cc3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:29:24 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc7664f-b662-427b-8243-041d26a5136c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:29:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:29:24 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:29:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:29:24 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:29:24 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d65ce7-7623-4c5f-8783-8e6ad9dfdd1f]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:29:24 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:29:24 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:29:24 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:29:24 user nova-compute[75080]: DEBUG os_brick.utils [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:29:24 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Updating existing volume attachment record: 634ef7cf-b1bc-4396-8dcc-7bd9d5769049 {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:29:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:25 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Successfully created port: ae56b484-8712-4d95-aa9f-686b40d2619f {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:29:25 user nova-compute[75080]: DEBUG nova.compute.manager [req-8b250cda-8c26-4efe-a378-c90deaa46d07 req-9fc27c08-0e13-411a-b9fe-97fa3beb5e70 service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Received event network-changed-6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:29:25 user nova-compute[75080]: DEBUG nova.compute.manager [req-8b250cda-8c26-4efe-a378-c90deaa46d07 req-9fc27c08-0e13-411a-b9fe-97fa3beb5e70 service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Refreshing instance network info cache due to event network-changed-6b187ba9-e311-4d40-8aa9-8f00feb45d88. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:29:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8b250cda-8c26-4efe-a378-c90deaa46d07 req-9fc27c08-0e13-411a-b9fe-97fa3beb5e70 service nova] Acquiring lock "refresh_cache-60b8e21f-5fbd-4bc5-95ad-8d743ec796f7" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:29:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8b250cda-8c26-4efe-a378-c90deaa46d07 req-9fc27c08-0e13-411a-b9fe-97fa3beb5e70 service nova] Acquired lock "refresh_cache-60b8e21f-5fbd-4bc5-95ad-8d743ec796f7" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:29:25 user nova-compute[75080]: DEBUG nova.network.neutron [req-8b250cda-8c26-4efe-a378-c90deaa46d07 req-9fc27c08-0e13-411a-b9fe-97fa3beb5e70 service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Refreshing network info cache for port 6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:29:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0b418b98-3c0d-465d-a973-12b1c03a7faa tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "06d40106-075c-4b29-bfc5-a0224ece1d45" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:29:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0b418b98-3c0d-465d-a973-12b1c03a7faa tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "06d40106-075c-4b29-bfc5-a0224ece1d45" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:29:25 user nova-compute[75080]: INFO nova.compute.manager [None req-0b418b98-3c0d-465d-a973-12b1c03a7faa tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Shelving
Dec 05 15:29:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:25 user nova-compute[75080]: DEBUG nova.compute.manager [req-52c79ea1-9a65-4879-a96e-aa47993b893c req-b85b5c90-7864-4381-aed3-8b74bd089bed service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Received event network-vif-plugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:29:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-52c79ea1-9a65-4879-a96e-aa47993b893c req-b85b5c90-7864-4381-aed3-8b74bd089bed service nova] Acquiring lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:29:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-52c79ea1-9a65-4879-a96e-aa47993b893c req-b85b5c90-7864-4381-aed3-8b74bd089bed service nova] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:29:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-52c79ea1-9a65-4879-a96e-aa47993b893c req-b85b5c90-7864-4381-aed3-8b74bd089bed service nova] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:29:25 user nova-compute[75080]: DEBUG nova.compute.manager [req-52c79ea1-9a65-4879-a96e-aa47993b893c req-b85b5c90-7864-4381-aed3-8b74bd089bed service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] No waiting events found dispatching network-vif-plugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:29:25 user nova-compute[75080]: WARNING nova.compute.manager [req-52c79ea1-9a65-4879-a96e-aa47993b893c req-b85b5c90-7864-4381-aed3-8b74bd089bed service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Received unexpected event network-vif-plugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 for instance with vm_state rescued and task_state unrescuing.
Dec 05 15:29:25 user nova-compute[75080]: DEBUG nova.compute.manager [req-52c79ea1-9a65-4879-a96e-aa47993b893c req-b85b5c90-7864-4381-aed3-8b74bd089bed service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Received event network-vif-plugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:29:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-52c79ea1-9a65-4879-a96e-aa47993b893c req-b85b5c90-7864-4381-aed3-8b74bd089bed service nova] Acquiring lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:29:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-52c79ea1-9a65-4879-a96e-aa47993b893c req-b85b5c90-7864-4381-aed3-8b74bd089bed service nova] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:29:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-52c79ea1-9a65-4879-a96e-aa47993b893c req-b85b5c90-7864-4381-aed3-8b74bd089bed service nova] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:29:25 user nova-compute[75080]: DEBUG nova.compute.manager [req-52c79ea1-9a65-4879-a96e-aa47993b893c req-b85b5c90-7864-4381-aed3-8b74bd089bed service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] No waiting events found dispatching network-vif-plugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:29:25 user nova-compute[75080]: WARNING nova.compute.manager [req-52c79ea1-9a65-4879-a96e-aa47993b893c req-b85b5c90-7864-4381-aed3-8b74bd089bed service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Received unexpected event network-vif-plugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 for instance with vm_state rescued and task_state unrescuing.
Dec 05 15:29:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:25 user nova-compute[75080]: DEBUG nova.network.neutron [req-8b250cda-8c26-4efe-a378-c90deaa46d07 req-9fc27c08-0e13-411a-b9fe-97fa3beb5e70 service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Updated VIF entry in instance network info cache for port 6b187ba9-e311-4d40-8aa9-8f00feb45d88. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:29:25 user nova-compute[75080]: DEBUG nova.network.neutron [req-8b250cda-8c26-4efe-a378-c90deaa46d07 req-9fc27c08-0e13-411a-b9fe-97fa3beb5e70 service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Updating instance_info_cache with network_info: [{"id": "6b187ba9-e311-4d40-8aa9-8f00feb45d88", "address": "fa:16:3e:3b:1f:ec", "network": {"id": "98270770-6a03-4b54-9160-a049184a508d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1275663774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecf8f0b6db8b4faeb2c3f5b580e05600", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b187ba9-e3", "ovs_interfaceid": "6b187ba9-e311-4d40-8aa9-8f00feb45d88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:29:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8b250cda-8c26-4efe-a378-c90deaa46d07 req-9fc27c08-0e13-411a-b9fe-97fa3beb5e70 service nova] Releasing lock "refresh_cache-60b8e21f-5fbd-4bc5-95ad-8d743ec796f7" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:29:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:25 user nova-compute[75080]: DEBUG nova.compute.manager [req-02ad53e2-d29c-4adc-b258-4d740593f498 req-b6a67739-9ebd-4448-b946-0736ac7585ca service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Received event network-vif-unplugged-5b00d45c-4fed-41ce-b3c1-67d45830034b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:29:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-02ad53e2-d29c-4adc-b258-4d740593f498 req-b6a67739-9ebd-4448-b946-0736ac7585ca service nova] Acquiring lock "06d40106-075c-4b29-bfc5-a0224ece1d45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:29:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-02ad53e2-d29c-4adc-b258-4d740593f498 req-b6a67739-9ebd-4448-b946-0736ac7585ca service nova] Lock "06d40106-075c-4b29-bfc5-a0224ece1d45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:29:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-02ad53e2-d29c-4adc-b258-4d740593f498 req-b6a67739-9ebd-4448-b946-0736ac7585ca service nova] Lock "06d40106-075c-4b29-bfc5-a0224ece1d45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:29:25 user nova-compute[75080]: DEBUG nova.compute.manager [req-02ad53e2-d29c-4adc-b258-4d740593f498 req-b6a67739-9ebd-4448-b946-0736ac7585ca service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] No waiting events found dispatching network-vif-unplugged-5b00d45c-4fed-41ce-b3c1-67d45830034b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:29:25 user nova-compute[75080]: WARNING nova.compute.manager [req-02ad53e2-d29c-4adc-b258-4d740593f498 req-b6a67739-9ebd-4448-b946-0736ac7585ca service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Received unexpected event network-vif-unplugged-5b00d45c-4fed-41ce-b3c1-67d45830034b for instance with vm_state active and task_state shelving.
Dec 05 15:29:25 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Successfully updated port: ae56b484-8712-4d95-aa9f-686b40d2619f {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:29:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "refresh_cache-308f6ec7-d5c1-46bf-95a4-036e1c192f7f" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:29:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquired lock "refresh_cache-308f6ec7-d5c1-46bf-95a4-036e1c192f7f" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:29:26 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:29:26 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Instance destroyed successfully.
Dec 05 15:29:26 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:29:26 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-0b418b98-3c0d-465d-a973-12b1c03a7faa tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Beginning cold snapshot process
Dec 05 15:29:26 user nova-compute[75080]: DEBUG nova.privsep.utils [None req-0b418b98-3c0d-465d-a973-12b1c03a7faa tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75080) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 15:29:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-0b418b98-3c0d-465d-a973-12b1c03a7faa tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45/disk /opt/stack/data/nova/instances/snapshots/tmp1a_fi01n/40e8d328bb994918871f1d5550d46c57 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:26 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Updating instance_info_cache with network_info: [{"id": "ae56b484-8712-4d95-aa9f-686b40d2619f", "address": "fa:16:3e:28:be:b7", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae56b484-87", "ovs_interfaceid": "ae56b484-8712-4d95-aa9f-686b40d2619f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:29:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Releasing lock "refresh_cache-308f6ec7-d5c1-46bf-95a4-036e1c192f7f" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:29:26 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Instance network_info: |[{"id": "ae56b484-8712-4d95-aa9f-686b40d2619f", "address": "fa:16:3e:28:be:b7", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae56b484-87", "ovs_interfaceid": "ae56b484-8712-4d95-aa9f-686b40d2619f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:29:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-0b418b98-3c0d-465d-a973-12b1c03a7faa tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45/disk /opt/stack/data/nova/instances/snapshots/tmp1a_fi01n/40e8d328bb994918871f1d5550d46c57" returned: 0 in 0.529s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:26 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-0b418b98-3c0d-465d-a973-12b1c03a7faa tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Snapshot extracted, beginning image upload
Dec 05 15:29:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:27 user nova-compute[75080]: DEBUG nova.compute.manager [req-be771532-761b-49c3-8382-17f0ab481a95 req-1d50a93c-7fbe-4dc3-8cf4-d9f486192c55 service nova] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Received event network-changed-ae56b484-8712-4d95-aa9f-686b40d2619f {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:29:27 user nova-compute[75080]: DEBUG nova.compute.manager [req-be771532-761b-49c3-8382-17f0ab481a95 req-1d50a93c-7fbe-4dc3-8cf4-d9f486192c55 service nova] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Refreshing instance network info cache due to event network-changed-ae56b484-8712-4d95-aa9f-686b40d2619f. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:29:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-be771532-761b-49c3-8382-17f0ab481a95 req-1d50a93c-7fbe-4dc3-8cf4-d9f486192c55 service nova] Acquiring lock "refresh_cache-308f6ec7-d5c1-46bf-95a4-036e1c192f7f" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:29:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-be771532-761b-49c3-8382-17f0ab481a95 req-1d50a93c-7fbe-4dc3-8cf4-d9f486192c55 service nova] Acquired lock "refresh_cache-308f6ec7-d5c1-46bf-95a4-036e1c192f7f" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:29:27 user nova-compute[75080]: DEBUG nova.network.neutron [req-be771532-761b-49c3-8382-17f0ab481a95 req-1d50a93c-7fbe-4dc3-8cf4-d9f486192c55 service nova] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Refreshing network info cache for port ae56b484-8712-4d95-aa9f-686b40d2619f {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:29:27 user nova-compute[75080]: DEBUG nova.compute.manager [None req-c5946e93-d126-4bf6-8cc4-8b078b2fbb50 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:29:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:27 user nova-compute[75080]: DEBUG nova.compute.manager [req-f17b4254-bce9-4d28-8cd2-197fd74bf9b9 req-c0e54615-b148-4687-ac2d-d8bf8b27929d service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Received event network-vif-plugged-5b00d45c-4fed-41ce-b3c1-67d45830034b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:29:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f17b4254-bce9-4d28-8cd2-197fd74bf9b9 req-c0e54615-b148-4687-ac2d-d8bf8b27929d service nova] Acquiring lock "06d40106-075c-4b29-bfc5-a0224ece1d45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:29:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f17b4254-bce9-4d28-8cd2-197fd74bf9b9 req-c0e54615-b148-4687-ac2d-d8bf8b27929d service nova] Lock "06d40106-075c-4b29-bfc5-a0224ece1d45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:29:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f17b4254-bce9-4d28-8cd2-197fd74bf9b9 req-c0e54615-b148-4687-ac2d-d8bf8b27929d service nova] Lock "06d40106-075c-4b29-bfc5-a0224ece1d45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:29:27 user nova-compute[75080]: DEBUG nova.compute.manager [req-f17b4254-bce9-4d28-8cd2-197fd74bf9b9 req-c0e54615-b148-4687-ac2d-d8bf8b27929d service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] No waiting events found dispatching network-vif-plugged-5b00d45c-4fed-41ce-b3c1-67d45830034b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:29:27 user nova-compute[75080]: WARNING nova.compute.manager [req-f17b4254-bce9-4d28-8cd2-197fd74bf9b9 req-c0e54615-b148-4687-ac2d-d8bf8b27929d service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Received unexpected event network-vif-plugged-5b00d45c-4fed-41ce-b3c1-67d45830034b for instance with vm_state active and task_state shelving_image_uploading.
Dec 05 15:29:28 user nova-compute[75080]: DEBUG nova.network.neutron [req-be771532-761b-49c3-8382-17f0ab481a95 req-1d50a93c-7fbe-4dc3-8cf4-d9f486192c55 service nova] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Updated VIF entry in instance network info cache for port ae56b484-8712-4d95-aa9f-686b40d2619f. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:29:28 user nova-compute[75080]: DEBUG nova.network.neutron [req-be771532-761b-49c3-8382-17f0ab481a95 req-1d50a93c-7fbe-4dc3-8cf4-d9f486192c55 service nova] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Updating instance_info_cache with network_info: [{"id": "ae56b484-8712-4d95-aa9f-686b40d2619f", "address": "fa:16:3e:28:be:b7", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae56b484-87", "ovs_interfaceid": "ae56b484-8712-4d95-aa9f-686b40d2619f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:29:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-be771532-761b-49c3-8382-17f0ab481a95 req-1d50a93c-7fbe-4dc3-8cf4-d9f486192c55 service nova] Releasing lock "refresh_cache-308f6ec7-d5c1-46bf-95a4-036e1c192f7f" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:29:29 user nova-compute[75080]: INFO nova.compute.manager [None req-9bd0d57d-e4d4-47c8-9bbd-c7498ce4a22c tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Unrescuing
Dec 05 15:29:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9bd0d57d-e4d4-47c8-9bbd-c7498ce4a22c tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "refresh_cache-ab882db7-e6d7-44ca-9ea4-ae2fa68f7929" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:29:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9bd0d57d-e4d4-47c8-9bbd-c7498ce4a22c tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquired lock "refresh_cache-ab882db7-e6d7-44ca-9ea4-ae2fa68f7929" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:29:29 user nova-compute[75080]: DEBUG nova.network.neutron [None req-9bd0d57d-e4d4-47c8-9bbd-c7498ce4a22c tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:29:29 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-0b418b98-3c0d-465d-a973-12b1c03a7faa tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Snapshot image upload complete
Dec 05 15:29:29 user nova-compute[75080]: DEBUG nova.compute.manager [None req-0b418b98-3c0d-465d-a973-12b1c03a7faa tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:29:29 user nova-compute[75080]: INFO nova.compute.manager [None req-0b418b98-3c0d-465d-a973-12b1c03a7faa tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Shelve offloading
Dec 05 15:29:29 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Instance destroyed successfully.
Dec 05 15:29:29 user nova-compute[75080]: DEBUG nova.compute.manager [None req-0b418b98-3c0d-465d-a973-12b1c03a7faa tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:29:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0b418b98-3c0d-465d-a973-12b1c03a7faa tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "refresh_cache-06d40106-075c-4b29-bfc5-a0224ece1d45" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:29:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0b418b98-3c0d-465d-a973-12b1c03a7faa tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquired lock "refresh_cache-06d40106-075c-4b29-bfc5-a0224ece1d45" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:29:29 user nova-compute[75080]: DEBUG nova.network.neutron [None req-0b418b98-3c0d-465d-a973-12b1c03a7faa tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:29:29 user nova-compute[75080]: DEBUG nova.network.neutron [None req-9bd0d57d-e4d4-47c8-9bbd-c7498ce4a22c tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Updating instance_info_cache with network_info: [{"id": "af017697-07fb-4000-87d4-87f84dbd53bc", "address": "fa:16:3e:48:4c:fd", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf017697-07", "ovs_interfaceid": "af017697-07fb-4000-87d4-87f84dbd53bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:29:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9bd0d57d-e4d4-47c8-9bbd-c7498ce4a22c tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Releasing lock "refresh_cache-ab882db7-e6d7-44ca-9ea4-ae2fa68f7929" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:29:29 user nova-compute[75080]: DEBUG nova.objects.instance [None req-9bd0d57d-e4d4-47c8-9bbd-c7498ce4a22c tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lazy-loading 'flavor' on Instance uuid ab882db7-e6d7-44ca-9ea4-ae2fa68f7929 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:29:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:29 user nova-compute[75080]: DEBUG nova.network.neutron [None req-0b418b98-3c0d-465d-a973-12b1c03a7faa tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Updating instance_info_cache with network_info: [{"id": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "address": "fa:16:3e:e1:1a:b2", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b00d45c-4f", "ovs_interfaceid": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:29:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0b418b98-3c0d-465d-a973-12b1c03a7faa tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Releasing lock "refresh_cache-06d40106-075c-4b29-bfc5-a0224ece1d45" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:29:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:30 user nova-compute[75080]: DEBUG nova.compute.manager [req-cb8d84e7-0787-4d7a-9603-dc47c3b35359 req-6444e2dd-842f-46cb-87f2-d57e8d483e5d service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Received event network-vif-unplugged-af017697-07fb-4000-87d4-87f84dbd53bc {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:29:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-cb8d84e7-0787-4d7a-9603-dc47c3b35359 req-6444e2dd-842f-46cb-87f2-d57e8d483e5d service nova] Acquiring lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:29:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-cb8d84e7-0787-4d7a-9603-dc47c3b35359 req-6444e2dd-842f-46cb-87f2-d57e8d483e5d service nova] Lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:29:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-cb8d84e7-0787-4d7a-9603-dc47c3b35359 req-6444e2dd-842f-46cb-87f2-d57e8d483e5d service nova] Lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:29:30 user nova-compute[75080]: DEBUG nova.compute.manager [req-cb8d84e7-0787-4d7a-9603-dc47c3b35359 req-6444e2dd-842f-46cb-87f2-d57e8d483e5d service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] No waiting events found dispatching network-vif-unplugged-af017697-07fb-4000-87d4-87f84dbd53bc {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:29:30 user nova-compute[75080]: WARNING nova.compute.manager [req-cb8d84e7-0787-4d7a-9603-dc47c3b35359 req-6444e2dd-842f-46cb-87f2-d57e8d483e5d service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Received unexpected event network-vif-unplugged-af017697-07fb-4000-87d4-87f84dbd53bc for instance with vm_state rescued and task_state unrescuing.
Dec 05 15:29:30 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Instance destroyed successfully.
Dec 05 15:29:31 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Instance destroyed successfully.
Dec 05 15:29:31 user nova-compute[75080]: DEBUG nova.objects.instance [None req-0b418b98-3c0d-465d-a973-12b1c03a7faa tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lazy-loading 'resources' on Instance uuid 06d40106-075c-4b29-bfc5-a0224ece1d45 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:29:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-0b418b98-3c0d-465d-a973-12b1c03a7faa tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:27:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1271607709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1271607709',id=25,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGEyzTF/B823LkyDU5gfGCuteT4fw75ySbVBKx+2tT0hOUi9Rmtt937/xjcCneA2bSTThW3EBbFbXM26bm1fIZOeGSIiFiMwCwlEia7YhFfTC54hx2NA1hMW/7xxyngiLg==',key_name='tempest-keypair-755329848',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:27:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6350b8a7b0ce4af7b83a280c0c1ec3e6',ramdisk_id='',reservation_id='r-33v9h4hw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-132988477',owner_user_name='tempest-AttachVolumeShelveTestJSON-132988477-project-member',shelved_at='2023-12-05T15:29:29.315398',shelved_host='user',shelved_image_id='11a45eea-cbbd-445a-9496-c7f17946066a'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:29:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72a1c29faca44a4095dbda09561e5a91',uuid=06d40106-075c-4b29-bfc5-a0224ece1d45,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "address": "fa:16:3e:e1:1a:b2", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b00d45c-4f", "ovs_interfaceid": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:29:31 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-0b418b98-3c0d-465d-a973-12b1c03a7faa tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Converting VIF {"id": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "address": "fa:16:3e:e1:1a:b2", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b00d45c-4f", "ovs_interfaceid": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:29:31 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-0b418b98-3c0d-465d-a973-12b1c03a7faa tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1a:b2,bridge_name='br-int',has_traffic_filtering=True,id=5b00d45c-4fed-41ce-b3c1-67d45830034b,network=Network(b94a6985-25b3-480e-b79f-b753c8b23fa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b00d45c-4f') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:29:31 user nova-compute[75080]: DEBUG os_vif [None req-0b418b98-3c0d-465d-a973-12b1c03a7faa tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1a:b2,bridge_name='br-int',has_traffic_filtering=True,id=5b00d45c-4fed-41ce-b3c1-67d45830034b,network=Network(b94a6985-25b3-480e-b79f-b753c8b23fa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b00d45c-4f') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:29:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b00d45c-4f, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:29:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:29:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=25bb60fe-ec6c-4a1b-ad25-077f26c156d9) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:29:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:29:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:31 user nova-compute[75080]: INFO os_vif [None req-0b418b98-3c0d-465d-a973-12b1c03a7faa tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1a:b2,bridge_name='br-int',has_traffic_filtering=True,id=5b00d45c-4fed-41ce-b3c1-67d45830034b,network=Network(b94a6985-25b3-480e-b79f-b753c8b23fa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b00d45c-4f')
Dec 05 15:29:31 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-0b418b98-3c0d-465d-a973-12b1c03a7faa tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Deleting instance files /opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45_del
Dec 05 15:29:31 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-0b418b98-3c0d-465d-a973-12b1c03a7faa tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Deletion of /opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45_del complete
Dec 05 15:29:31 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-0b418b98-3c0d-465d-a973-12b1c03a7faa tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Deleted allocations for instance 06d40106-075c-4b29-bfc5-a0224ece1d45
Dec 05 15:29:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0b418b98-3c0d-465d-a973-12b1c03a7faa tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:29:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0b418b98-3c0d-465d-a973-12b1c03a7faa tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:29:31 user nova-compute[75080]: DEBUG nova.objects.instance [None req-0b418b98-3c0d-465d-a973-12b1c03a7faa tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lazy-loading 'numa_topology' on Instance uuid 06d40106-075c-4b29-bfc5-a0224ece1d45 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:29:31 user nova-compute[75080]: DEBUG nova.objects.base [None req-0b418b98-3c0d-465d-a973-12b1c03a7faa tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Object Instance<06d40106-075c-4b29-bfc5-a0224ece1d45> lazy-loaded attributes: resources,numa_topology {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:29:31 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:29:31 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:29:31 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-0b418b98-3c0d-465d-a973-12b1c03a7faa tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:29:31 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-0b418b98-3c0d-465d-a973-12b1c03a7faa tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:29:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0b418b98-3c0d-465d-a973-12b1c03a7faa tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:29:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0b418b98-3c0d-465d-a973-12b1c03a7faa tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "06d40106-075c-4b29-bfc5-a0224ece1d45" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.287s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:29:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:32 user nova-compute[75080]: DEBUG nova.compute.manager [req-741fea16-a65c-4cf3-89ac-fc2bd5ea907a req-430fd2de-e1d0-4ad5-ba47-b6d0ebf2de7a service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Received event network-vif-plugged-af017697-07fb-4000-87d4-87f84dbd53bc {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:29:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-741fea16-a65c-4cf3-89ac-fc2bd5ea907a req-430fd2de-e1d0-4ad5-ba47-b6d0ebf2de7a service nova] Acquiring lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:29:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-741fea16-a65c-4cf3-89ac-fc2bd5ea907a req-430fd2de-e1d0-4ad5-ba47-b6d0ebf2de7a service nova] Lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:29:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-741fea16-a65c-4cf3-89ac-fc2bd5ea907a req-430fd2de-e1d0-4ad5-ba47-b6d0ebf2de7a service nova] Lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:29:32 user nova-compute[75080]: DEBUG nova.compute.manager [req-741fea16-a65c-4cf3-89ac-fc2bd5ea907a req-430fd2de-e1d0-4ad5-ba47-b6d0ebf2de7a service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] No waiting events found dispatching network-vif-plugged-af017697-07fb-4000-87d4-87f84dbd53bc {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:29:32 user nova-compute[75080]: WARNING nova.compute.manager [req-741fea16-a65c-4cf3-89ac-fc2bd5ea907a req-430fd2de-e1d0-4ad5-ba47-b6d0ebf2de7a service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Received unexpected event network-vif-plugged-af017697-07fb-4000-87d4-87f84dbd53bc for instance with vm_state rescued and task_state unrescuing.
Dec 05 15:29:32 user nova-compute[75080]: DEBUG nova.compute.manager [req-741fea16-a65c-4cf3-89ac-fc2bd5ea907a req-430fd2de-e1d0-4ad5-ba47-b6d0ebf2de7a service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Received event network-vif-plugged-af017697-07fb-4000-87d4-87f84dbd53bc {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:29:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-741fea16-a65c-4cf3-89ac-fc2bd5ea907a req-430fd2de-e1d0-4ad5-ba47-b6d0ebf2de7a service nova] Acquiring lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:29:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-741fea16-a65c-4cf3-89ac-fc2bd5ea907a req-430fd2de-e1d0-4ad5-ba47-b6d0ebf2de7a service nova] Lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:29:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-741fea16-a65c-4cf3-89ac-fc2bd5ea907a req-430fd2de-e1d0-4ad5-ba47-b6d0ebf2de7a service nova] Lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:29:32 user nova-compute[75080]: DEBUG nova.compute.manager [req-741fea16-a65c-4cf3-89ac-fc2bd5ea907a req-430fd2de-e1d0-4ad5-ba47-b6d0ebf2de7a service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] No waiting events found dispatching network-vif-plugged-af017697-07fb-4000-87d4-87f84dbd53bc {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:29:32 user nova-compute[75080]: WARNING nova.compute.manager [req-741fea16-a65c-4cf3-89ac-fc2bd5ea907a req-430fd2de-e1d0-4ad5-ba47-b6d0ebf2de7a service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Received unexpected event network-vif-plugged-af017697-07fb-4000-87d4-87f84dbd53bc for instance with vm_state rescued and task_state unrescuing.
Dec 05 15:29:33 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:29:33 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:29:33 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:29:34 user nova-compute[75080]: DEBUG nova.compute.manager [req-798e3c92-a50e-435c-9fb6-c429bb8f1ea7 req-cba69309-35c8-4481-9e75-78fac3e4ab57 service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Received event network-vif-plugged-af017697-07fb-4000-87d4-87f84dbd53bc {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:29:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-798e3c92-a50e-435c-9fb6-c429bb8f1ea7 req-cba69309-35c8-4481-9e75-78fac3e4ab57 service nova] Acquiring lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:29:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-798e3c92-a50e-435c-9fb6-c429bb8f1ea7 req-cba69309-35c8-4481-9e75-78fac3e4ab57 service nova] Lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:29:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-798e3c92-a50e-435c-9fb6-c429bb8f1ea7 req-cba69309-35c8-4481-9e75-78fac3e4ab57 service nova] Lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:29:34 user nova-compute[75080]: DEBUG nova.compute.manager [req-798e3c92-a50e-435c-9fb6-c429bb8f1ea7 req-cba69309-35c8-4481-9e75-78fac3e4ab57 service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] No waiting events found dispatching network-vif-plugged-af017697-07fb-4000-87d4-87f84dbd53bc {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:29:34 user nova-compute[75080]: WARNING nova.compute.manager [req-798e3c92-a50e-435c-9fb6-c429bb8f1ea7 req-cba69309-35c8-4481-9e75-78fac3e4ab57 service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Received unexpected event network-vif-plugged-af017697-07fb-4000-87d4-87f84dbd53bc for instance with vm_state rescued and task_state unrescuing.
Dec 05 15:29:34 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:29:34 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:29:34 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Rebuilding the list of instances to heal {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 15:29:34 user nova-compute[75080]: DEBUG nova.compute.manager [None req-9bd0d57d-e4d4-47c8-9bbd-c7498ce4a22c tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:29:34 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Skipping network cache update for instance because it is Building. {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Dec 05 15:29:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-eedd1529-4feb-4f85-8625-0c20d8e0359d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:29:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-eedd1529-4feb-4f85-8625-0c20d8e0359d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:29:34 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 15:29:34 user nova-compute[75080]: DEBUG nova.objects.instance [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lazy-loading 'info_cache' on Instance uuid eedd1529-4feb-4f85-8625-0c20d8e0359d {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Acquiring lock "2ed540ae-41c0-4baf-bf69-52213850fb95" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "2ed540ae-41c0-4baf-bf69-52213850fb95" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG nova.objects.instance [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lazy-loading 'flavor' on Instance uuid 2ed540ae-41c0-4baf-bf69-52213850fb95 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "2ed540ae-41c0-4baf-bf69-52213850fb95" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:29:35 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Creating image(s)
Dec 05 15:29:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Did not create local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Ensure instance console log exists: /opt/stack/data/nova/instances/308f6ec7-d5c1-46bf-95a4-036e1c192f7f/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Start _get_guest_xml network_info=[{"id": "ae56b484-8712-4d95-aa9f-686b40d2619f", "address": "fa:16:3e:28:be:b7", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae56b484-87", "ovs_interfaceid": "ae56b484-8712-4d95-aa9f-686b40d2619f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qOpctbNu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '308f6ec7-d5c1-46bf-95a4-036e1c192f7f', 'attached_at': '', 'detached_at': '', 'volume_id': '48df39ad-d50b-473c-9675-9c68d4cd1dd5', 'serial': '48df39ad-d50b-473c-9675-9c68d4cd1dd5'}, 'device_type': 'disk', 'attachment_id': '634ef7cf-b1bc-4396-8dcc-7bd9d5769049', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:29:35 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:29:35 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:29:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qOpctbNu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:29:35 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:29:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:29:35 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:29:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:29:35 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Acquiring lock "2ed540ae-41c0-4baf-bf69-52213850fb95" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "2ed540ae-41c0-4baf-bf69-52213850fb95" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:29:35 user nova-compute[75080]: INFO nova.compute.manager [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Attaching volume 305261e7-5a42-44d7-9c8d-7c6e5750dfea to /dev/vdb
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd29df3c-664d-496f-8799-fee6b979f24e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:29:35 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Updating instance_info_cache with network_info: [{"id": "f0094ba7-45c2-445b-bd35-d5c7aedd68bd", "address": "fa:16:3e:f9:84:93", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0094ba7-45", "ovs_interfaceid": "f0094ba7-45c2-445b-bd35-d5c7aedd68bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-eedd1529-4feb-4f85-8625-0c20d8e0359d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[64373da5-59e6-4ac0-ac44-4f05d48ac6c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5] added
Dec 05 15:29:35 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94255f8-3682-434d-ab68-e78ba09a7333]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG os_brick.utils [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8714ebe-38ef-4c2c-aeef-3afeb52e2cec]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qOpctbNu {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9386f7-57f5-418e-b3eb-6fbc8e73dcaf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qOpctbNu" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a284ed7-7478-4f5a-9587-3f2383941860]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qOpctbNu'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[75459372-2707-4d68-84b2-ea6a2578e151]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[97041a48-5136-410b-acf7-141388afd678]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[daed68ce-7df0-4e55-98af-d074aa86e72b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ecc94d2-e66e-49cf-a335-a76d7989104a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f959c0-fc2f-4e98-b47a-8189a108a737]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:29:35 user nova-compute[75080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)
Dec 05 15:29:35 user nova-compute[75080]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:29:35 user nova-compute[75080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:29:35 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:29:35 user nova-compute[75080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)
Dec 05 15:29:35 user nova-compute[75080]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:29:35 user nova-compute[75080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:29:35 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:29:35 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c285c626-97bf-410b-a48b-efbf1603af53]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG os_brick.utils [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Updating existing volume attachment record: f1a58122-31cc-4e29-8d58-08f83694dd83 {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c756527d-fee3-4bfb-bdeb-0d4c926e9a26]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5, portal: 172.16.0.220,3260]
Dec 05 15:29:35 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5, portal: 172.16.0.220,3260] successful.
Dec 05 15:29:35 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2634f2-2b17-47eb-86d1-34b7755b9dc3]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[26943a07-6c75-495d-9983-1ed55fabf3c5]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:29:35 user nova-compute[75080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)
Dec 05 15:29:35 user nova-compute[75080]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:29:35 user nova-compute[75080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:29:35 user nova-compute[75080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:29:35 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:29:35 user nova-compute[75080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)
Dec 05 15:29:35 user nova-compute[75080]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:29:35 user nova-compute[75080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:29:35 user nova-compute[75080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:29:35 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.388s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6201bc5-4931-47d3-b5d1-bad8ee5c6929]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qOpctbNu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:29:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG nova.compute.manager [req-57f2c2e9-0688-452c-96dc-358bd1ee3192 req-a827015e-d374-40c9-819a-b55afb93e5e0 service nova] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Received event network-changed-322cb506-f3d1-49d4-956b-9cef1c9325cd {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG nova.compute.manager [req-57f2c2e9-0688-452c-96dc-358bd1ee3192 req-a827015e-d374-40c9-819a-b55afb93e5e0 service nova] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Refreshing instance network info cache due to event network-changed-322cb506-f3d1-49d4-956b-9cef1c9325cd. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-57f2c2e9-0688-452c-96dc-358bd1ee3192 req-a827015e-d374-40c9-819a-b55afb93e5e0 service nova] Acquiring lock "refresh_cache-2ed540ae-41c0-4baf-bf69-52213850fb95" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-57f2c2e9-0688-452c-96dc-358bd1ee3192 req-a827015e-d374-40c9-819a-b55afb93e5e0 service nova] Acquired lock "refresh_cache-2ed540ae-41c0-4baf-bf69-52213850fb95" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG nova.network.neutron [req-57f2c2e9-0688-452c-96dc-358bd1ee3192 req-a827015e-d374-40c9-819a-b55afb93e5e0 service nova] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Refreshing network info cache for port 322cb506-f3d1-49d4-956b-9cef1c9325cd {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.429s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] <== connect_volume: return (1431ms) {'type': 'block', 'scsi_wwn': '23137623435623765', 'path': '/dev/sde'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137623435623765', 'path': '/dev/sde'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed540ae-41c0-4baf-bf69-52213850fb95/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG nova.network.neutron [req-57f2c2e9-0688-452c-96dc-358bd1ee3192 req-a827015e-d374-40c9-819a-b55afb93e5e0 service nova] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Updated VIF entry in instance network info cache for port 322cb506-f3d1-49d4-956b-9cef1c9325cd. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG nova.network.neutron [req-57f2c2e9-0688-452c-96dc-358bd1ee3192 req-a827015e-d374-40c9-819a-b55afb93e5e0 service nova] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Updating instance_info_cache with network_info: [{"id": "322cb506-f3d1-49d4-956b-9cef1c9325cd", "address": "fa:16:3e:53:0c:12", "network": {"id": "60895755-a5e0-4195-ace1-7627829ca044", "bridge": "br-int", "label": "tempest-TestStampPattern-2093692741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc899a7995f64588957e55ca0129c812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap322cb506-f3", "ovs_interfaceid": "322cb506-f3d1-49d4-956b-9cef1c9325cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:29:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-77885476',display_name='tempest-ServerActionsTestOtherA-server-77885476',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-77885476',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIP5nbHwDP3MaLimasQ81bdHfaI0CFiTpw2YpAxQTZDkv+5y7AL53TfAVsSe07r4BvGkQeGQdB4lyczKq+WcllL3mLq5dj12AlRuMlnnGy3kUrnJXEIK2cec4EX/PelNSA==',key_name='tempest-keypair-1219993291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50f49255d5b74f448dc941027afbf84a',ramdisk_id='',reservation_id='r-ui3j1gwe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-393209338',owner_user_name='tempest-ServerActionsTestOtherA-393209338-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:29:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e99cb2f1c4541fd9a656e038f4afac3',uuid=308f6ec7-d5c1-46bf-95a4-036e1c192f7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae56b484-8712-4d95-aa9f-686b40d2619f", "address": "fa:16:3e:28:be:b7", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae56b484-87", "ovs_interfaceid": "ae56b484-8712-4d95-aa9f-686b40d2619f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Converting VIF {"id": "ae56b484-8712-4d95-aa9f-686b40d2619f", "address": "fa:16:3e:28:be:b7", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae56b484-87", "ovs_interfaceid": "ae56b484-8712-4d95-aa9f-686b40d2619f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:be:b7,bridge_name='br-int',has_traffic_filtering=True,id=ae56b484-8712-4d95-aa9f-686b40d2619f,network=Network(efba4a7e-3a56-41d2-8af7-4c064ba641fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae56b484-87') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG nova.objects.instance [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lazy-loading 'pci_devices' on Instance uuid 308f6ec7-d5c1-46bf-95a4-036e1c192f7f {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-57f2c2e9-0688-452c-96dc-358bd1ee3192 req-a827015e-d374-40c9-819a-b55afb93e5e0 service nova] Releasing lock "refresh_cache-2ed540ae-41c0-4baf-bf69-52213850fb95" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:29:36 user nova-compute[75080]:   <uuid>308f6ec7-d5c1-46bf-95a4-036e1c192f7f</uuid>
Dec 05 15:29:36 user nova-compute[75080]:   <name>instance-0000001d</name>
Dec 05 15:29:36 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:29:36 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:29:36 user nova-compute[75080]:   <metadata>
Dec 05 15:29:36 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:29:36 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:29:36 user nova-compute[75080]:       <nova:name>tempest-ServerActionsTestOtherA-server-77885476</nova:name>
Dec 05 15:29:36 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:29:35</nova:creationTime>
Dec 05 15:29:36 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:29:36 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:29:36 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:29:36 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:29:36 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:29:36 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:29:36 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:29:36 user nova-compute[75080]:       <nova:owner>
Dec 05 15:29:36 user nova-compute[75080]:         <nova:user uuid="8e99cb2f1c4541fd9a656e038f4afac3">tempest-ServerActionsTestOtherA-393209338-project-member</nova:user>
Dec 05 15:29:36 user nova-compute[75080]:         <nova:project uuid="50f49255d5b74f448dc941027afbf84a">tempest-ServerActionsTestOtherA-393209338</nova:project>
Dec 05 15:29:36 user nova-compute[75080]:       </nova:owner>
Dec 05 15:29:36 user nova-compute[75080]:       <nova:ports>
Dec 05 15:29:36 user nova-compute[75080]:         <nova:port uuid="ae56b484-8712-4d95-aa9f-686b40d2619f">
Dec 05 15:29:36 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 05 15:29:36 user nova-compute[75080]:         </nova:port>
Dec 05 15:29:36 user nova-compute[75080]:       </nova:ports>
Dec 05 15:29:36 user nova-compute[75080]:     </nova:instance>
Dec 05 15:29:36 user nova-compute[75080]:   </metadata>
Dec 05 15:29:36 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:29:36 user nova-compute[75080]:     <system>
Dec 05 15:29:36 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:29:36 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:29:36 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:29:36 user nova-compute[75080]:       <entry name="serial">308f6ec7-d5c1-46bf-95a4-036e1c192f7f</entry>
Dec 05 15:29:36 user nova-compute[75080]:       <entry name="uuid">308f6ec7-d5c1-46bf-95a4-036e1c192f7f</entry>
Dec 05 15:29:36 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:29:36 user nova-compute[75080]:     </system>
Dec 05 15:29:36 user nova-compute[75080]:   </sysinfo>
Dec 05 15:29:36 user nova-compute[75080]:   <os>
Dec 05 15:29:36 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:29:36 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:29:36 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:29:36 user nova-compute[75080]:   </os>
Dec 05 15:29:36 user nova-compute[75080]:   <features>
Dec 05 15:29:36 user nova-compute[75080]:     <acpi/>
Dec 05 15:29:36 user nova-compute[75080]:     <apic/>
Dec 05 15:29:36 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:29:36 user nova-compute[75080]:   </features>
Dec 05 15:29:36 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:29:36 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:29:36 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:29:36 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:29:36 user nova-compute[75080]:   </clock>
Dec 05 15:29:36 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:29:36 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:29:36 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:29:36 user nova-compute[75080]:   </cpu>
Dec 05 15:29:36 user nova-compute[75080]:   <devices>
Dec 05 15:29:36 user nova-compute[75080]:     <disk type="block" device="disk">
Dec 05 15:29:36 user nova-compute[75080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:29:36 user nova-compute[75080]:       <source dev="/dev/sde"/>
Dec 05 15:29:36 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:29:36 user nova-compute[75080]:       <serial>48df39ad-d50b-473c-9675-9c68d4cd1dd5</serial>
Dec 05 15:29:36 user nova-compute[75080]:     </disk>
Dec 05 15:29:36 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:29:36 user nova-compute[75080]:       <mac address="fa:16:3e:28:be:b7"/>
Dec 05 15:29:36 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:29:36 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:29:36 user nova-compute[75080]:       <target dev="tapae56b484-87"/>
Dec 05 15:29:36 user nova-compute[75080]:     </interface>
Dec 05 15:29:36 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:29:36 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/308f6ec7-d5c1-46bf-95a4-036e1c192f7f/console.log" append="off"/>
Dec 05 15:29:36 user nova-compute[75080]:     </serial>
Dec 05 15:29:36 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:29:36 user nova-compute[75080]:     <video>
Dec 05 15:29:36 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:29:36 user nova-compute[75080]:     </video>
Dec 05 15:29:36 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:29:36 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:29:36 user nova-compute[75080]:     </rng>
Dec 05 15:29:36 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:29:36 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:29:36 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:29:36 user nova-compute[75080]:     </memballoon>
Dec 05 15:29:36 user nova-compute[75080]:   </devices>
Dec 05 15:29:36 user nova-compute[75080]: </domain>
Dec 05 15:29:36 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:29:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-77885476',display_name='tempest-ServerActionsTestOtherA-server-77885476',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-77885476',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIP5nbHwDP3MaLimasQ81bdHfaI0CFiTpw2YpAxQTZDkv+5y7AL53TfAVsSe07r4BvGkQeGQdB4lyczKq+WcllL3mLq5dj12AlRuMlnnGy3kUrnJXEIK2cec4EX/PelNSA==',key_name='tempest-keypair-1219993291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50f49255d5b74f448dc941027afbf84a',ramdisk_id='',reservation_id='r-ui3j1gwe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-393209338',owner_user_name='tempest-ServerActionsTestOtherA-393209338-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:29:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e99cb2f1c4541fd9a656e038f4afac3',uuid=308f6ec7-d5c1-46bf-95a4-036e1c192f7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae56b484-8712-4d95-aa9f-686b40d2619f", "address": "fa:16:3e:28:be:b7", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae56b484-87", "ovs_interfaceid": "ae56b484-8712-4d95-aa9f-686b40d2619f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Converting VIF {"id": "ae56b484-8712-4d95-aa9f-686b40d2619f", "address": "fa:16:3e:28:be:b7", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae56b484-87", "ovs_interfaceid": "ae56b484-8712-4d95-aa9f-686b40d2619f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:be:b7,bridge_name='br-int',has_traffic_filtering=True,id=ae56b484-8712-4d95-aa9f-686b40d2619f,network=Network(efba4a7e-3a56-41d2-8af7-4c064ba641fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae56b484-87') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG os_vif [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:be:b7,bridge_name='br-int',has_traffic_filtering=True,id=ae56b484-8712-4d95-aa9f-686b40d2619f,network=Network(efba4a7e-3a56-41d2-8af7-4c064ba641fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae56b484-87') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1cf64c90-a8d6-5891-a611-ec0bbf55bdc0', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae56b484-87, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapae56b484-87, col_values=(('qos', UUID('6437d963-4172-421b-aca2-10a0bba4986a')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapae56b484-87, col_values=(('external_ids', {'iface-id': 'ae56b484-8712-4d95-aa9f-686b40d2619f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:be:b7', 'vm-uuid': '308f6ec7-d5c1-46bf-95a4-036e1c192f7f'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:36 user nova-compute[75080]: INFO os_vif [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:be:b7,bridge_name='br-int',has_traffic_filtering=True,id=ae56b484-8712-4d95-aa9f-686b40d2619f,network=Network(efba4a7e-3a56-41d2-8af7-4c064ba641fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae56b484-87')
Dec 05 15:29:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] No VIF found with MAC fa:16:3e:28:be:b7, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed540ae-41c0-4baf-bf69-52213850fb95/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed540ae-41c0-4baf-bf69-52213850fb95/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed540ae-41c0-4baf-bf69-52213850fb95/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:38 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:29:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:40 user nova-compute[75080]: DEBUG nova.compute.manager [req-90593eb5-964c-445e-8d3e-069084434c74 req-ac57d410-6f5f-4133-b878-6491eb18df9a service nova] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Received event network-vif-plugged-ae56b484-8712-4d95-aa9f-686b40d2619f {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:29:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-90593eb5-964c-445e-8d3e-069084434c74 req-ac57d410-6f5f-4133-b878-6491eb18df9a service nova] Acquiring lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:29:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-90593eb5-964c-445e-8d3e-069084434c74 req-ac57d410-6f5f-4133-b878-6491eb18df9a service nova] Lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:29:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-90593eb5-964c-445e-8d3e-069084434c74 req-ac57d410-6f5f-4133-b878-6491eb18df9a service nova] Lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:29:40 user nova-compute[75080]: DEBUG nova.compute.manager [req-90593eb5-964c-445e-8d3e-069084434c74 req-ac57d410-6f5f-4133-b878-6491eb18df9a service nova] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] No waiting events found dispatching network-vif-plugged-ae56b484-8712-4d95-aa9f-686b40d2619f {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:29:40 user nova-compute[75080]: WARNING nova.compute.manager [req-90593eb5-964c-445e-8d3e-069084434c74 req-ac57d410-6f5f-4133-b878-6491eb18df9a service nova] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Received unexpected event network-vif-plugged-ae56b484-8712-4d95-aa9f-686b40d2619f for instance with vm_state building and task_state spawning.
Dec 05 15:29:40 user nova-compute[75080]: DEBUG nova.compute.manager [req-d11cf5d0-9a14-48bf-b274-fce514fdf28e req-d9d35ccb-fa74-4c6d-b067-0ceacfb6ddca service nova] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Received event network-vif-plugged-ae56b484-8712-4d95-aa9f-686b40d2619f {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:29:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d11cf5d0-9a14-48bf-b274-fce514fdf28e req-d9d35ccb-fa74-4c6d-b067-0ceacfb6ddca service nova] Acquiring lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:29:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d11cf5d0-9a14-48bf-b274-fce514fdf28e req-d9d35ccb-fa74-4c6d-b067-0ceacfb6ddca service nova] Lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:29:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d11cf5d0-9a14-48bf-b274-fce514fdf28e req-d9d35ccb-fa74-4c6d-b067-0ceacfb6ddca service nova] Lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:29:40 user nova-compute[75080]: DEBUG nova.compute.manager [req-d11cf5d0-9a14-48bf-b274-fce514fdf28e req-d9d35ccb-fa74-4c6d-b067-0ceacfb6ddca service nova] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] No waiting events found dispatching network-vif-plugged-ae56b484-8712-4d95-aa9f-686b40d2619f {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:29:40 user nova-compute[75080]: WARNING nova.compute.manager [req-d11cf5d0-9a14-48bf-b274-fce514fdf28e req-d9d35ccb-fa74-4c6d-b067-0ceacfb6ddca service nova] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Received unexpected event network-vif-plugged-ae56b484-8712-4d95-aa9f-686b40d2619f for instance with vm_state building and task_state spawning.
Dec 05 15:29:40 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:29:40 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:29:40 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:29:40 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:29:40 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=7709MB free_disk=24.89488983154297GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:29:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:29:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:29:40 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Instance spawned successfully.
Dec 05 15:29:40 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:29:40 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:29:40 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:29:40 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:29:40 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:29:40 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:29:40 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:29:40 user nova-compute[75080]: INFO nova.compute.manager [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Took 5.67 seconds to spawn the instance on the hypervisor.
Dec 05 15:29:40 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:29:40 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance eedd1529-4feb-4f85-8625-0c20d8e0359d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:29:40 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 07b025ff-4a9d-48a2-b950-b8f2d165f33c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:29:40 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:29:40 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance c9836958-96d4-4b3e-a45c-fbb97846dbd4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:29:40 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance ab882db7-e6d7-44ca-9ea4-ae2fa68f7929 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:29:40 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 412e1e40-082a-429e-9d35-013b72322761 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:29:40 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 2ed540ae-41c0-4baf-bf69-52213850fb95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:29:40 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 729c6c3a-9959-42dd-b698-949ad0d571f8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:29:40 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 011d3446-577a-4f5c-b8f0-ef04940cad17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:29:40 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 308f6ec7-d5c1-46bf-95a4-036e1c192f7f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:29:40 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:29:40 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:29:40 user nova-compute[75080]: INFO nova.compute.manager [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Took 17.20 seconds to build instance.
Dec 05 15:29:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e3c2d976-9c26-43cc-bd87-590274c436de tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.370s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:29:41 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:29:41 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:29:41 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:29:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.505s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:29:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:43 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:29:43 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:29:43 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GCVlMiDu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:29:45 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:29:45 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:29:45 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:29:45 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:29:45 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:29:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e1010c-7adb-4b79-a9dc-cf08c69f0202]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:29:45 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b857d92-0272-4487-a1cf-f6d71b7b4d5d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea] added
Dec 05 15:29:45 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0637fa-2e04-46b2-8802-87a62bcaa6ab]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3685c7-0ab7-443b-ab49-023ed30885f2]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GCVlMiDu {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GCVlMiDu" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfc50d5-63a6-45d0-93ed-b8267dcc53d5]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GCVlMiDu'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb6a72c-27bd-4103-abb1-82db82224835]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b9a9bf-8011-489f-b999-0f21d5fba635]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:29:45 user nova-compute[75080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)
Dec 05 15:29:45 user nova-compute[75080]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:29:45 user nova-compute[75080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:29:45 user nova-compute[75080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:29:45 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:29:45 user nova-compute[75080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)
Dec 05 15:29:45 user nova-compute[75080]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:29:45 user nova-compute[75080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:29:45 user nova-compute[75080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:29:45 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07437f1-d90b-466c-9f25-fdac1795661c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea, portal: 172.16.0.220,3260]
Dec 05 15:29:45 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea, portal: 172.16.0.220,3260] successful.
Dec 05 15:29:45 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c221bd-a901-4624-86e7-1450ffe0cbe4]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1f3847-2302-4095-9927-041b0e50901c]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:29:45 user nova-compute[75080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)
Dec 05 15:29:45 user nova-compute[75080]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:29:45 user nova-compute[75080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:29:45 user nova-compute[75080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:29:45 user nova-compute[75080]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea (non-flash)
Dec 05 15:29:45 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:29:45 user nova-compute[75080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)
Dec 05 15:29:45 user nova-compute[75080]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:29:45 user nova-compute[75080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:29:45 user nova-compute[75080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:29:45 user nova-compute[75080]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea (non-flash)
Dec 05 15:29:45 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] HCTL ('37', '-', '-', 0) found on session 33 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0768e0d2-7950-4c00-b3f1-1701510343f4]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Searching for a device in session 33 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:29:45 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GCVlMiDu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:29:46 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:29:46 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23338633061643561', 'path': '/dev/sdf'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:29:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338633061643561', 'path': '/dev/sdf'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:29:46 user nova-compute[75080]: DEBUG nova.objects.instance [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lazy-loading 'flavor' on Instance uuid 2ed540ae-41c0-4baf-bf69-52213850fb95 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:29:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 15:29:46 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:29:46 user nova-compute[75080]:   <source dev="/dev/sdf"/>
Dec 05 15:29:46 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:29:46 user nova-compute[75080]:   <serial>305261e7-5a42-44d7-9c8d-7c6e5750dfea</serial>
Dec 05 15:29:46 user nova-compute[75080]: </disk>
Dec 05 15:29:46 user nova-compute[75080]:  {{(pid=75080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 15:29:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:47 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:29:47 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:29:47 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] No VIF found with MAC fa:16:3e:53:0c:12, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:29:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f430b987-7099-4e5b-897a-7c701ef0d18e tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "2ed540ae-41c0-4baf-bf69-52213850fb95" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.085s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:29:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f5b86211-120a-464f-ae79-38c49937a462 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Acquiring lock "2ed540ae-41c0-4baf-bf69-52213850fb95" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:29:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f5b86211-120a-464f-ae79-38c49937a462 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "2ed540ae-41c0-4baf-bf69-52213850fb95" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:29:49 user nova-compute[75080]: INFO nova.compute.manager [None req-f5b86211-120a-464f-ae79-38c49937a462 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Detaching volume 305261e7-5a42-44d7-9c8d-7c6e5750dfea
Dec 05 15:29:49 user nova-compute[75080]: INFO nova.virt.block_device [None req-f5b86211-120a-464f-ae79-38c49937a462 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Attempting to driver detach volume 305261e7-5a42-44d7-9c8d-7c6e5750dfea from mountpoint /dev/vdb
Dec 05 15:29:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-f5b86211-120a-464f-ae79-38c49937a462 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Attempting to detach device vdb from instance 2ed540ae-41c0-4baf-bf69-52213850fb95 from the persistent domain config. {{(pid=75080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 15:29:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-f5b86211-120a-464f-ae79-38c49937a462 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:29:49 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:29:49 user nova-compute[75080]:   <source dev="/dev/sdf"/>
Dec 05 15:29:49 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:29:49 user nova-compute[75080]:   <serial>305261e7-5a42-44d7-9c8d-7c6e5750dfea</serial>
Dec 05 15:29:49 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 15:29:49 user nova-compute[75080]: </disk>
Dec 05 15:29:49 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:29:49 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-f5b86211-120a-464f-ae79-38c49937a462 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Successfully detached device vdb from instance 2ed540ae-41c0-4baf-bf69-52213850fb95 from the persistent domain config.
Dec 05 15:29:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-f5b86211-120a-464f-ae79-38c49937a462 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2ed540ae-41c0-4baf-bf69-52213850fb95 from the live domain config. {{(pid=75080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 15:29:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-f5b86211-120a-464f-ae79-38c49937a462 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:29:49 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:29:49 user nova-compute[75080]:   <source dev="/dev/sdf"/>
Dec 05 15:29:49 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:29:49 user nova-compute[75080]:   <serial>305261e7-5a42-44d7-9c8d-7c6e5750dfea</serial>
Dec 05 15:29:49 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 15:29:49 user nova-compute[75080]: </disk>
Dec 05 15:29:49 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:29:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-f5b86211-120a-464f-ae79-38c49937a462 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2ed540ae-41c0-4baf-bf69-52213850fb95 {{(pid=75080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 15:29:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-488d8365-bb67-47ff-86fa-c21ddb097862 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Acquiring lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:29:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-488d8365-bb67-47ff-86fa-c21ddb097862 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:29:55 user nova-compute[75080]: INFO nova.compute.manager [None req-488d8365-bb67-47ff-86fa-c21ddb097862 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Detaching volume d99fb99a-13b8-4dd8-a129-b0c0e68e9960
Dec 05 15:29:55 user nova-compute[75080]: INFO nova.virt.block_device [None req-488d8365-bb67-47ff-86fa-c21ddb097862 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Attempting to driver detach volume d99fb99a-13b8-4dd8-a129-b0c0e68e9960 from mountpoint /dev/vdb
Dec 05 15:29:55 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-488d8365-bb67-47ff-86fa-c21ddb097862 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Attempting to detach device vdb from instance 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7 from the persistent domain config. {{(pid=75080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 15:29:55 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-488d8365-bb67-47ff-86fa-c21ddb097862 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:29:55 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:29:55 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 15:29:55 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:29:55 user nova-compute[75080]:   <serial>d99fb99a-13b8-4dd8-a129-b0c0e68e9960</serial>
Dec 05 15:29:55 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 15:29:55 user nova-compute[75080]: </disk>
Dec 05 15:29:55 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:29:55 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-488d8365-bb67-47ff-86fa-c21ddb097862 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Successfully detached device vdb from instance 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7 from the persistent domain config.
Dec 05 15:29:55 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-488d8365-bb67-47ff-86fa-c21ddb097862 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7 from the live domain config. {{(pid=75080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 15:29:55 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-488d8365-bb67-47ff-86fa-c21ddb097862 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:29:55 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:29:55 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 15:29:55 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:29:55 user nova-compute[75080]:   <serial>d99fb99a-13b8-4dd8-a129-b0c0e68e9960</serial>
Dec 05 15:29:55 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 15:29:55 user nova-compute[75080]: </disk>
Dec 05 15:29:55 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:29:55 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-488d8365-bb67-47ff-86fa-c21ddb097862 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7 {{(pid=75080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 15:29:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:29:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:01 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:03 user nova-compute[75080]: DEBUG nova.compute.manager [req-2643cea4-7520-40a1-ad29-b0ac81be15ad req-2b243de7-d677-4614-acd9-f06288198769 service nova] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Received event network-changed-a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:30:03 user nova-compute[75080]: DEBUG nova.compute.manager [req-2643cea4-7520-40a1-ad29-b0ac81be15ad req-2b243de7-d677-4614-acd9-f06288198769 service nova] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Refreshing instance network info cache due to event network-changed-a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:30:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2643cea4-7520-40a1-ad29-b0ac81be15ad req-2b243de7-d677-4614-acd9-f06288198769 service nova] Acquiring lock "refresh_cache-729c6c3a-9959-42dd-b698-949ad0d571f8" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:30:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2643cea4-7520-40a1-ad29-b0ac81be15ad req-2b243de7-d677-4614-acd9-f06288198769 service nova] Acquired lock "refresh_cache-729c6c3a-9959-42dd-b698-949ad0d571f8" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:30:03 user nova-compute[75080]: DEBUG nova.network.neutron [req-2643cea4-7520-40a1-ad29-b0ac81be15ad req-2b243de7-d677-4614-acd9-f06288198769 service nova] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Refreshing network info cache for port a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:30:04 user nova-compute[75080]: DEBUG nova.network.neutron [req-2643cea4-7520-40a1-ad29-b0ac81be15ad req-2b243de7-d677-4614-acd9-f06288198769 service nova] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Updated VIF entry in instance network info cache for port a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:30:04 user nova-compute[75080]: DEBUG nova.network.neutron [req-2643cea4-7520-40a1-ad29-b0ac81be15ad req-2b243de7-d677-4614-acd9-f06288198769 service nova] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Updating instance_info_cache with network_info: [{"id": "a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b", "address": "fa:16:3e:cd:64:15", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0bb5ab6-1e", "ovs_interfaceid": "a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:30:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2643cea4-7520-40a1-ad29-b0ac81be15ad req-2b243de7-d677-4614-acd9-f06288198769 service nova] Releasing lock "refresh_cache-729c6c3a-9959-42dd-b698-949ad0d571f8" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:30:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "729c6c3a-9959-42dd-b698-949ad0d571f8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:30:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "729c6c3a-9959-42dd-b698-949ad0d571f8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:30:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "729c6c3a-9959-42dd-b698-949ad0d571f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:30:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "729c6c3a-9959-42dd-b698-949ad0d571f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:30:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "729c6c3a-9959-42dd-b698-949ad0d571f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:30:04 user nova-compute[75080]: INFO nova.compute.manager [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Terminating instance
Dec 05 15:30:04 user nova-compute[75080]: DEBUG nova.compute.manager [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:30:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG nova.compute.manager [req-1b2e7eae-ca3e-4cfa-b0a5-02b59b0c9e76 req-109cb34e-98b3-4df7-9485-ea55d07330d7 service nova] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Received event network-vif-unplugged-a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-1b2e7eae-ca3e-4cfa-b0a5-02b59b0c9e76 req-109cb34e-98b3-4df7-9485-ea55d07330d7 service nova] Acquiring lock "729c6c3a-9959-42dd-b698-949ad0d571f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-1b2e7eae-ca3e-4cfa-b0a5-02b59b0c9e76 req-109cb34e-98b3-4df7-9485-ea55d07330d7 service nova] Lock "729c6c3a-9959-42dd-b698-949ad0d571f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-1b2e7eae-ca3e-4cfa-b0a5-02b59b0c9e76 req-109cb34e-98b3-4df7-9485-ea55d07330d7 service nova] Lock "729c6c3a-9959-42dd-b698-949ad0d571f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG nova.compute.manager [req-1b2e7eae-ca3e-4cfa-b0a5-02b59b0c9e76 req-109cb34e-98b3-4df7-9485-ea55d07330d7 service nova] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] No waiting events found dispatching network-vif-unplugged-a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG nova.compute.manager [req-1b2e7eae-ca3e-4cfa-b0a5-02b59b0c9e76 req-109cb34e-98b3-4df7-9485-ea55d07330d7 service nova] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Received event network-vif-unplugged-a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:05 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Instance destroyed successfully.
Dec 05 15:30:05 user nova-compute[75080]: DEBUG nova.objects.instance [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lazy-loading 'resources' on Instance uuid 729c6c3a-9959-42dd-b698-949ad0d571f8 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:28:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-999285683',display_name='tempest-TestVolumeBootPattern-server-999285683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-999285683',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbodyAsCj/LsLD4+fqj081LHmxK6h/6lXtC6JTYG6GWTlsJ9L34SglBGh22zHQ6DhZ8jkeGO+vsFyUrlKxX0aNv4V7kDdiXAt2Ew2tgqS8jk69Jg7JlqDhZvfUPpLsuMg==',key_name='tempest-TestVolumeBootPattern-1935536975',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:28:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11227acd507347ae9c5a3bc710707f84',ramdisk_id='',reservation_id='r-z1nvqdp8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-23416231',owner_user_name='tempest-TestVolumeBootPattern-23416231-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:28:28Z,user_data=None,user_id='15be5b54cc8346bb86683e4ed2fbba9e',uuid=729c6c3a-9959-42dd-b698-949ad0d571f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b", "address": "fa:16:3e:cd:64:15", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0bb5ab6-1e", "ovs_interfaceid": "a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Converting VIF {"id": "a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b", "address": "fa:16:3e:cd:64:15", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0bb5ab6-1e", "ovs_interfaceid": "a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:64:15,bridge_name='br-int',has_traffic_filtering=True,id=a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0bb5ab6-1e') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG os_vif [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:64:15,bridge_name='br-int',has_traffic_filtering=True,id=a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0bb5ab6-1e') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0bb5ab6-1e, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e7bbd81b-304f-4e90-97e1-7f97d980f39e) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:05 user nova-compute[75080]: INFO os_vif [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:64:15,bridge_name='br-int',has_traffic_filtering=True,id=a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0bb5ab6-1e')
Dec 05 15:30:05 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UuagHdeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:30:05 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:30:05 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4b4193-3e1d-4d5b-8d78-8144d10028ed]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:30:05 user nova-compute[75080]: No targets found.
Dec 05 15:30:05 user nova-compute[75080]: iSNS:
Dec 05 15:30:05 user nova-compute[75080]: No targets found.
Dec 05 15:30:05 user nova-compute[75080]: STATIC:
Dec 05 15:30:05 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5
Dec 05 15:30:05 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:30:05 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:30:05 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399
Dec 05 15:30:05 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:30:05 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:30:05 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960
Dec 05 15:30:05 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:30:05 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:30:05 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea
Dec 05 15:30:05 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:30:05 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:30:05 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b
Dec 05 15:30:05 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:30:05 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:30:05 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb
Dec 05 15:30:05 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:30:05 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:30:05 user nova-compute[75080]: FIRMWARE:
Dec 05 15:30:05 user nova-compute[75080]: No targets found.
Dec 05 15:30:05 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:30:05 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:30:05 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[623ade1a-9e89-46dd-acbf-71556b66f362]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb85d9c-fcaa-4a10-9773-4361e72e36c0]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:30:05 user nova-compute[75080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)
Dec 05 15:30:05 user nova-compute[75080]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:30:05 user nova-compute[75080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:30:05 user nova-compute[75080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:30:05 user nova-compute[75080]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea (non-flash)
Dec 05 15:30:05 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:30:05 user nova-compute[75080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)
Dec 05 15:30:05 user nova-compute[75080]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:30:05 user nova-compute[75080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:30:05 user nova-compute[75080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:30:05 user nova-compute[75080]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea (non-flash)
Dec 05 15:30:05 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f66384aa9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b'): ({'sdd'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Removing single pathed devices sdd {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3484b93a-8cef-4a6a-9bd3-d911c99e68ce]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e372b891-1c42-4e42-8fb8-afe9a6ac89d7]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Flushing IO for device /dev/sdd {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d24754-5dd9-42cf-b3ef-eec168a605a1]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bde683-6708-4d1f-9967-1fa6ed4e1660]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] SCSI volumes sdd have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23339616232633030', '/dev/disk/by-id/scsi-1SCST_BIO53c2a5cc-39ab2c000818e902', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_53c2a5cc') {{(pid=86242) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e323e84-c95a-4c06-8091-8f3093fb514d]: (4, None) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4a4d8c-1a20-4a03-961c-3a1f557f1bbb]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4075ea3b-03aa-43b4-9108-860f5ac99940]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b, portal: 172.16.0.220,3260]
Dec 05 15:30:05 user nova-compute[75080]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b, portal: 172.16.0.220,3260] successful.
Dec 05 15:30:05 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[05211144-0d64-4be5-9cac-34cc6e3b31df]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] <== disconnect_volume: return (369ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:30:05 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Deleting instance files /opt/stack/data/nova/instances/729c6c3a-9959-42dd-b698-949ad0d571f8_del
Dec 05 15:30:05 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Deletion of /opt/stack/data/nova/instances/729c6c3a-9959-42dd-b698-949ad0d571f8_del complete
Dec 05 15:30:05 user nova-compute[75080]: INFO nova.compute.manager [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Took 1.33 seconds to destroy the instance on the hypervisor.
Dec 05 15:30:05 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:30:05 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:30:06 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:30:06 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Took 0.67 seconds to deallocate network for instance.
Dec 05 15:30:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-a0c33017-41f1-464c-bed0-fe4b98d1537f req-f34c6e01-32d6-4162-ab9e-95bfccf713cc service nova] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Received event network-vif-plugged-a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:30:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a0c33017-41f1-464c-bed0-fe4b98d1537f req-f34c6e01-32d6-4162-ab9e-95bfccf713cc service nova] Acquiring lock "729c6c3a-9959-42dd-b698-949ad0d571f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:30:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a0c33017-41f1-464c-bed0-fe4b98d1537f req-f34c6e01-32d6-4162-ab9e-95bfccf713cc service nova] Lock "729c6c3a-9959-42dd-b698-949ad0d571f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:30:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a0c33017-41f1-464c-bed0-fe4b98d1537f req-f34c6e01-32d6-4162-ab9e-95bfccf713cc service nova] Lock "729c6c3a-9959-42dd-b698-949ad0d571f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:30:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-a0c33017-41f1-464c-bed0-fe4b98d1537f req-f34c6e01-32d6-4162-ab9e-95bfccf713cc service nova] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] No waiting events found dispatching network-vif-plugged-a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:30:07 user nova-compute[75080]: WARNING nova.compute.manager [req-a0c33017-41f1-464c-bed0-fe4b98d1537f req-f34c6e01-32d6-4162-ab9e-95bfccf713cc service nova] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Received unexpected event network-vif-plugged-a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b for instance with vm_state active and task_state deleting.
Dec 05 15:30:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-a0c33017-41f1-464c-bed0-fe4b98d1537f req-f34c6e01-32d6-4162-ab9e-95bfccf713cc service nova] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Received event network-vif-deleted-a0bb5ab6-1e44-4553-906f-fbeac0aa2d3b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:30:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:07 user nova-compute[75080]: INFO nova.compute.manager [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 729c6c3a-9959-42dd-b698-949ad0d571f8] Took 0.79 seconds to detach 1 volumes for instance.
Dec 05 15:30:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:30:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:30:07 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:30:07 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:30:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.312s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:30:07 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Deleted allocations for instance 729c6c3a-9959-42dd-b698-949ad0d571f8
Dec 05 15:30:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-47c3433c-fb33-4f27-8a1d-9ecdea9b661d tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "729c6c3a-9959-42dd-b698-949ad0d571f8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.291s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:30:09 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-f5b86211-120a-464f-ae79-38c49937a462 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2ed540ae-41c0-4baf-bf69-52213850fb95 is timed out.
Dec 05 15:30:09 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-f5b86211-120a-464f-ae79-38c49937a462 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Successfully detached device vdb from instance 2ed540ae-41c0-4baf-bf69-52213850fb95 from the live domain config.
Dec 05 15:30:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5b86211-120a-464f-ae79-38c49937a462 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:30:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b86211-120a-464f-ae79-38c49937a462 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GCVlMiDu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:30:09 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-f5b86211-120a-464f-ae79-38c49937a462 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:30:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-f5b86211-120a-464f-ae79-38c49937a462 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:30:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-f5b86211-120a-464f-ae79-38c49937a462 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:30:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:09 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa32f82d-13b5-43b1-b732-11678ef2e8f0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b86211-120a-464f-ae79-38c49937a462 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:30:09 user nova-compute[75080]: No targets found.
Dec 05 15:30:09 user nova-compute[75080]: iSNS:
Dec 05 15:30:09 user nova-compute[75080]: No targets found.
Dec 05 15:30:09 user nova-compute[75080]: STATIC:
Dec 05 15:30:09 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5
Dec 05 15:30:09 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:30:09 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:30:09 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399
Dec 05 15:30:09 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:30:09 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:30:09 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960
Dec 05 15:30:09 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:30:09 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:30:09 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea
Dec 05 15:30:09 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:30:09 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:30:09 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb
Dec 05 15:30:09 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:30:09 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:30:09 user nova-compute[75080]: FIRMWARE:
Dec 05 15:30:09 user nova-compute[75080]: No targets found.
Dec 05 15:30:09 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:30:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b86211-120a-464f-ae79-38c49937a462 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:30:09 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:30:09 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:30:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b86211-120a-464f-ae79-38c49937a462 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:30:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:09 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97c77c4-e01c-4cd6-8fad-e548be40d86b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:09 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf1d952-cf39-4c7b-ba09-a0e1c0f1d158]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b86211-120a-464f-ae79-38c49937a462 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:30:09 user nova-compute[75080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)
Dec 05 15:30:09 user nova-compute[75080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:30:09 user nova-compute[75080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:30:09 user nova-compute[75080]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea (non-flash)
Dec 05 15:30:09 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:30:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b86211-120a-464f-ae79-38c49937a462 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:30:09 user nova-compute[75080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)
Dec 05 15:30:09 user nova-compute[75080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:30:09 user nova-compute[75080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:30:09 user nova-compute[75080]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea (non-flash)
Dec 05 15:30:09 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:30:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b86211-120a-464f-ae79-38c49937a462 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f66384ba5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea'): ({'sdf'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:30:09 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-f5b86211-120a-464f-ae79-38c49937a462 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Removing single pathed devices sdf {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:30:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[446a4756-6eb9-4fa9-b33f-e900ffffa1cd]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f439e6d9-a9ab-4df9-8670-14033b353807]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:10 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-f5b86211-120a-464f-ae79-38c49937a462 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Flushing IO for device /dev/sdf {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:30:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1c4d21-0000-463e-9f5e-3f9787b2542c]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:10 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-f5b86211-120a-464f-ae79-38c49937a462 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:30:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.039s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[67caa947-8c22-444c-99c0-546a3eaff688]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:10 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-f5b86211-120a-464f-ae79-38c49937a462 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:30:10 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-f5b86211-120a-464f-ae79-38c49937a462 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] SCSI volumes sdf have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:30:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b86211-120a-464f-ae79-38c49937a462 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:30:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f72b400-d117-49e1-8ebc-61e5f110973f]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b86211-120a-464f-ae79-38c49937a462 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:30:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d738b2b8-c7ab-49b9-992c-25e1a1e579ed]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b86211-120a-464f-ae79-38c49937a462 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea, portal: 172.16.0.220,3260]
Dec 05 15:30:10 user nova-compute[75080]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea, portal: 172.16.0.220,3260] successful.
Dec 05 15:30:10 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:30:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:305261e7-5a42-44d7-9c8d-7c6e5750dfea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5c1888-516c-4110-95f3-6f9305401209]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b86211-120a-464f-ae79-38c49937a462 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:30:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-f5b86211-120a-464f-ae79-38c49937a462 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:30:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b86211-120a-464f-ae79-38c49937a462 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] <== disconnect_volume: return (317ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:30:10 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5b86211-120a-464f-ae79-38c49937a462 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:30:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:10 user nova-compute[75080]: DEBUG nova.objects.instance [None req-f5b86211-120a-464f-ae79-38c49937a462 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lazy-loading 'flavor' on Instance uuid 2ed540ae-41c0-4baf-bf69-52213850fb95 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:30:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f5b86211-120a-464f-ae79-38c49937a462 tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "2ed540ae-41c0-4baf-bf69-52213850fb95" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.657s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:30:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:15 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-488d8365-bb67-47ff-86fa-c21ddb097862 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7 is timed out.
Dec 05 15:30:15 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-488d8365-bb67-47ff-86fa-c21ddb097862 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Successfully detached device vdb from instance 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7 from the live domain config.
Dec 05 15:30:15 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-488d8365-bb67-47ff-86fa-c21ddb097862 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-488d8365-bb67-47ff-86fa-c21ddb097862 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KesDLzjB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:30:15 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-488d8365-bb67-47ff-86fa-c21ddb097862 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:30:15 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-488d8365-bb67-47ff-86fa-c21ddb097862 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-488d8365-bb67-47ff-86fa-c21ddb097862 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7be32a-1e8c-42c0-8884-80bc3da61a25]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-488d8365-bb67-47ff-86fa-c21ddb097862 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:30:15 user nova-compute[75080]: No targets found.
Dec 05 15:30:15 user nova-compute[75080]: iSNS:
Dec 05 15:30:15 user nova-compute[75080]: No targets found.
Dec 05 15:30:15 user nova-compute[75080]: STATIC:
Dec 05 15:30:15 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5
Dec 05 15:30:15 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:30:15 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:30:15 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399
Dec 05 15:30:15 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:30:15 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:30:15 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960
Dec 05 15:30:15 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:30:15 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:30:15 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb
Dec 05 15:30:15 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:30:15 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:30:15 user nova-compute[75080]: FIRMWARE:
Dec 05 15:30:15 user nova-compute[75080]: No targets found.
Dec 05 15:30:15 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-488d8365-bb67-47ff-86fa-c21ddb097862 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:30:15 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:30:15 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-488d8365-bb67-47ff-86fa-c21ddb097862 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[826af3d1-c531-4fcf-a7c2-608e77178f7d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8697c46c-2278-46c3-87de-c4d1d8885c8f]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-488d8365-bb67-47ff-86fa-c21ddb097862 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:30:15 user nova-compute[75080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)
Dec 05 15:30:15 user nova-compute[75080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:30:15 user nova-compute[75080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:30:15 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-488d8365-bb67-47ff-86fa-c21ddb097862 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:30:15 user nova-compute[75080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 (non-flash)
Dec 05 15:30:15 user nova-compute[75080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:30:15 user nova-compute[75080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:30:15 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-488d8365-bb67-47ff-86fa-c21ddb097862 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f665c4323b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960'): ({'sdb'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-488d8365-bb67-47ff-86fa-c21ddb097862 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Removing single pathed devices sdb {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c232c424-175b-41a9-b2c3-c7ee4f0d0690]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e56f9a6-b7f8-4906-80fc-7591cb2f2b12]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-488d8365-bb67-47ff-86fa-c21ddb097862 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Flushing IO for device /dev/sdb {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.064s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7c85a3-8a63-4d6d-bc3a-6ea5a4df6af4]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-488d8365-bb67-47ff-86fa-c21ddb097862 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a98536-1508-45f7-a3e8-079ff756ca64]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-488d8365-bb67-47ff-86fa-c21ddb097862 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-488d8365-bb67-47ff-86fa-c21ddb097862 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-488d8365-bb67-47ff-86fa-c21ddb097862 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9275b77a-9639-42ee-a1f1-6cb2c991959f]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-488d8365-bb67-47ff-86fa-c21ddb097862 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb589a80-48a8-4494-b8a7-d489b4644d22]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-488d8365-bb67-47ff-86fa-c21ddb097862 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960, portal: 172.16.0.220,3260]
Dec 05 15:30:15 user nova-compute[75080]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960, portal: 172.16.0.220,3260] successful.
Dec 05 15:30:15 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:30:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d99fb99a-13b8-4dd8-a129-b0c0e68e9960 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:16 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fa1722-20c3-4475-9a6c-462eef7ac221]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-488d8365-bb67-47ff-86fa-c21ddb097862 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:30:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-488d8365-bb67-47ff-86fa-c21ddb097862 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:30:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-488d8365-bb67-47ff-86fa-c21ddb097862 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] <== disconnect_volume: return (368ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:30:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-488d8365-bb67-47ff-86fa-c21ddb097862 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:30:16 user nova-compute[75080]: DEBUG nova.objects.instance [None req-488d8365-bb67-47ff-86fa-c21ddb097862 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lazy-loading 'flavor' on Instance uuid 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:30:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-488d8365-bb67-47ff-86fa-c21ddb097862 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.722s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:30:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:30:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:30:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 15:30:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:30:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:30:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:30:31 user nova-compute[75080]: DEBUG nova.compute.manager [req-c45e3145-f59c-4818-9a7b-418587489f18 req-7f7006e8-6a9e-4cbd-b140-88362e575f5b service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Received event network-changed-dfee0a0e-5241-4d51-879d-7667bb06344b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:30:31 user nova-compute[75080]: DEBUG nova.compute.manager [req-c45e3145-f59c-4818-9a7b-418587489f18 req-7f7006e8-6a9e-4cbd-b140-88362e575f5b service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Refreshing instance network info cache due to event network-changed-dfee0a0e-5241-4d51-879d-7667bb06344b. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:30:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c45e3145-f59c-4818-9a7b-418587489f18 req-7f7006e8-6a9e-4cbd-b140-88362e575f5b service nova] Acquiring lock "refresh_cache-011d3446-577a-4f5c-b8f0-ef04940cad17" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:30:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c45e3145-f59c-4818-9a7b-418587489f18 req-7f7006e8-6a9e-4cbd-b140-88362e575f5b service nova] Acquired lock "refresh_cache-011d3446-577a-4f5c-b8f0-ef04940cad17" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:30:31 user nova-compute[75080]: DEBUG nova.network.neutron [req-c45e3145-f59c-4818-9a7b-418587489f18 req-7f7006e8-6a9e-4cbd-b140-88362e575f5b service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Refreshing network info cache for port dfee0a0e-5241-4d51-879d-7667bb06344b {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:30:31 user nova-compute[75080]: DEBUG nova.network.neutron [req-c45e3145-f59c-4818-9a7b-418587489f18 req-7f7006e8-6a9e-4cbd-b140-88362e575f5b service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Updated VIF entry in instance network info cache for port dfee0a0e-5241-4d51-879d-7667bb06344b. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:30:31 user nova-compute[75080]: DEBUG nova.network.neutron [req-c45e3145-f59c-4818-9a7b-418587489f18 req-7f7006e8-6a9e-4cbd-b140-88362e575f5b service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Updating instance_info_cache with network_info: [{"id": "dfee0a0e-5241-4d51-879d-7667bb06344b", "address": "fa:16:3e:be:d6:bd", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfee0a0e-52", "ovs_interfaceid": "dfee0a0e-5241-4d51-879d-7667bb06344b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:30:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c45e3145-f59c-4818-9a7b-418587489f18 req-7f7006e8-6a9e-4cbd-b140-88362e575f5b service nova] Releasing lock "refresh_cache-011d3446-577a-4f5c-b8f0-ef04940cad17" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:30:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:33 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:30:33 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:30:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "011d3446-577a-4f5c-b8f0-ef04940cad17" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:30:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:30:34 user nova-compute[75080]: DEBUG nova.objects.instance [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lazy-loading 'flavor' on Instance uuid 011d3446-577a-4f5c-b8f0-ef04940cad17 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:30:34 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:30:34 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:30:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:30:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "011d3446-577a-4f5c-b8f0-ef04940cad17" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:30:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:30:34 user nova-compute[75080]: INFO nova.compute.manager [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Attaching volume 37794663-c414-4d76-8796-5c6c60f5efb0 to /dev/vdb
Dec 05 15:30:34 user nova-compute[75080]: DEBUG os_brick.utils [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:30:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:34 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abdf9bf-c6e0-4fa0-81f0-7cdbf2c03488]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:34 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e9d06b-66e5-49b8-bf69-039c1edfc593]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:34 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a70fac-7b29-4c55-b0a1-aaca54b394d3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:34 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a683ad9-5276-4ae6-ad4f-506d799e6e89]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:30:34 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:30:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:34 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:30:34 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:30:34 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ddd535-c1f9-4fe5-ac3e-38e718c0dffa]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:34 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:30:34 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:30:34 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:30:34 user nova-compute[75080]: DEBUG os_brick.utils [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:30:34 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Updating existing volume attachment record: 07c9514d-71b6-4fc7-977e-efc713dfcfde {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:30:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:35 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:30:35 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:30:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-412e1e40-082a-429e-9d35-013b72322761" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:30:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-412e1e40-082a-429e-9d35-013b72322761" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:30:35 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 412e1e40-082a-429e-9d35-013b72322761] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 15:30:35 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 412e1e40-082a-429e-9d35-013b72322761] Updating instance_info_cache with network_info: [{"id": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "address": "fa:16:3e:ab:04:37", "network": {"id": "3f7b7f16-6cc0-45b9-9f9c-efd112a71092", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-47517680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00d040579ca46338e01b8110a0ebc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78547a5f-e1", "ovs_interfaceid": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:30:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-412e1e40-082a-429e-9d35-013b72322761" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:30:35 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 412e1e40-082a-429e-9d35-013b72322761] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 15:30:35 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:30:35 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:30:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:30:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:30:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:30:35 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:30:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:30:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:30:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed540ae-41c0-4baf-bf69-52213850fb95/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed540ae-41c0-4baf-bf69-52213850fb95/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed540ae-41c0-4baf-bf69-52213850fb95/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed540ae-41c0-4baf-bf69-52213850fb95/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:38 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:30:39 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:30:39 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:30:39 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=7844MB free_disk=24.892250061035156GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:30:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:30:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:30:39 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance eedd1529-4feb-4f85-8625-0c20d8e0359d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:30:39 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 07b025ff-4a9d-48a2-b950-b8f2d165f33c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:30:39 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:30:39 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance c9836958-96d4-4b3e-a45c-fbb97846dbd4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:30:39 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance ab882db7-e6d7-44ca-9ea4-ae2fa68f7929 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:30:39 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 412e1e40-082a-429e-9d35-013b72322761 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:30:39 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 2ed540ae-41c0-4baf-bf69-52213850fb95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:30:39 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 011d3446-577a-4f5c-b8f0-ef04940cad17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:30:39 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 308f6ec7-d5c1-46bf-95a4-036e1c192f7f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:30:39 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:30:39 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:30:39 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:30:39 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:30:39 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:30:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.445s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:30:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:40 user nova-compute[75080]: DEBUG nova.compute.manager [req-52eed7df-af84-4f5d-9eb6-5cdf50a02ccd req-e2efe45a-1ffd-4392-a93a-c744ffa0afa9 service nova] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Received event network-changed-322cb506-f3d1-49d4-956b-9cef1c9325cd {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:30:40 user nova-compute[75080]: DEBUG nova.compute.manager [req-52eed7df-af84-4f5d-9eb6-5cdf50a02ccd req-e2efe45a-1ffd-4392-a93a-c744ffa0afa9 service nova] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Refreshing instance network info cache due to event network-changed-322cb506-f3d1-49d4-956b-9cef1c9325cd. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:30:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-52eed7df-af84-4f5d-9eb6-5cdf50a02ccd req-e2efe45a-1ffd-4392-a93a-c744ffa0afa9 service nova] Acquiring lock "refresh_cache-2ed540ae-41c0-4baf-bf69-52213850fb95" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:30:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-52eed7df-af84-4f5d-9eb6-5cdf50a02ccd req-e2efe45a-1ffd-4392-a93a-c744ffa0afa9 service nova] Acquired lock "refresh_cache-2ed540ae-41c0-4baf-bf69-52213850fb95" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:30:40 user nova-compute[75080]: DEBUG nova.network.neutron [req-52eed7df-af84-4f5d-9eb6-5cdf50a02ccd req-e2efe45a-1ffd-4392-a93a-c744ffa0afa9 service nova] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Refreshing network info cache for port 322cb506-f3d1-49d4-956b-9cef1c9325cd {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:30:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c5995b30-3d56-4b4a-974a-e5d2e68f65ae tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Acquiring lock "2ed540ae-41c0-4baf-bf69-52213850fb95" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:30:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c5995b30-3d56-4b4a-974a-e5d2e68f65ae tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "2ed540ae-41c0-4baf-bf69-52213850fb95" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:30:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c5995b30-3d56-4b4a-974a-e5d2e68f65ae tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Acquiring lock "2ed540ae-41c0-4baf-bf69-52213850fb95-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:30:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c5995b30-3d56-4b4a-974a-e5d2e68f65ae tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "2ed540ae-41c0-4baf-bf69-52213850fb95-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:30:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c5995b30-3d56-4b4a-974a-e5d2e68f65ae tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "2ed540ae-41c0-4baf-bf69-52213850fb95-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:30:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:40 user nova-compute[75080]: INFO nova.compute.manager [None req-c5995b30-3d56-4b4a-974a-e5d2e68f65ae tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Terminating instance
Dec 05 15:30:40 user nova-compute[75080]: DEBUG nova.compute.manager [None req-c5995b30-3d56-4b4a-974a-e5d2e68f65ae tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:30:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:40 user nova-compute[75080]: DEBUG nova.compute.manager [req-cef33372-c02e-4048-8c3e-1e798bd28aa5 req-fecacfff-8cc5-41d4-900a-09ff11f14aae service nova] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Received event network-vif-unplugged-322cb506-f3d1-49d4-956b-9cef1c9325cd {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:30:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-cef33372-c02e-4048-8c3e-1e798bd28aa5 req-fecacfff-8cc5-41d4-900a-09ff11f14aae service nova] Acquiring lock "2ed540ae-41c0-4baf-bf69-52213850fb95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:30:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-cef33372-c02e-4048-8c3e-1e798bd28aa5 req-fecacfff-8cc5-41d4-900a-09ff11f14aae service nova] Lock "2ed540ae-41c0-4baf-bf69-52213850fb95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:30:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-cef33372-c02e-4048-8c3e-1e798bd28aa5 req-fecacfff-8cc5-41d4-900a-09ff11f14aae service nova] Lock "2ed540ae-41c0-4baf-bf69-52213850fb95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:30:40 user nova-compute[75080]: DEBUG nova.compute.manager [req-cef33372-c02e-4048-8c3e-1e798bd28aa5 req-fecacfff-8cc5-41d4-900a-09ff11f14aae service nova] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] No waiting events found dispatching network-vif-unplugged-322cb506-f3d1-49d4-956b-9cef1c9325cd {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:30:40 user nova-compute[75080]: DEBUG nova.compute.manager [req-cef33372-c02e-4048-8c3e-1e798bd28aa5 req-fecacfff-8cc5-41d4-900a-09ff11f14aae service nova] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Received event network-vif-unplugged-322cb506-f3d1-49d4-956b-9cef1c9325cd for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:30:40 user nova-compute[75080]: DEBUG nova.network.neutron [req-52eed7df-af84-4f5d-9eb6-5cdf50a02ccd req-e2efe45a-1ffd-4392-a93a-c744ffa0afa9 service nova] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Updated VIF entry in instance network info cache for port 322cb506-f3d1-49d4-956b-9cef1c9325cd. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:30:40 user nova-compute[75080]: DEBUG nova.network.neutron [req-52eed7df-af84-4f5d-9eb6-5cdf50a02ccd req-e2efe45a-1ffd-4392-a93a-c744ffa0afa9 service nova] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Updating instance_info_cache with network_info: [{"id": "322cb506-f3d1-49d4-956b-9cef1c9325cd", "address": "fa:16:3e:53:0c:12", "network": {"id": "60895755-a5e0-4195-ace1-7627829ca044", "bridge": "br-int", "label": "tempest-TestStampPattern-2093692741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc899a7995f64588957e55ca0129c812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap322cb506-f3", "ovs_interfaceid": "322cb506-f3d1-49d4-956b-9cef1c9325cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:30:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-52eed7df-af84-4f5d-9eb6-5cdf50a02ccd req-e2efe45a-1ffd-4392-a93a-c744ffa0afa9 service nova] Releasing lock "refresh_cache-2ed540ae-41c0-4baf-bf69-52213850fb95" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:30:41 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Instance destroyed successfully.
Dec 05 15:30:41 user nova-compute[75080]: DEBUG nova.objects.instance [None req-c5995b30-3d56-4b4a-974a-e5d2e68f65ae tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lazy-loading 'resources' on Instance uuid 2ed540ae-41c0-4baf-bf69-52213850fb95 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:30:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-c5995b30-3d56-4b4a-974a-e5d2e68f65ae tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:27:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-2008392424',display_name='tempest-TestStampPattern-server-2008392424',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2008392424',id=26,image_ref='949511f6-f43c-4a22-ac01-e6ed2acc4d9a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHAMA1CXZez7MdPSph5S9i392ZBdQjLqQOb8hqMfYY669vYgo8ML8BR0YzkdsvotEWD0HqSrUCtIg33ZSIHfujV9PM0Cii8jO16lDVcp4/zZGFDnycYQV610lx2OhuUeWQ==',key_name='tempest-TestStampPattern-113655159',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:27:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc899a7995f64588957e55ca0129c812',ramdisk_id='',reservation_id='r-2z0y1qs6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='c9836958-96d4-4b3e-a45c-fbb97846dbd4',image_min_disk='1',image_min_ram='0',image_owner_id='bc899a7995f64588957e55ca0129c812',image_owner_project_name='tempest-TestStampPattern-1734509700',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1734509700-project-member',image_user_id='3f34ec988b5943aeb8d3b5ae512cb417',owner_project_name='tempest-TestStampPattern-1734509700',owner_user_name='tempest-TestStampPattern-1734509700-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:27:53Z,user_data=None,user_id='3f34ec988b5943aeb8d3b5ae512cb417',uuid=2ed540ae-41c0-4baf-bf69-52213850fb95,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "322cb506-f3d1-49d4-956b-9cef1c9325cd", "address": "fa:16:3e:53:0c:12", "network": {"id": "60895755-a5e0-4195-ace1-7627829ca044", "bridge": "br-int", "label": "tempest-TestStampPattern-2093692741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc899a7995f64588957e55ca0129c812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap322cb506-f3", "ovs_interfaceid": "322cb506-f3d1-49d4-956b-9cef1c9325cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:30:41 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c5995b30-3d56-4b4a-974a-e5d2e68f65ae tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Converting VIF {"id": "322cb506-f3d1-49d4-956b-9cef1c9325cd", "address": "fa:16:3e:53:0c:12", "network": {"id": "60895755-a5e0-4195-ace1-7627829ca044", "bridge": "br-int", "label": "tempest-TestStampPattern-2093692741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc899a7995f64588957e55ca0129c812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap322cb506-f3", "ovs_interfaceid": "322cb506-f3d1-49d4-956b-9cef1c9325cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:30:41 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c5995b30-3d56-4b4a-974a-e5d2e68f65ae tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:0c:12,bridge_name='br-int',has_traffic_filtering=True,id=322cb506-f3d1-49d4-956b-9cef1c9325cd,network=Network(60895755-a5e0-4195-ace1-7627829ca044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap322cb506-f3') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:30:41 user nova-compute[75080]: DEBUG os_vif [None req-c5995b30-3d56-4b4a-974a-e5d2e68f65ae tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:0c:12,bridge_name='br-int',has_traffic_filtering=True,id=322cb506-f3d1-49d4-956b-9cef1c9325cd,network=Network(60895755-a5e0-4195-ace1-7627829ca044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap322cb506-f3') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:30:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap322cb506-f3, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:30:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:30:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a9045707-83fd-46b9-a1dc-e9c85ad9a691) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:30:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:41 user nova-compute[75080]: INFO os_vif [None req-c5995b30-3d56-4b4a-974a-e5d2e68f65ae tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:0c:12,bridge_name='br-int',has_traffic_filtering=True,id=322cb506-f3d1-49d4-956b-9cef1c9325cd,network=Network(60895755-a5e0-4195-ace1-7627829ca044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap322cb506-f3')
Dec 05 15:30:41 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-c5995b30-3d56-4b4a-974a-e5d2e68f65ae tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Deleting instance files /opt/stack/data/nova/instances/2ed540ae-41c0-4baf-bf69-52213850fb95_del
Dec 05 15:30:41 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-c5995b30-3d56-4b4a-974a-e5d2e68f65ae tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Deletion of /opt/stack/data/nova/instances/2ed540ae-41c0-4baf-bf69-52213850fb95_del complete
Dec 05 15:30:41 user nova-compute[75080]: INFO nova.compute.manager [None req-c5995b30-3d56-4b4a-974a-e5d2e68f65ae tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Took 0.86 seconds to destroy the instance on the hypervisor.
Dec 05 15:30:41 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-c5995b30-3d56-4b4a-974a-e5d2e68f65ae tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:30:41 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:30:41 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:30:41 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:30:41 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Took 0.47 seconds to deallocate network for instance.
Dec 05 15:30:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c5995b30-3d56-4b4a-974a-e5d2e68f65ae tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:30:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c5995b30-3d56-4b4a-974a-e5d2e68f65ae tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:30:41 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-c5995b30-3d56-4b4a-974a-e5d2e68f65ae tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:30:42 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-c5995b30-3d56-4b4a-974a-e5d2e68f65ae tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:30:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c5995b30-3d56-4b4a-974a-e5d2e68f65ae tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:30:42 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:30:42 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:30:42 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:30:42 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-c5995b30-3d56-4b4a-974a-e5d2e68f65ae tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Deleted allocations for instance 2ed540ae-41c0-4baf-bf69-52213850fb95
Dec 05 15:30:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c5995b30-3d56-4b4a-974a-e5d2e68f65ae tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "2ed540ae-41c0-4baf-bf69-52213850fb95" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.826s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:30:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:42 user nova-compute[75080]: DEBUG nova.compute.manager [req-f6974354-73b7-4205-80f1-95cae7eca76b req-730c303c-9274-42e3-907e-e20c972e489c service nova] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Received event network-vif-plugged-322cb506-f3d1-49d4-956b-9cef1c9325cd {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:30:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f6974354-73b7-4205-80f1-95cae7eca76b req-730c303c-9274-42e3-907e-e20c972e489c service nova] Acquiring lock "2ed540ae-41c0-4baf-bf69-52213850fb95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:30:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f6974354-73b7-4205-80f1-95cae7eca76b req-730c303c-9274-42e3-907e-e20c972e489c service nova] Lock "2ed540ae-41c0-4baf-bf69-52213850fb95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:30:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f6974354-73b7-4205-80f1-95cae7eca76b req-730c303c-9274-42e3-907e-e20c972e489c service nova] Lock "2ed540ae-41c0-4baf-bf69-52213850fb95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:30:42 user nova-compute[75080]: DEBUG nova.compute.manager [req-f6974354-73b7-4205-80f1-95cae7eca76b req-730c303c-9274-42e3-907e-e20c972e489c service nova] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] No waiting events found dispatching network-vif-plugged-322cb506-f3d1-49d4-956b-9cef1c9325cd {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:30:42 user nova-compute[75080]: WARNING nova.compute.manager [req-f6974354-73b7-4205-80f1-95cae7eca76b req-730c303c-9274-42e3-907e-e20c972e489c service nova] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Received unexpected event network-vif-plugged-322cb506-f3d1-49d4-956b-9cef1c9325cd for instance with vm_state deleted and task_state None.
Dec 05 15:30:42 user nova-compute[75080]: DEBUG nova.compute.manager [req-f6974354-73b7-4205-80f1-95cae7eca76b req-730c303c-9274-42e3-907e-e20c972e489c service nova] [instance: 2ed540ae-41c0-4baf-bf69-52213850fb95] Received event network-vif-deleted-322cb506-f3d1-49d4-956b-9cef1c9325cd {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZlSAkpE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:30:44 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:30:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:30:44 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:30:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:30:44 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:30:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[492c8c75-65d0-4dfe-af9c-309cfdc02f0a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:30:44 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[17896b26-8282-47d3-860d-bff99193d97c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0] added
Dec 05 15:30:44 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fa9aef-b470-4379-aa68-9ca6295feb76]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fa0170-725e-477d-be0d-6b87f1c1b469]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WZlSAkpE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WZlSAkpE" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[878d9c77-9c46-4992-9497-8fc8106075c6]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WZlSAkpE'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[784251a0-1c38-4562-9df4-fe0c467ce7f8]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a1a731-d107-4ce2-9418-d4bcab91df4b]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:30:44 user nova-compute[75080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:30:44 user nova-compute[75080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:30:44 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:30:44 user nova-compute[75080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:30:44 user nova-compute[75080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:30:44 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c3b5eb-ead9-4bc7-b982-38fc2e5921a0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0, portal: 172.16.0.220,3260]
Dec 05 15:30:44 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0, portal: 172.16.0.220,3260] successful.
Dec 05 15:30:44 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ceff56-924e-456c-809c-a61c2c62b3c6]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d1f148-f712-44f6-8bd9-f29ed3ee7519]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:30:44 user nova-compute[75080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:30:44 user nova-compute[75080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:30:44 user nova-compute[75080]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)
Dec 05 15:30:44 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:30:44 user nova-compute[75080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:30:44 user nova-compute[75080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:30:44 user nova-compute[75080]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)
Dec 05 15:30:44 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebc8afe-1d13-47f7-88ed-526728bccbe9]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:30:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZlSAkpE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:30:45 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:30:45 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23631323463326530', 'path': '/dev/sdb'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:30:45 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631323463326530', 'path': '/dev/sdb'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:30:45 user nova-compute[75080]: DEBUG nova.objects.instance [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lazy-loading 'flavor' on Instance uuid 011d3446-577a-4f5c-b8f0-ef04940cad17 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:30:45 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 15:30:45 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:30:45 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 15:30:45 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:30:45 user nova-compute[75080]:   <serial>37794663-c414-4d76-8796-5c6c60f5efb0</serial>
Dec 05 15:30:45 user nova-compute[75080]: </disk>
Dec 05 15:30:45 user nova-compute[75080]:  {{(pid=75080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 15:30:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c3192340-4332-4cc9-b004-751e6eac6fd1 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Acquiring lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:30:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c3192340-4332-4cc9-b004-751e6eac6fd1 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:30:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c3192340-4332-4cc9-b004-751e6eac6fd1 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Acquiring lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:30:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c3192340-4332-4cc9-b004-751e6eac6fd1 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:30:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c3192340-4332-4cc9-b004-751e6eac6fd1 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:30:45 user nova-compute[75080]: INFO nova.compute.manager [None req-c3192340-4332-4cc9-b004-751e6eac6fd1 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Terminating instance
Dec 05 15:30:45 user nova-compute[75080]: DEBUG nova.compute.manager [None req-c3192340-4332-4cc9-b004-751e6eac6fd1 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:30:45 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:45 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:45 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:45 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:45 user nova-compute[75080]: DEBUG nova.compute.manager [req-910143fa-57d2-41c8-9bd8-3bab0950834d req-817244f5-57f3-43e6-9da0-4160ee67da58 service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Received event network-vif-unplugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:30:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-910143fa-57d2-41c8-9bd8-3bab0950834d req-817244f5-57f3-43e6-9da0-4160ee67da58 service nova] Acquiring lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:30:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-910143fa-57d2-41c8-9bd8-3bab0950834d req-817244f5-57f3-43e6-9da0-4160ee67da58 service nova] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:30:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-910143fa-57d2-41c8-9bd8-3bab0950834d req-817244f5-57f3-43e6-9da0-4160ee67da58 service nova] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:30:45 user nova-compute[75080]: DEBUG nova.compute.manager [req-910143fa-57d2-41c8-9bd8-3bab0950834d req-817244f5-57f3-43e6-9da0-4160ee67da58 service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] No waiting events found dispatching network-vif-unplugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:30:45 user nova-compute[75080]: DEBUG nova.compute.manager [req-910143fa-57d2-41c8-9bd8-3bab0950834d req-817244f5-57f3-43e6-9da0-4160ee67da58 service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Received event network-vif-unplugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:30:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:30:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:30:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] No VIF found with MAC fa:16:3e:be:d6:bd, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:30:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f0f04dbf-9789-458e-bb5b-da207fb8d22a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.720s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:30:46 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Instance destroyed successfully.
Dec 05 15:30:46 user nova-compute[75080]: DEBUG nova.objects.instance [None req-c3192340-4332-4cc9-b004-751e6eac6fd1 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lazy-loading 'resources' on Instance uuid 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:30:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-c3192340-4332-4cc9-b004-751e6eac6fd1 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-44459294',display_name='tempest-ServerStableDeviceRescueTest-server-44459294',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-44459294',id=19,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPWS3/W2vhVnzZ3NaYXtEquVmBoozY3zOCiGSaoCx4S9+RZI8lcD2eBXGHkJL7aTNIcbbWFdKvFHZ3EJ7KZ38K040A64F6R0O0DMD87IGDq0dpPKOqp9lZ2b8iXtRJnSg==',key_name='tempest-keypair-110561965',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:27:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ecf8f0b6db8b4faeb2c3f5b580e05600',ramdisk_id='',reservation_id='r-9pxkj28l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-701514044',owner_user_name='tempest-ServerStableDeviceRescueTest-701514044-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:29:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='180f6d2698714da0b8585c593d91412f',uuid=60b8e21f-5fbd-4bc5-95ad-8d743ec796f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b187ba9-e311-4d40-8aa9-8f00feb45d88", "address": "fa:16:3e:3b:1f:ec", "network": {"id": "98270770-6a03-4b54-9160-a049184a508d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1275663774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecf8f0b6db8b4faeb2c3f5b580e05600", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b187ba9-e3", "ovs_interfaceid": "6b187ba9-e311-4d40-8aa9-8f00feb45d88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:30:46 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c3192340-4332-4cc9-b004-751e6eac6fd1 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Converting VIF {"id": "6b187ba9-e311-4d40-8aa9-8f00feb45d88", "address": "fa:16:3e:3b:1f:ec", "network": {"id": "98270770-6a03-4b54-9160-a049184a508d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1275663774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecf8f0b6db8b4faeb2c3f5b580e05600", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b187ba9-e3", "ovs_interfaceid": "6b187ba9-e311-4d40-8aa9-8f00feb45d88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:30:46 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c3192340-4332-4cc9-b004-751e6eac6fd1 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:1f:ec,bridge_name='br-int',has_traffic_filtering=True,id=6b187ba9-e311-4d40-8aa9-8f00feb45d88,network=Network(98270770-6a03-4b54-9160-a049184a508d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b187ba9-e3') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:30:46 user nova-compute[75080]: DEBUG os_vif [None req-c3192340-4332-4cc9-b004-751e6eac6fd1 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:1f:ec,bridge_name='br-int',has_traffic_filtering=True,id=6b187ba9-e311-4d40-8aa9-8f00feb45d88,network=Network(98270770-6a03-4b54-9160-a049184a508d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b187ba9-e3') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:30:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b187ba9-e3, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:30:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c36a5223-c8cf-45b9-b98b-93602932bd88) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:30:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:46 user nova-compute[75080]: INFO os_vif [None req-c3192340-4332-4cc9-b004-751e6eac6fd1 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:1f:ec,bridge_name='br-int',has_traffic_filtering=True,id=6b187ba9-e311-4d40-8aa9-8f00feb45d88,network=Network(98270770-6a03-4b54-9160-a049184a508d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b187ba9-e3')
Dec 05 15:30:46 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-c3192340-4332-4cc9-b004-751e6eac6fd1 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Deleting instance files /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7_del
Dec 05 15:30:46 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-c3192340-4332-4cc9-b004-751e6eac6fd1 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Deletion of /opt/stack/data/nova/instances/60b8e21f-5fbd-4bc5-95ad-8d743ec796f7_del complete
Dec 05 15:30:46 user nova-compute[75080]: INFO nova.compute.manager [None req-c3192340-4332-4cc9-b004-751e6eac6fd1 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Took 0.84 seconds to destroy the instance on the hypervisor.
Dec 05 15:30:46 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-c3192340-4332-4cc9-b004-751e6eac6fd1 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:30:46 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:30:46 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:30:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-013a555f-03c6-4949-bb7d-58ded4c9d670 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "011d3446-577a-4f5c-b8f0-ef04940cad17" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:30:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-013a555f-03c6-4949-bb7d-58ded4c9d670 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:30:46 user nova-compute[75080]: DEBUG nova.compute.manager [None req-013a555f-03c6-4949-bb7d-58ded4c9d670 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:30:46 user nova-compute[75080]: DEBUG nova.compute.manager [None req-013a555f-03c6-4949-bb7d-58ded4c9d670 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75080) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Dec 05 15:30:46 user nova-compute[75080]: DEBUG nova.objects.instance [None req-013a555f-03c6-4949-bb7d-58ded4c9d670 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lazy-loading 'flavor' on Instance uuid 011d3446-577a-4f5c-b8f0-ef04940cad17 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:30:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:46 user nova-compute[75080]: DEBUG nova.compute.manager [req-99365264-5364-4bcf-ba14-aaaeabb7654b req-51665bb4-7414-427c-a6e9-0d55f380e6d8 service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Received event network-vif-unplugged-dfee0a0e-5241-4d51-879d-7667bb06344b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:30:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-99365264-5364-4bcf-ba14-aaaeabb7654b req-51665bb4-7414-427c-a6e9-0d55f380e6d8 service nova] Acquiring lock "011d3446-577a-4f5c-b8f0-ef04940cad17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:30:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-99365264-5364-4bcf-ba14-aaaeabb7654b req-51665bb4-7414-427c-a6e9-0d55f380e6d8 service nova] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:30:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-99365264-5364-4bcf-ba14-aaaeabb7654b req-51665bb4-7414-427c-a6e9-0d55f380e6d8 service nova] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:30:46 user nova-compute[75080]: DEBUG nova.compute.manager [req-99365264-5364-4bcf-ba14-aaaeabb7654b req-51665bb4-7414-427c-a6e9-0d55f380e6d8 service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] No waiting events found dispatching network-vif-unplugged-dfee0a0e-5241-4d51-879d-7667bb06344b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:30:46 user nova-compute[75080]: WARNING nova.compute.manager [req-99365264-5364-4bcf-ba14-aaaeabb7654b req-51665bb4-7414-427c-a6e9-0d55f380e6d8 service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Received unexpected event network-vif-unplugged-dfee0a0e-5241-4d51-879d-7667bb06344b for instance with vm_state active and task_state powering-off.
Dec 05 15:30:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:47 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Instance destroyed successfully.
Dec 05 15:30:47 user nova-compute[75080]: DEBUG nova.compute.manager [None req-013a555f-03c6-4949-bb7d-58ded4c9d670 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:30:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-013a555f-03c6-4949-bb7d-58ded4c9d670 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.861s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:30:47 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:30:47 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Took 1.31 seconds to deallocate network for instance.
Dec 05 15:30:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c3192340-4332-4cc9-b004-751e6eac6fd1 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:30:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c3192340-4332-4cc9-b004-751e6eac6fd1 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:30:48 user nova-compute[75080]: DEBUG nova.compute.manager [req-95d60ca1-8266-465d-89d6-33611ea15d6f req-79dc6a5b-df37-4d38-8657-dd2cd8c17ba6 service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Received event network-vif-plugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:30:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-95d60ca1-8266-465d-89d6-33611ea15d6f req-79dc6a5b-df37-4d38-8657-dd2cd8c17ba6 service nova] Acquiring lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:30:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-95d60ca1-8266-465d-89d6-33611ea15d6f req-79dc6a5b-df37-4d38-8657-dd2cd8c17ba6 service nova] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:30:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-95d60ca1-8266-465d-89d6-33611ea15d6f req-79dc6a5b-df37-4d38-8657-dd2cd8c17ba6 service nova] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:30:48 user nova-compute[75080]: DEBUG nova.compute.manager [req-95d60ca1-8266-465d-89d6-33611ea15d6f req-79dc6a5b-df37-4d38-8657-dd2cd8c17ba6 service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] No waiting events found dispatching network-vif-plugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:30:48 user nova-compute[75080]: WARNING nova.compute.manager [req-95d60ca1-8266-465d-89d6-33611ea15d6f req-79dc6a5b-df37-4d38-8657-dd2cd8c17ba6 service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Received unexpected event network-vif-plugged-6b187ba9-e311-4d40-8aa9-8f00feb45d88 for instance with vm_state deleted and task_state None.
Dec 05 15:30:48 user nova-compute[75080]: DEBUG nova.compute.manager [req-95d60ca1-8266-465d-89d6-33611ea15d6f req-79dc6a5b-df37-4d38-8657-dd2cd8c17ba6 service nova] [instance: 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7] Received event network-vif-deleted-6b187ba9-e311-4d40-8aa9-8f00feb45d88 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:30:48 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-c3192340-4332-4cc9-b004-751e6eac6fd1 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:30:48 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-c3192340-4332-4cc9-b004-751e6eac6fd1 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:30:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c3192340-4332-4cc9-b004-751e6eac6fd1 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.258s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:30:48 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-c3192340-4332-4cc9-b004-751e6eac6fd1 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Deleted allocations for instance 60b8e21f-5fbd-4bc5-95ad-8d743ec796f7
Dec 05 15:30:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c3192340-4332-4cc9-b004-751e6eac6fd1 tempest-ServerStableDeviceRescueTest-701514044 tempest-ServerStableDeviceRescueTest-701514044-project-member] Lock "60b8e21f-5fbd-4bc5-95ad-8d743ec796f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.573s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:30:48 user nova-compute[75080]: DEBUG nova.compute.manager [req-0fdd7547-f6b8-4820-b054-5adba03101d3 req-8dbe9000-0ea4-4810-b2dc-c05638b763c6 service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Received event network-vif-plugged-dfee0a0e-5241-4d51-879d-7667bb06344b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:30:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0fdd7547-f6b8-4820-b054-5adba03101d3 req-8dbe9000-0ea4-4810-b2dc-c05638b763c6 service nova] Acquiring lock "011d3446-577a-4f5c-b8f0-ef04940cad17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:30:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0fdd7547-f6b8-4820-b054-5adba03101d3 req-8dbe9000-0ea4-4810-b2dc-c05638b763c6 service nova] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:30:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0fdd7547-f6b8-4820-b054-5adba03101d3 req-8dbe9000-0ea4-4810-b2dc-c05638b763c6 service nova] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:30:48 user nova-compute[75080]: DEBUG nova.compute.manager [req-0fdd7547-f6b8-4820-b054-5adba03101d3 req-8dbe9000-0ea4-4810-b2dc-c05638b763c6 service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] No waiting events found dispatching network-vif-plugged-dfee0a0e-5241-4d51-879d-7667bb06344b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:30:48 user nova-compute[75080]: WARNING nova.compute.manager [req-0fdd7547-f6b8-4820-b054-5adba03101d3 req-8dbe9000-0ea4-4810-b2dc-c05638b763c6 service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Received unexpected event network-vif-plugged-dfee0a0e-5241-4d51-879d-7667bb06344b for instance with vm_state stopped and task_state None.
Dec 05 15:30:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "40138071-fefc-4686-9344-7df255a1fc9d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:30:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "40138071-fefc-4686-9344-7df255a1fc9d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:30:56 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:30:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:30:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:30:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 15:30:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:30:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:30:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:30:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:30:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:30:56 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:30:56 user nova-compute[75080]: INFO nova.compute.claims [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Claim successful on node user
Dec 05 15:30:56 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:30:56 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:30:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.343s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:30:56 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:30:56 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:30:56 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:30:56 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:30:56 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:30:57 user nova-compute[75080]: DEBUG nova.policy [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '15be5b54cc8346bb86683e4ed2fbba9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11227acd507347ae9c5a3bc710707f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:30:57 user nova-compute[75080]: INFO nova.virt.block_device [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Booting with volume 59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b at /dev/vda
Dec 05 15:30:57 user nova-compute[75080]: DEBUG os_brick.utils [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:30:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:57 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4230e8c-ddab-4344-8b05-6ef232813705]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:57 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c0ca0c-36d3-4c76-b8db-5f664a1efb62]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:30:57 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec71e3f-037b-4943-a507-4b9d00b4f74d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:57 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[386c9371-b169-4ddb-88d1-d405ff53c511]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:30:57 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:30:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:30:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:30:57 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:30:57 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1533a77b-4738-4bbf-8e49-ef148087701a]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:30:57 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:30:57 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:30:57 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:30:57 user nova-compute[75080]: DEBUG os_brick.utils [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:30:57 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Updating existing volume attachment record: 17aa890f-9f58-4856-9889-15fb76fc11d2 {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:30:57 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Successfully created port: 022ecfdd-eb21-4d23-8f7d-d993577809e3 {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:30:58 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Successfully updated port: 022ecfdd-eb21-4d23-8f7d-d993577809e3 {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:30:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "refresh_cache-40138071-fefc-4686-9344-7df255a1fc9d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:30:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquired lock "refresh_cache-40138071-fefc-4686-9344-7df255a1fc9d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:30:58 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:30:58 user nova-compute[75080]: DEBUG nova.compute.manager [req-39305641-d7fa-4e07-9b6b-e7ff53fe1ac5 req-ddd89da1-88ca-4e6a-8bb7-82c1a66faf49 service nova] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Received event network-changed-022ecfdd-eb21-4d23-8f7d-d993577809e3 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:30:58 user nova-compute[75080]: DEBUG nova.compute.manager [req-39305641-d7fa-4e07-9b6b-e7ff53fe1ac5 req-ddd89da1-88ca-4e6a-8bb7-82c1a66faf49 service nova] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Refreshing instance network info cache due to event network-changed-022ecfdd-eb21-4d23-8f7d-d993577809e3. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:30:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-39305641-d7fa-4e07-9b6b-e7ff53fe1ac5 req-ddd89da1-88ca-4e6a-8bb7-82c1a66faf49 service nova] Acquiring lock "refresh_cache-40138071-fefc-4686-9344-7df255a1fc9d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:30:58 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:30:58 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Updating instance_info_cache with network_info: [{"id": "022ecfdd-eb21-4d23-8f7d-d993577809e3", "address": "fa:16:3e:f2:a5:2b", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022ecfdd-eb", "ovs_interfaceid": "022ecfdd-eb21-4d23-8f7d-d993577809e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:30:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Releasing lock "refresh_cache-40138071-fefc-4686-9344-7df255a1fc9d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:30:58 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Instance network_info: |[{"id": "022ecfdd-eb21-4d23-8f7d-d993577809e3", "address": "fa:16:3e:f2:a5:2b", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022ecfdd-eb", "ovs_interfaceid": "022ecfdd-eb21-4d23-8f7d-d993577809e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:30:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-39305641-d7fa-4e07-9b6b-e7ff53fe1ac5 req-ddd89da1-88ca-4e6a-8bb7-82c1a66faf49 service nova] Acquired lock "refresh_cache-40138071-fefc-4686-9344-7df255a1fc9d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:30:58 user nova-compute[75080]: DEBUG nova.network.neutron [req-39305641-d7fa-4e07-9b6b-e7ff53fe1ac5 req-ddd89da1-88ca-4e6a-8bb7-82c1a66faf49 service nova] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Refreshing network info cache for port 022ecfdd-eb21-4d23-8f7d-d993577809e3 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:30:59 user nova-compute[75080]: DEBUG nova.network.neutron [req-39305641-d7fa-4e07-9b6b-e7ff53fe1ac5 req-ddd89da1-88ca-4e6a-8bb7-82c1a66faf49 service nova] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Updated VIF entry in instance network info cache for port 022ecfdd-eb21-4d23-8f7d-d993577809e3. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:30:59 user nova-compute[75080]: DEBUG nova.network.neutron [req-39305641-d7fa-4e07-9b6b-e7ff53fe1ac5 req-ddd89da1-88ca-4e6a-8bb7-82c1a66faf49 service nova] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Updating instance_info_cache with network_info: [{"id": "022ecfdd-eb21-4d23-8f7d-d993577809e3", "address": "fa:16:3e:f2:a5:2b", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022ecfdd-eb", "ovs_interfaceid": "022ecfdd-eb21-4d23-8f7d-d993577809e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:30:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-39305641-d7fa-4e07-9b6b-e7ff53fe1ac5 req-ddd89da1-88ca-4e6a-8bb7-82c1a66faf49 service nova] Releasing lock "refresh_cache-40138071-fefc-4686-9344-7df255a1fc9d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:31:01 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:31:01 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:01 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 15:31:01 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:31:01 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:31:01 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:31:06 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Creating image(s)
Dec 05 15:31:06 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Did not create local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Ensure instance console log exists: /opt/stack/data/nova/instances/40138071-fefc-4686-9344-7df255a1fc9d/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Start _get_guest_xml network_info=[{"id": "022ecfdd-eb21-4d23-8f7d-d993577809e3", "address": "fa:16:3e:f2:a5:2b", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022ecfdd-eb", "ovs_interfaceid": "022ecfdd-eb21-4d23-8f7d-d993577809e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UuagHdeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '40138071-fefc-4686-9344-7df255a1fc9d', 'attached_at': '', 'detached_at': '', 'volume_id': '59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b', 'serial': '59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b'}, 'device_type': 'disk', 'attachment_id': '17aa890f-9f58-4856-9889-15fb76fc11d2', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:31:06 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:31:06 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:31:06 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UuagHdeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:31:06 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:31:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:31:06 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:31:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:31:06 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:31:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[723fc0ac-3dbe-40c7-ac12-8bfa90569f12]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:31:06 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b754a8f-f66e-457b-aa77-6e8990677951]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b] added
Dec 05 15:31:06 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[966c068f-a2f4-460c-b00a-3d9768219456]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a68aae0-589d-48d9-931f-67a5a7f41c77]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UuagHdeV {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UuagHdeV" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ab449e-5453-4656-a583-92b8185a7836]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UuagHdeV'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7358f48e-992a-4d6b-aadc-b2a9608724fc]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7746e2ef-aec1-4c99-b521-04d221b1a969]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:31:06 user nova-compute[75080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:31:06 user nova-compute[75080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:31:06 user nova-compute[75080]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)
Dec 05 15:31:06 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:31:06 user nova-compute[75080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:31:06 user nova-compute[75080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:31:06 user nova-compute[75080]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)
Dec 05 15:31:06 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c805844a-b6ef-40a1-b63d-018538d2ab02]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b, portal: 172.16.0.220,3260]
Dec 05 15:31:06 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b, portal: 172.16.0.220,3260] successful.
Dec 05 15:31:06 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc482cd-031d-45f6-bbdc-bee94f83735a]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:31:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:07 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:07 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ee54a5-8949-4431-aa6b-5f97bbe3ec83]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:07 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:31:07 user nova-compute[75080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:31:07 user nova-compute[75080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:31:07 user nova-compute[75080]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)
Dec 05 15:31:07 user nova-compute[75080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:31:07 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:31:07 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:31:07 user nova-compute[75080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:31:07 user nova-compute[75080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:31:07 user nova-compute[75080]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)
Dec 05 15:31:07 user nova-compute[75080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:31:07 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:31:07 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:31:07 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:31:07 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:31:07 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:31:07 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:07 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:07 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2572ec2e-008c-496c-9d2b-51abb35155b5]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:07 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:31:07 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UuagHdeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:31:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:31:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23339616232633030', 'path': '/dev/sdd'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:31:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339616232633030', 'path': '/dev/sdd'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:31:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:30:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-261500703',display_name='tempest-TestVolumeBootPattern-server-261500703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-261500703',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbodyAsCj/LsLD4+fqj081LHmxK6h/6lXtC6JTYG6GWTlsJ9L34SglBGh22zHQ6DhZ8jkeGO+vsFyUrlKxX0aNv4V7kDdiXAt2Ew2tgqS8jk69Jg7JlqDhZvfUPpLsuMg==',key_name='tempest-TestVolumeBootPattern-1935536975',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11227acd507347ae9c5a3bc710707f84',ramdisk_id='',reservation_id='r-xnkfxslm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-23416231',owner_user_name='tempest-TestVolumeBootPattern-23416231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:30:57Z,user_data=None,user_id='15be5b54cc8346bb86683e4ed2fbba9e',uuid=40138071-fefc-4686-9344-7df255a1fc9d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "022ecfdd-eb21-4d23-8f7d-d993577809e3", "address": "fa:16:3e:f2:a5:2b", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022ecfdd-eb", "ovs_interfaceid": "022ecfdd-eb21-4d23-8f7d-d993577809e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:31:08 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Converting VIF {"id": "022ecfdd-eb21-4d23-8f7d-d993577809e3", "address": "fa:16:3e:f2:a5:2b", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022ecfdd-eb", "ovs_interfaceid": "022ecfdd-eb21-4d23-8f7d-d993577809e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:31:08 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:a5:2b,bridge_name='br-int',has_traffic_filtering=True,id=022ecfdd-eb21-4d23-8f7d-d993577809e3,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap022ecfdd-eb') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:31:08 user nova-compute[75080]: DEBUG nova.objects.instance [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lazy-loading 'pci_devices' on Instance uuid 40138071-fefc-4686-9344-7df255a1fc9d {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:31:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:31:08 user nova-compute[75080]:   <uuid>40138071-fefc-4686-9344-7df255a1fc9d</uuid>
Dec 05 15:31:08 user nova-compute[75080]:   <name>instance-0000001e</name>
Dec 05 15:31:08 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:31:08 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:31:08 user nova-compute[75080]:   <metadata>
Dec 05 15:31:08 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:31:08 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:31:08 user nova-compute[75080]:       <nova:name>tempest-TestVolumeBootPattern-server-261500703</nova:name>
Dec 05 15:31:08 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:31:06</nova:creationTime>
Dec 05 15:31:08 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:31:08 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:31:08 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:31:08 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:31:08 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:31:08 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:31:08 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:31:08 user nova-compute[75080]:       <nova:owner>
Dec 05 15:31:08 user nova-compute[75080]:         <nova:user uuid="15be5b54cc8346bb86683e4ed2fbba9e">tempest-TestVolumeBootPattern-23416231-project-member</nova:user>
Dec 05 15:31:08 user nova-compute[75080]:         <nova:project uuid="11227acd507347ae9c5a3bc710707f84">tempest-TestVolumeBootPattern-23416231</nova:project>
Dec 05 15:31:08 user nova-compute[75080]:       </nova:owner>
Dec 05 15:31:08 user nova-compute[75080]:       <nova:ports>
Dec 05 15:31:08 user nova-compute[75080]:         <nova:port uuid="022ecfdd-eb21-4d23-8f7d-d993577809e3">
Dec 05 15:31:08 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 05 15:31:08 user nova-compute[75080]:         </nova:port>
Dec 05 15:31:08 user nova-compute[75080]:       </nova:ports>
Dec 05 15:31:08 user nova-compute[75080]:     </nova:instance>
Dec 05 15:31:08 user nova-compute[75080]:   </metadata>
Dec 05 15:31:08 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:31:08 user nova-compute[75080]:     <system>
Dec 05 15:31:08 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:31:08 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:31:08 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:31:08 user nova-compute[75080]:       <entry name="serial">40138071-fefc-4686-9344-7df255a1fc9d</entry>
Dec 05 15:31:08 user nova-compute[75080]:       <entry name="uuid">40138071-fefc-4686-9344-7df255a1fc9d</entry>
Dec 05 15:31:08 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:31:08 user nova-compute[75080]:     </system>
Dec 05 15:31:08 user nova-compute[75080]:   </sysinfo>
Dec 05 15:31:08 user nova-compute[75080]:   <os>
Dec 05 15:31:08 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:31:08 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:31:08 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:31:08 user nova-compute[75080]:   </os>
Dec 05 15:31:08 user nova-compute[75080]:   <features>
Dec 05 15:31:08 user nova-compute[75080]:     <acpi/>
Dec 05 15:31:08 user nova-compute[75080]:     <apic/>
Dec 05 15:31:08 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:31:08 user nova-compute[75080]:   </features>
Dec 05 15:31:08 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:31:08 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:31:08 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:31:08 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:31:08 user nova-compute[75080]:   </clock>
Dec 05 15:31:08 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:31:08 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:31:08 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:31:08 user nova-compute[75080]:   </cpu>
Dec 05 15:31:08 user nova-compute[75080]:   <devices>
Dec 05 15:31:08 user nova-compute[75080]:     <disk type="block" device="disk">
Dec 05 15:31:08 user nova-compute[75080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:31:08 user nova-compute[75080]:       <source dev="/dev/sdd"/>
Dec 05 15:31:08 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:31:08 user nova-compute[75080]:       <serial>59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b</serial>
Dec 05 15:31:08 user nova-compute[75080]:     </disk>
Dec 05 15:31:08 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:31:08 user nova-compute[75080]:       <mac address="fa:16:3e:f2:a5:2b"/>
Dec 05 15:31:08 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:31:08 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:31:08 user nova-compute[75080]:       <target dev="tap022ecfdd-eb"/>
Dec 05 15:31:08 user nova-compute[75080]:     </interface>
Dec 05 15:31:08 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:31:08 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/40138071-fefc-4686-9344-7df255a1fc9d/console.log" append="off"/>
Dec 05 15:31:08 user nova-compute[75080]:     </serial>
Dec 05 15:31:08 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:31:08 user nova-compute[75080]:     <video>
Dec 05 15:31:08 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:31:08 user nova-compute[75080]:     </video>
Dec 05 15:31:08 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:31:08 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:31:08 user nova-compute[75080]:     </rng>
Dec 05 15:31:08 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:31:08 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:31:08 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:31:08 user nova-compute[75080]:     </memballoon>
Dec 05 15:31:08 user nova-compute[75080]:   </devices>
Dec 05 15:31:08 user nova-compute[75080]: </domain>
Dec 05 15:31:08 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:31:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:30:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-261500703',display_name='tempest-TestVolumeBootPattern-server-261500703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-261500703',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbodyAsCj/LsLD4+fqj081LHmxK6h/6lXtC6JTYG6GWTlsJ9L34SglBGh22zHQ6DhZ8jkeGO+vsFyUrlKxX0aNv4V7kDdiXAt2Ew2tgqS8jk69Jg7JlqDhZvfUPpLsuMg==',key_name='tempest-TestVolumeBootPattern-1935536975',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11227acd507347ae9c5a3bc710707f84',ramdisk_id='',reservation_id='r-xnkfxslm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-23416231',owner_user_name='tempest-TestVolumeBootPattern-23416231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:30:57Z,user_data=None,user_id='15be5b54cc8346bb86683e4ed2fbba9e',uuid=40138071-fefc-4686-9344-7df255a1fc9d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "022ecfdd-eb21-4d23-8f7d-d993577809e3", "address": "fa:16:3e:f2:a5:2b", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022ecfdd-eb", "ovs_interfaceid": "022ecfdd-eb21-4d23-8f7d-d993577809e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:31:08 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Converting VIF {"id": "022ecfdd-eb21-4d23-8f7d-d993577809e3", "address": "fa:16:3e:f2:a5:2b", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022ecfdd-eb", "ovs_interfaceid": "022ecfdd-eb21-4d23-8f7d-d993577809e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:31:08 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:a5:2b,bridge_name='br-int',has_traffic_filtering=True,id=022ecfdd-eb21-4d23-8f7d-d993577809e3,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap022ecfdd-eb') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:31:08 user nova-compute[75080]: DEBUG os_vif [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:a5:2b,bridge_name='br-int',has_traffic_filtering=True,id=022ecfdd-eb21-4d23-8f7d-d993577809e3,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap022ecfdd-eb') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:31:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:31:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:31:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b956b29f-1744-57fa-a380-e3ec26ed417d', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:31:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:31:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap022ecfdd-eb, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:31:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap022ecfdd-eb, col_values=(('qos', UUID('936a3c4c-1bee-460c-90c3-f6ab973d4ca6')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:31:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap022ecfdd-eb, col_values=(('external_ids', {'iface-id': '022ecfdd-eb21-4d23-8f7d-d993577809e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:a5:2b', 'vm-uuid': '40138071-fefc-4686-9344-7df255a1fc9d'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:31:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:31:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:08 user nova-compute[75080]: INFO os_vif [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:a5:2b,bridge_name='br-int',has_traffic_filtering=True,id=022ecfdd-eb21-4d23-8f7d-d993577809e3,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap022ecfdd-eb')
Dec 05 15:31:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:31:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] No VIF found with MAC fa:16:3e:f2:a5:2b, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:31:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:09 user nova-compute[75080]: DEBUG nova.compute.manager [req-a91a7b76-c44c-47de-b73c-5e1718a03860 req-6973e0df-c564-4224-83ad-263dcf303cc0 service nova] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Received event network-vif-plugged-022ecfdd-eb21-4d23-8f7d-d993577809e3 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:31:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a91a7b76-c44c-47de-b73c-5e1718a03860 req-6973e0df-c564-4224-83ad-263dcf303cc0 service nova] Acquiring lock "40138071-fefc-4686-9344-7df255a1fc9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:31:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a91a7b76-c44c-47de-b73c-5e1718a03860 req-6973e0df-c564-4224-83ad-263dcf303cc0 service nova] Lock "40138071-fefc-4686-9344-7df255a1fc9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:31:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a91a7b76-c44c-47de-b73c-5e1718a03860 req-6973e0df-c564-4224-83ad-263dcf303cc0 service nova] Lock "40138071-fefc-4686-9344-7df255a1fc9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:31:09 user nova-compute[75080]: DEBUG nova.compute.manager [req-a91a7b76-c44c-47de-b73c-5e1718a03860 req-6973e0df-c564-4224-83ad-263dcf303cc0 service nova] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] No waiting events found dispatching network-vif-plugged-022ecfdd-eb21-4d23-8f7d-d993577809e3 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:31:09 user nova-compute[75080]: WARNING nova.compute.manager [req-a91a7b76-c44c-47de-b73c-5e1718a03860 req-6973e0df-c564-4224-83ad-263dcf303cc0 service nova] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Received unexpected event network-vif-plugged-022ecfdd-eb21-4d23-8f7d-d993577809e3 for instance with vm_state building and task_state spawning.
Dec 05 15:31:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:11 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:31:11 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:31:11 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Instance spawned successfully.
Dec 05 15:31:11 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:31:11 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:31:11 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:31:11 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:31:11 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:31:11 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:31:11 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:31:11 user nova-compute[75080]: INFO nova.compute.manager [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Took 4.95 seconds to spawn the instance on the hypervisor.
Dec 05 15:31:11 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:31:11 user nova-compute[75080]: DEBUG nova.compute.manager [req-8f09e658-c66b-43fa-953b-6e38458f9fb8 req-982c66eb-3779-4fa9-bd6a-d1ab80797344 service nova] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Received event network-vif-plugged-022ecfdd-eb21-4d23-8f7d-d993577809e3 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:31:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8f09e658-c66b-43fa-953b-6e38458f9fb8 req-982c66eb-3779-4fa9-bd6a-d1ab80797344 service nova] Acquiring lock "40138071-fefc-4686-9344-7df255a1fc9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:31:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8f09e658-c66b-43fa-953b-6e38458f9fb8 req-982c66eb-3779-4fa9-bd6a-d1ab80797344 service nova] Lock "40138071-fefc-4686-9344-7df255a1fc9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:31:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8f09e658-c66b-43fa-953b-6e38458f9fb8 req-982c66eb-3779-4fa9-bd6a-d1ab80797344 service nova] Lock "40138071-fefc-4686-9344-7df255a1fc9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:31:11 user nova-compute[75080]: DEBUG nova.compute.manager [req-8f09e658-c66b-43fa-953b-6e38458f9fb8 req-982c66eb-3779-4fa9-bd6a-d1ab80797344 service nova] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] No waiting events found dispatching network-vif-plugged-022ecfdd-eb21-4d23-8f7d-d993577809e3 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:31:11 user nova-compute[75080]: WARNING nova.compute.manager [req-8f09e658-c66b-43fa-953b-6e38458f9fb8 req-982c66eb-3779-4fa9-bd6a-d1ab80797344 service nova] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Received unexpected event network-vif-plugged-022ecfdd-eb21-4d23-8f7d-d993577809e3 for instance with vm_state building and task_state spawning.
Dec 05 15:31:11 user nova-compute[75080]: INFO nova.compute.manager [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Took 15.18 seconds to build instance.
Dec 05 15:31:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e42bdaf0-5bd8-47d6-8a32-c3a2ed9882ad tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "40138071-fefc-4686-9344-7df255a1fc9d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.271s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:31:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:14 user nova-compute[75080]: DEBUG nova.compute.manager [req-51958e61-a050-498b-be6e-88a2dee92370 req-6baf89f6-67ae-4e77-92b0-5c460ca72b32 service nova] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Received event network-changed-f0094ba7-45c2-445b-bd35-d5c7aedd68bd {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:31:14 user nova-compute[75080]: DEBUG nova.compute.manager [req-51958e61-a050-498b-be6e-88a2dee92370 req-6baf89f6-67ae-4e77-92b0-5c460ca72b32 service nova] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Refreshing instance network info cache due to event network-changed-f0094ba7-45c2-445b-bd35-d5c7aedd68bd. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:31:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-51958e61-a050-498b-be6e-88a2dee92370 req-6baf89f6-67ae-4e77-92b0-5c460ca72b32 service nova] Acquiring lock "refresh_cache-eedd1529-4feb-4f85-8625-0c20d8e0359d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:31:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-51958e61-a050-498b-be6e-88a2dee92370 req-6baf89f6-67ae-4e77-92b0-5c460ca72b32 service nova] Acquired lock "refresh_cache-eedd1529-4feb-4f85-8625-0c20d8e0359d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:31:14 user nova-compute[75080]: DEBUG nova.network.neutron [req-51958e61-a050-498b-be6e-88a2dee92370 req-6baf89f6-67ae-4e77-92b0-5c460ca72b32 service nova] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Refreshing network info cache for port f0094ba7-45c2-445b-bd35-d5c7aedd68bd {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:31:15 user nova-compute[75080]: DEBUG nova.network.neutron [req-51958e61-a050-498b-be6e-88a2dee92370 req-6baf89f6-67ae-4e77-92b0-5c460ca72b32 service nova] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Updated VIF entry in instance network info cache for port f0094ba7-45c2-445b-bd35-d5c7aedd68bd. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:31:15 user nova-compute[75080]: DEBUG nova.network.neutron [req-51958e61-a050-498b-be6e-88a2dee92370 req-6baf89f6-67ae-4e77-92b0-5c460ca72b32 service nova] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Updating instance_info_cache with network_info: [{"id": "f0094ba7-45c2-445b-bd35-d5c7aedd68bd", "address": "fa:16:3e:f9:84:93", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0094ba7-45", "ovs_interfaceid": "f0094ba7-45c2-445b-bd35-d5c7aedd68bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:31:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Acquiring lock "412e1e40-082a-429e-9d35-013b72322761" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:31:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "412e1e40-082a-429e-9d35-013b72322761" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:31:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Acquiring lock "412e1e40-082a-429e-9d35-013b72322761-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:31:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "412e1e40-082a-429e-9d35-013b72322761-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:31:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "412e1e40-082a-429e-9d35-013b72322761-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:31:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-51958e61-a050-498b-be6e-88a2dee92370 req-6baf89f6-67ae-4e77-92b0-5c460ca72b32 service nova] Releasing lock "refresh_cache-eedd1529-4feb-4f85-8625-0c20d8e0359d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:31:15 user nova-compute[75080]: INFO nova.compute.manager [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Terminating instance
Dec 05 15:31:15 user nova-compute[75080]: DEBUG nova.compute.manager [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:31:15 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:15 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:15 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:15 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:15 user nova-compute[75080]: DEBUG nova.compute.manager [req-58bc79fb-bca4-4443-bf6a-c0667cebfd01 req-290c6188-f937-46c0-a8c1-38ffacb494f2 service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] Received event network-vif-unplugged-78547a5f-e10d-4a62-8d35-5584ce87d2c5 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:31:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-58bc79fb-bca4-4443-bf6a-c0667cebfd01 req-290c6188-f937-46c0-a8c1-38ffacb494f2 service nova] Acquiring lock "412e1e40-082a-429e-9d35-013b72322761-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:31:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-58bc79fb-bca4-4443-bf6a-c0667cebfd01 req-290c6188-f937-46c0-a8c1-38ffacb494f2 service nova] Lock "412e1e40-082a-429e-9d35-013b72322761-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:31:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-58bc79fb-bca4-4443-bf6a-c0667cebfd01 req-290c6188-f937-46c0-a8c1-38ffacb494f2 service nova] Lock "412e1e40-082a-429e-9d35-013b72322761-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:31:15 user nova-compute[75080]: DEBUG nova.compute.manager [req-58bc79fb-bca4-4443-bf6a-c0667cebfd01 req-290c6188-f937-46c0-a8c1-38ffacb494f2 service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] No waiting events found dispatching network-vif-unplugged-78547a5f-e10d-4a62-8d35-5584ce87d2c5 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:31:15 user nova-compute[75080]: DEBUG nova.compute.manager [req-58bc79fb-bca4-4443-bf6a-c0667cebfd01 req-290c6188-f937-46c0-a8c1-38ffacb494f2 service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] Received event network-vif-unplugged-78547a5f-e10d-4a62-8d35-5584ce87d2c5 for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:31:15 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 412e1e40-082a-429e-9d35-013b72322761] Instance destroyed successfully.
Dec 05 15:31:15 user nova-compute[75080]: DEBUG nova.objects.instance [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lazy-loading 'resources' on Instance uuid 412e1e40-082a-429e-9d35-013b72322761 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:22:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1475628522',display_name='tempest-ServerActionsTestOtherB-server-1475628522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1475628522',id=17,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwmHJwK89ZUQ4UynGDWrkxG5H0hE1b2MJmPt/rTqIdK43uWLaFbVA/0/Nip6RjSnsKkWhAWpaEvyfqDY42bj2ESHH8OvSzPeboVnwtrtWSkYdz3jR4YJhIMViK+6gUdwg==',key_name='tempest-keypair-508009308',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:28:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c00d040579ca46338e01b8110a0ebc05',ramdisk_id='',reservation_id='r-col74in8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1903161286',owner_user_name='tempest-ServerActionsTestOtherB-1903161286-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:28:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='512e60f95c314913959f037132353c9e',uuid=412e1e40-082a-429e-9d35-013b72322761,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "address": "fa:16:3e:ab:04:37", "network": {"id": "3f7b7f16-6cc0-45b9-9f9c-efd112a71092", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-47517680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00d040579ca46338e01b8110a0ebc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78547a5f-e1", "ovs_interfaceid": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Converting VIF {"id": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "address": "fa:16:3e:ab:04:37", "network": {"id": "3f7b7f16-6cc0-45b9-9f9c-efd112a71092", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-47517680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00d040579ca46338e01b8110a0ebc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78547a5f-e1", "ovs_interfaceid": "78547a5f-e10d-4a62-8d35-5584ce87d2c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:04:37,bridge_name='br-int',has_traffic_filtering=True,id=78547a5f-e10d-4a62-8d35-5584ce87d2c5,network=Network(3f7b7f16-6cc0-45b9-9f9c-efd112a71092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78547a5f-e1') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG os_vif [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:04:37,bridge_name='br-int',has_traffic_filtering=True,id=78547a5f-e10d-4a62-8d35-5584ce87d2c5,network=Network(3f7b7f16-6cc0-45b9-9f9c-efd112a71092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78547a5f-e1') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78547a5f-e1, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=03008ec0-9178-4b01-bd31-97a1fc77cb09) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:16 user nova-compute[75080]: INFO os_vif [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:04:37,bridge_name='br-int',has_traffic_filtering=True,id=78547a5f-e10d-4a62-8d35-5584ce87d2c5,network=Network(3f7b7f16-6cc0-45b9-9f9c-efd112a71092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78547a5f-e1')
Dec 05 15:31:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BMaNUgCf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:31:16 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:31:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea18c1f3-9722-41e3-abd4-9e28b7b85fbc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:31:16 user nova-compute[75080]: No targets found.
Dec 05 15:31:16 user nova-compute[75080]: iSNS:
Dec 05 15:31:16 user nova-compute[75080]: No targets found.
Dec 05 15:31:16 user nova-compute[75080]: STATIC:
Dec 05 15:31:16 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5
Dec 05 15:31:16 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:31:16 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:31:16 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399
Dec 05 15:31:16 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:31:16 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:31:16 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0
Dec 05 15:31:16 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:31:16 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:31:16 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b
Dec 05 15:31:16 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:31:16 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:31:16 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb
Dec 05 15:31:16 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:31:16 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:31:16 user nova-compute[75080]: FIRMWARE:
Dec 05 15:31:16 user nova-compute[75080]: No targets found.
Dec 05 15:31:16 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:31:16 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:31:16 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb9efb9-e6b2-4e90-bccf-7117af8f3d27]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c087dbdc-4bc1-4a0f-8cd1-b486a78f2ec0]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:31:16 user nova-compute[75080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:31:16 user nova-compute[75080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:31:16 user nova-compute[75080]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)
Dec 05 15:31:16 user nova-compute[75080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:31:16 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:31:16 user nova-compute[75080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb (non-flash)
Dec 05 15:31:16 user nova-compute[75080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:31:16 user nova-compute[75080]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)
Dec 05 15:31:16 user nova-compute[75080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:31:16 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f66384b9fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb'): ({'sdc'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Removing single pathed devices sdc {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6256cc3-f242-404a-bc2c-13d33671aed6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[38736554-b652-4c51-848f-57f3a5ab614f]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Flushing IO for device /dev/sdc {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b77349-063f-4432-a4a6-b156c2c9400e]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG nova.compute.manager [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Stashing vm_state: active {{(pid=75080) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[07740633-b20f-47e7-b2d6-17ecddaf8790]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] SCSI volumes sdc have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0195ed7-3680-4edc-8f21-7dd3fc0bfc0f]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c43f824-1e70-4d48-bcf0-d2723fa8cae8]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb, portal: 172.16.0.220,3260]
Dec 05 15:31:16 user nova-compute[75080]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb, portal: 172.16.0.220,3260] successful.
Dec 05 15:31:16 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:31:16 user nova-compute[75080]: INFO nova.compute.claims [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Claim successful on node user
Dec 05 15:31:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64d9a505-3db3-49e1-b76d-68f48f59c4cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27f8208-5579-49a3-b93f-f2477d7f804f]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] <== disconnect_volume: return (357ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:31:16 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Deleting instance files /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761_del
Dec 05 15:31:16 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Deletion of /opt/stack/data/nova/instances/412e1e40-082a-429e-9d35-013b72322761_del complete
Dec 05 15:31:16 user nova-compute[75080]: INFO nova.compute.resource_tracker [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Updating resource usage from migration a0da3b9d-b45d-4c81-b791-539fb331e53e
Dec 05 15:31:16 user nova-compute[75080]: INFO nova.compute.manager [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Took 1.29 seconds to destroy the instance on the hypervisor.
Dec 05 15:31:16 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: 412e1e40-082a-429e-9d35-013b72322761] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 412e1e40-082a-429e-9d35-013b72322761] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG nova.compute.manager [req-09766b97-7cee-476d-9883-77ec67578b00 req-19a211f7-3d8f-4ad4-adef-413fd15819aa service nova] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Received event network-changed-ae56b484-8712-4d95-aa9f-686b40d2619f {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG nova.compute.manager [req-09766b97-7cee-476d-9883-77ec67578b00 req-19a211f7-3d8f-4ad4-adef-413fd15819aa service nova] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Refreshing instance network info cache due to event network-changed-ae56b484-8712-4d95-aa9f-686b40d2619f. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-09766b97-7cee-476d-9883-77ec67578b00 req-19a211f7-3d8f-4ad4-adef-413fd15819aa service nova] Acquiring lock "refresh_cache-308f6ec7-d5c1-46bf-95a4-036e1c192f7f" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-09766b97-7cee-476d-9883-77ec67578b00 req-19a211f7-3d8f-4ad4-adef-413fd15819aa service nova] Acquired lock "refresh_cache-308f6ec7-d5c1-46bf-95a4-036e1c192f7f" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG nova.network.neutron [req-09766b97-7cee-476d-9883-77ec67578b00 req-19a211f7-3d8f-4ad4-adef-413fd15819aa service nova] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Refreshing network info cache for port ae56b484-8712-4d95-aa9f-686b40d2619f {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:31:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.458s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:31:16 user nova-compute[75080]: INFO nova.compute.manager [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Migrating
Dec 05 15:31:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "refresh_cache-308f6ec7-d5c1-46bf-95a4-036e1c192f7f" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:31:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:17 user nova-compute[75080]: DEBUG nova.network.neutron [req-09766b97-7cee-476d-9883-77ec67578b00 req-19a211f7-3d8f-4ad4-adef-413fd15819aa service nova] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Updated VIF entry in instance network info cache for port ae56b484-8712-4d95-aa9f-686b40d2619f. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:31:17 user nova-compute[75080]: DEBUG nova.network.neutron [req-09766b97-7cee-476d-9883-77ec67578b00 req-19a211f7-3d8f-4ad4-adef-413fd15819aa service nova] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Updating instance_info_cache with network_info: [{"id": "ae56b484-8712-4d95-aa9f-686b40d2619f", "address": "fa:16:3e:28:be:b7", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae56b484-87", "ovs_interfaceid": "ae56b484-8712-4d95-aa9f-686b40d2619f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:31:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-09766b97-7cee-476d-9883-77ec67578b00 req-19a211f7-3d8f-4ad4-adef-413fd15819aa service nova] Releasing lock "refresh_cache-308f6ec7-d5c1-46bf-95a4-036e1c192f7f" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:31:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquired lock "refresh_cache-308f6ec7-d5c1-46bf-95a4-036e1c192f7f" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:31:17 user nova-compute[75080]: DEBUG nova.network.neutron [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:31:17 user nova-compute[75080]: DEBUG nova.compute.manager [req-bc261037-bc21-42e6-aaf7-7a2c6605e94a req-18ff30a7-938e-4f78-8786-194eaf665f49 service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] Received event network-vif-plugged-78547a5f-e10d-4a62-8d35-5584ce87d2c5 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:31:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-bc261037-bc21-42e6-aaf7-7a2c6605e94a req-18ff30a7-938e-4f78-8786-194eaf665f49 service nova] Acquiring lock "412e1e40-082a-429e-9d35-013b72322761-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:31:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-bc261037-bc21-42e6-aaf7-7a2c6605e94a req-18ff30a7-938e-4f78-8786-194eaf665f49 service nova] Lock "412e1e40-082a-429e-9d35-013b72322761-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:31:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-bc261037-bc21-42e6-aaf7-7a2c6605e94a req-18ff30a7-938e-4f78-8786-194eaf665f49 service nova] Lock "412e1e40-082a-429e-9d35-013b72322761-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:31:17 user nova-compute[75080]: DEBUG nova.compute.manager [req-bc261037-bc21-42e6-aaf7-7a2c6605e94a req-18ff30a7-938e-4f78-8786-194eaf665f49 service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] No waiting events found dispatching network-vif-plugged-78547a5f-e10d-4a62-8d35-5584ce87d2c5 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:31:17 user nova-compute[75080]: WARNING nova.compute.manager [req-bc261037-bc21-42e6-aaf7-7a2c6605e94a req-18ff30a7-938e-4f78-8786-194eaf665f49 service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] Received unexpected event network-vif-plugged-78547a5f-e10d-4a62-8d35-5584ce87d2c5 for instance with vm_state active and task_state deleting.
Dec 05 15:31:17 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 412e1e40-082a-429e-9d35-013b72322761] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:31:17 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: 412e1e40-082a-429e-9d35-013b72322761] Took 1.32 seconds to deallocate network for instance.
Dec 05 15:31:17 user nova-compute[75080]: DEBUG nova.compute.manager [req-3b519374-3d0a-4650-bab6-e6b04efb0748 req-1c5fd473-a6bc-40d3-842b-49ce7b682603 service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] Received event network-vif-deleted-78547a5f-e10d-4a62-8d35-5584ce87d2c5 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:31:17 user nova-compute[75080]: INFO nova.compute.manager [req-3b519374-3d0a-4650-bab6-e6b04efb0748 req-1c5fd473-a6bc-40d3-842b-49ce7b682603 service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] Neutron deleted interface 78547a5f-e10d-4a62-8d35-5584ce87d2c5; detaching it from the instance and deleting it from the info cache
Dec 05 15:31:17 user nova-compute[75080]: DEBUG nova.network.neutron [req-3b519374-3d0a-4650-bab6-e6b04efb0748 req-1c5fd473-a6bc-40d3-842b-49ce7b682603 service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:31:17 user nova-compute[75080]: DEBUG nova.compute.manager [req-3b519374-3d0a-4650-bab6-e6b04efb0748 req-1c5fd473-a6bc-40d3-842b-49ce7b682603 service nova] [instance: 412e1e40-082a-429e-9d35-013b72322761] Detach interface failed, port_id=78547a5f-e10d-4a62-8d35-5584ce87d2c5, reason: Instance 412e1e40-082a-429e-9d35-013b72322761 could not be found. {{(pid=75080) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 15:31:17 user nova-compute[75080]: DEBUG nova.network.neutron [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Updating instance_info_cache with network_info: [{"id": "ae56b484-8712-4d95-aa9f-686b40d2619f", "address": "fa:16:3e:28:be:b7", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae56b484-87", "ovs_interfaceid": "ae56b484-8712-4d95-aa9f-686b40d2619f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:31:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Releasing lock "refresh_cache-308f6ec7-d5c1-46bf-95a4-036e1c192f7f" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Starting migrate_disk_and_power_off {{(pid=75080) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11490}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "06d40106-075c-4b29-bfc5-a0224ece1d45" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "06d40106-075c-4b29-bfc5-a0224ece1d45" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:31:18 user nova-compute[75080]: INFO nova.compute.manager [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Unshelving
Dec 05 15:31:18 user nova-compute[75080]: INFO nova.virt.block_device [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Booting with volume 37bf152b-3fc7-42e2-a431-c1df7895b315 at /dev/vdc
Dec 05 15:31:18 user nova-compute[75080]: DEBUG os_brick.utils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef49db39-773b-43c1-a444-06376ced66f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a8ec60-b89e-447f-ae05-ece24064e94e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa37262-97e7-4bed-9ac5-dc5e41e2092e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2552e2e2-55b8-422e-af5d-211c4040075c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:31:18 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:31:18 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36d5e94-095a-4b6c-bc2b-211f981a363b]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG os_brick.utils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Updating existing volume attachment record: 2aa8baeb-7451-4a23-9a3a-b08512fd8dd5 {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:31:18 user nova-compute[75080]: INFO nova.compute.manager [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] [instance: 412e1e40-082a-429e-9d35-013b72322761] Took 0.93 seconds to detach 1 volumes for instance.
Dec 05 15:31:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG nova.compute.manager [req-61cf35ec-1728-4179-b9de-5b04c3157acf req-8ddebcaf-03ef-4f3e-9c61-2e800cc3778c service nova] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Received event network-vif-unplugged-ae56b484-8712-4d95-aa9f-686b40d2619f {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-61cf35ec-1728-4179-b9de-5b04c3157acf req-8ddebcaf-03ef-4f3e-9c61-2e800cc3778c service nova] Acquiring lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-61cf35ec-1728-4179-b9de-5b04c3157acf req-8ddebcaf-03ef-4f3e-9c61-2e800cc3778c service nova] Lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-61cf35ec-1728-4179-b9de-5b04c3157acf req-8ddebcaf-03ef-4f3e-9c61-2e800cc3778c service nova] Lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG nova.compute.manager [req-61cf35ec-1728-4179-b9de-5b04c3157acf req-8ddebcaf-03ef-4f3e-9c61-2e800cc3778c service nova] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] No waiting events found dispatching network-vif-unplugged-ae56b484-8712-4d95-aa9f-686b40d2619f {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:31:18 user nova-compute[75080]: WARNING nova.compute.manager [req-61cf35ec-1728-4179-b9de-5b04c3157acf req-8ddebcaf-03ef-4f3e-9c61-2e800cc3778c service nova] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Received unexpected event network-vif-unplugged-ae56b484-8712-4d95-aa9f-686b40d2619f for instance with vm_state active and task_state resize_migrating.
Dec 05 15:31:18 user nova-compute[75080]: DEBUG nova.compute.manager [req-61cf35ec-1728-4179-b9de-5b04c3157acf req-8ddebcaf-03ef-4f3e-9c61-2e800cc3778c service nova] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Received event network-vif-plugged-ae56b484-8712-4d95-aa9f-686b40d2619f {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-61cf35ec-1728-4179-b9de-5b04c3157acf req-8ddebcaf-03ef-4f3e-9c61-2e800cc3778c service nova] Acquiring lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-61cf35ec-1728-4179-b9de-5b04c3157acf req-8ddebcaf-03ef-4f3e-9c61-2e800cc3778c service nova] Lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-61cf35ec-1728-4179-b9de-5b04c3157acf req-8ddebcaf-03ef-4f3e-9c61-2e800cc3778c service nova] Lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG nova.compute.manager [req-61cf35ec-1728-4179-b9de-5b04c3157acf req-8ddebcaf-03ef-4f3e-9c61-2e800cc3778c service nova] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] No waiting events found dispatching network-vif-plugged-ae56b484-8712-4d95-aa9f-686b40d2619f {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:31:18 user nova-compute[75080]: WARNING nova.compute.manager [req-61cf35ec-1728-4179-b9de-5b04c3157acf req-8ddebcaf-03ef-4f3e-9c61-2e800cc3778c service nova] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Received unexpected event network-vif-plugged-ae56b484-8712-4d95-aa9f-686b40d2619f for instance with vm_state active and task_state resize_migrating.
Dec 05 15:31:18 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Instance destroyed successfully.
Dec 05 15:31:18 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:29:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-77885476',display_name='tempest-ServerActionsTestOtherA-server-77885476',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-77885476',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIP5nbHwDP3MaLimasQ81bdHfaI0CFiTpw2YpAxQTZDkv+5y7AL53TfAVsSe07r4BvGkQeGQdB4lyczKq+WcllL3mLq5dj12AlRuMlnnGy3kUrnJXEIK2cec4EX/PelNSA==',key_name='tempest-keypair-1219993291',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:29:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='50f49255d5b74f448dc941027afbf84a',ramdisk_id='',reservation_id='r-ui3j1gwe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-393209338',owner_user_name='tempest-ServerActionsTestOtherA-393209338-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:31:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e99cb2f1c4541fd9a656e038f4afac3',uuid=308f6ec7-d5c1-46bf-95a4-036e1c192f7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae56b484-8712-4d95-aa9f-686b40d2619f", "address": "fa:16:3e:28:be:b7", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-313144289-network", "vif_mac": "fa:16:3e:28:be:b7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae56b484-87", "ovs_interfaceid": "ae56b484-8712-4d95-aa9f-686b40d2619f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Converting VIF {"id": "ae56b484-8712-4d95-aa9f-686b40d2619f", "address": "fa:16:3e:28:be:b7", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-313144289-network", "vif_mac": "fa:16:3e:28:be:b7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae56b484-87", "ovs_interfaceid": "ae56b484-8712-4d95-aa9f-686b40d2619f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:be:b7,bridge_name='br-int',has_traffic_filtering=True,id=ae56b484-8712-4d95-aa9f-686b40d2619f,network=Network(efba4a7e-3a56-41d2-8af7-4c064ba641fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae56b484-87') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG os_vif [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:be:b7,bridge_name='br-int',has_traffic_filtering=True,id=ae56b484-8712-4d95-aa9f-686b40d2619f,network=Network(efba4a7e-3a56-41d2-8af7-4c064ba641fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae56b484-87') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae56b484-87, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6437d963-4172-421b-aca2-10a0bba4986a) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:18 user nova-compute[75080]: INFO os_vif [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:be:b7,bridge_name='br-int',has_traffic_filtering=True,id=ae56b484-8712-4d95-aa9f-686b40d2619f,network=Network(efba4a7e-3a56-41d2-8af7-4c064ba641fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae56b484-87')
Dec 05 15:31:18 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qOpctbNu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:31:18 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:31:18 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1fa6a4-4c82-42c7-bc8f-2b5c95cdab82]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:31:18 user nova-compute[75080]: No targets found.
Dec 05 15:31:18 user nova-compute[75080]: iSNS:
Dec 05 15:31:18 user nova-compute[75080]: No targets found.
Dec 05 15:31:18 user nova-compute[75080]: STATIC:
Dec 05 15:31:18 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5
Dec 05 15:31:18 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:31:18 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:31:18 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399
Dec 05 15:31:18 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:31:18 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:31:18 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0
Dec 05 15:31:18 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:31:18 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:31:18 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b
Dec 05 15:31:18 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:31:18 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:31:18 user nova-compute[75080]: FIRMWARE:
Dec 05 15:31:18 user nova-compute[75080]: No targets found.
Dec 05 15:31:18 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:31:18 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:31:18 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c209e163-4d41-4a3b-93d4-38f6ec5e287f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:18 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d46c576-21a8-4437-ba76-174e80c91085]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:31:19 user nova-compute[75080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:31:19 user nova-compute[75080]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)
Dec 05 15:31:19 user nova-compute[75080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:31:19 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:31:19 user nova-compute[75080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:31:19 user nova-compute[75080]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)
Dec 05 15:31:19 user nova-compute[75080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:31:19 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f66385229e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5'): ({'sde'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Removing single pathed devices sde {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[172ff8fb-75d0-43cb-9af5-77e51f6ad2a5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e809543c-59f1-4778-8489-1620b6c86c99]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Flushing IO for device /dev/sde {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3e0714-b7f5-47b8-92bb-e59978ae9bc7]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b6be19-00b1-4b53-a257-22d37f705f14]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] SCSI volumes sde have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bf4777-2967-4602-b0c4-5de57f45a030]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c49cc4b-a0ed-4b96-89fb-78b8e895576b]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5, portal: 172.16.0.220,3260]
Dec 05 15:31:19 user nova-compute[75080]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5, portal: 172.16.0.220,3260] successful.
Dec 05 15:31:19 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:19 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Deleted allocations for instance 412e1e40-082a-429e-9d35-013b72322761
Dec 05 15:31:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7739a4-454b-488c-aef8-e8a32ffb04e5]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] <== disconnect_volume: return (368ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:31:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-dc290edc-294a-4b38-9cfa-4a7490d3db12 tempest-ServerActionsTestOtherB-1903161286 tempest-ServerActionsTestOtherB-1903161286-project-member] Lock "412e1e40-082a-429e-9d35-013b72322761" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.153s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:31:20 user nova-compute[75080]: DEBUG nova.network.neutron [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Port ae56b484-8712-4d95-aa9f-686b40d2619f binding to destination host user is already ACTIVE {{(pid=75080) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Dec 05 15:31:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:31:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:31:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:31:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "refresh_cache-308f6ec7-d5c1-46bf-95a4-036e1c192f7f" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:31:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquired lock "refresh_cache-308f6ec7-d5c1-46bf-95a4-036e1c192f7f" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:31:20 user nova-compute[75080]: DEBUG nova.network.neutron [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:31:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "b47129e8-c02b-4107-af4f-329173dd453f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:31:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "b47129e8-c02b-4107-af4f-329173dd453f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:31:21 user nova-compute[75080]: DEBUG nova.compute.manager [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:31:21 user nova-compute[75080]: DEBUG nova.network.neutron [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Updating instance_info_cache with network_info: [{"id": "ae56b484-8712-4d95-aa9f-686b40d2619f", "address": "fa:16:3e:28:be:b7", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae56b484-87", "ovs_interfaceid": "ae56b484-8712-4d95-aa9f-686b40d2619f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:31:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Releasing lock "refresh_cache-308f6ec7-d5c1-46bf-95a4-036e1c192f7f" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:31:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:31:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:31:21 user nova-compute[75080]: DEBUG os_brick.utils [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:31:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:21 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:31:21 user nova-compute[75080]: INFO nova.compute.claims [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Claim successful on node user
Dec 05 15:31:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:21 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03f3c4c-50e9-4e1d-91a9-ffa52d4cb036]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:21 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[734a0a76-d999-4c84-8a17-2f390120f75f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:21 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[496642f4-c6ca-4156-b312-88dfb23cf36d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:21 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[abca7e71-099f-4f60-bc54-baaf3abe32b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:31:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:31:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:31:21 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:31:21 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8e5771-4e45-4105-9746-cc41180ccb0d]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:31:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:31:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:31:21 user nova-compute[75080]: DEBUG os_brick.utils [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:31:21 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:31:21 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:31:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.455s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:31:21 user nova-compute[75080]: DEBUG nova.compute.manager [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:31:21 user nova-compute[75080]: DEBUG nova.compute.manager [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:31:21 user nova-compute[75080]: DEBUG nova.network.neutron [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:31:21 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:31:21 user nova-compute[75080]: DEBUG nova.compute.manager [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:31:21 user nova-compute[75080]: DEBUG nova.policy [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '829d709c32db431199af609ddbc8b090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97145ab79b414c4fb8772c71e9414581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:31:21 user nova-compute[75080]: DEBUG nova.compute.manager [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:31:21 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:31:21 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Creating image(s)
Dec 05 15:31:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "/opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:31:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "/opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:31:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "/opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:31:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.198s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:31:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:31:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.175s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk 1073741824" returned: 0 in 0.063s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:31:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:22 user nova-compute[75080]: DEBUG nova.network.neutron [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Successfully created port: c926ed6d-3eed-4727-9a0f-5a9f76c85982 {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:31:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.189s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:22 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 15:31:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:22 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Cannot resize image /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 15:31:22 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:31:22 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Ensure instance console log exists: /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:31:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:31:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:31:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG nova.network.neutron [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Successfully updated port: c926ed6d-3eed-4727-9a0f-5a9f76c85982 {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "refresh_cache-b47129e8-c02b-4107-af4f-329173dd453f" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquired lock "refresh_cache-b47129e8-c02b-4107-af4f-329173dd453f" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG nova.network.neutron [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG nova.compute.manager [req-7ee92458-6ca3-4d71-b68c-c2ed1db73e7d req-ca67231e-e7a4-4653-9447-fd9fb30f238c service nova] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Received event network-changed-c926ed6d-3eed-4727-9a0f-5a9f76c85982 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG nova.compute.manager [req-7ee92458-6ca3-4d71-b68c-c2ed1db73e7d req-ca67231e-e7a4-4653-9447-fd9fb30f238c service nova] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Refreshing instance network info cache due to event network-changed-c926ed6d-3eed-4727-9a0f-5a9f76c85982. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7ee92458-6ca3-4d71-b68c-c2ed1db73e7d req-ca67231e-e7a4-4653-9447-fd9fb30f238c service nova] Acquiring lock "refresh_cache-b47129e8-c02b-4107-af4f-329173dd453f" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG nova.network.neutron [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG nova.network.neutron [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Updating instance_info_cache with network_info: [{"id": "c926ed6d-3eed-4727-9a0f-5a9f76c85982", "address": "fa:16:3e:37:91:eb", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc926ed6d-3e", "ovs_interfaceid": "c926ed6d-3eed-4727-9a0f-5a9f76c85982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Releasing lock "refresh_cache-b47129e8-c02b-4107-af4f-329173dd453f" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG nova.compute.manager [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Instance network_info: |[{"id": "c926ed6d-3eed-4727-9a0f-5a9f76c85982", "address": "fa:16:3e:37:91:eb", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc926ed6d-3e", "ovs_interfaceid": "c926ed6d-3eed-4727-9a0f-5a9f76c85982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7ee92458-6ca3-4d71-b68c-c2ed1db73e7d req-ca67231e-e7a4-4653-9447-fd9fb30f238c service nova] Acquired lock "refresh_cache-b47129e8-c02b-4107-af4f-329173dd453f" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG nova.network.neutron [req-7ee92458-6ca3-4d71-b68c-c2ed1db73e7d req-ca67231e-e7a4-4653-9447-fd9fb30f238c service nova] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Refreshing network info cache for port c926ed6d-3eed-4727-9a0f-5a9f76c85982 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Start _get_guest_xml network_info=[{"id": "c926ed6d-3eed-4727-9a0f-5a9f76c85982", "address": "fa:16:3e:37:91:eb", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc926ed6d-3e", "ovs_interfaceid": "c926ed6d-3eed-4727-9a0f-5a9f76c85982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:31:23 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:31:23 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:31:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:31:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1736206662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1736206662',id=31,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97145ab79b414c4fb8772c71e9414581',ramdisk_id='',reservation_id='r-6s6lrb02',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2060228993',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:31:22Z,user_data=None,user_id='829d709c32db431199af609ddbc8b090',uuid=b47129e8-c02b-4107-af4f-329173dd453f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c926ed6d-3eed-4727-9a0f-5a9f76c85982", "address": "fa:16:3e:37:91:eb", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc926ed6d-3e", "ovs_interfaceid": "c926ed6d-3eed-4727-9a0f-5a9f76c85982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Converting VIF {"id": "c926ed6d-3eed-4727-9a0f-5a9f76c85982", "address": "fa:16:3e:37:91:eb", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc926ed6d-3e", "ovs_interfaceid": "c926ed6d-3eed-4727-9a0f-5a9f76c85982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:91:eb,bridge_name='br-int',has_traffic_filtering=True,id=c926ed6d-3eed-4727-9a0f-5a9f76c85982,network=Network(61aa968d-7e44-4ef2-955f-2e5441416f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc926ed6d-3e') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG nova.objects.instance [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lazy-loading 'pci_devices' on Instance uuid b47129e8-c02b-4107-af4f-329173dd453f {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:31:23 user nova-compute[75080]:   <uuid>b47129e8-c02b-4107-af4f-329173dd453f</uuid>
Dec 05 15:31:23 user nova-compute[75080]:   <name>instance-0000001f</name>
Dec 05 15:31:23 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:31:23 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:31:23 user nova-compute[75080]:   <metadata>
Dec 05 15:31:23 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:31:23 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:31:23 user nova-compute[75080]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1736206662</nova:name>
Dec 05 15:31:23 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:31:23</nova:creationTime>
Dec 05 15:31:23 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:31:23 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:31:23 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:31:23 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:31:23 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:31:23 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:31:23 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:31:23 user nova-compute[75080]:       <nova:owner>
Dec 05 15:31:23 user nova-compute[75080]:         <nova:user uuid="829d709c32db431199af609ddbc8b090">tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member</nova:user>
Dec 05 15:31:23 user nova-compute[75080]:         <nova:project uuid="97145ab79b414c4fb8772c71e9414581">tempest-ServerBootFromVolumeStableRescueTest-2060228993</nova:project>
Dec 05 15:31:23 user nova-compute[75080]:       </nova:owner>
Dec 05 15:31:23 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:31:23 user nova-compute[75080]:       <nova:ports>
Dec 05 15:31:23 user nova-compute[75080]:         <nova:port uuid="c926ed6d-3eed-4727-9a0f-5a9f76c85982">
Dec 05 15:31:23 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 05 15:31:23 user nova-compute[75080]:         </nova:port>
Dec 05 15:31:23 user nova-compute[75080]:       </nova:ports>
Dec 05 15:31:23 user nova-compute[75080]:     </nova:instance>
Dec 05 15:31:23 user nova-compute[75080]:   </metadata>
Dec 05 15:31:23 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:31:23 user nova-compute[75080]:     <system>
Dec 05 15:31:23 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:31:23 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:31:23 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:31:23 user nova-compute[75080]:       <entry name="serial">b47129e8-c02b-4107-af4f-329173dd453f</entry>
Dec 05 15:31:23 user nova-compute[75080]:       <entry name="uuid">b47129e8-c02b-4107-af4f-329173dd453f</entry>
Dec 05 15:31:23 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:31:23 user nova-compute[75080]:     </system>
Dec 05 15:31:23 user nova-compute[75080]:   </sysinfo>
Dec 05 15:31:23 user nova-compute[75080]:   <os>
Dec 05 15:31:23 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:31:23 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:31:23 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:31:23 user nova-compute[75080]:   </os>
Dec 05 15:31:23 user nova-compute[75080]:   <features>
Dec 05 15:31:23 user nova-compute[75080]:     <acpi/>
Dec 05 15:31:23 user nova-compute[75080]:     <apic/>
Dec 05 15:31:23 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:31:23 user nova-compute[75080]:   </features>
Dec 05 15:31:23 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:31:23 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:31:23 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:31:23 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:31:23 user nova-compute[75080]:   </clock>
Dec 05 15:31:23 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:31:23 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:31:23 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:31:23 user nova-compute[75080]:   </cpu>
Dec 05 15:31:23 user nova-compute[75080]:   <devices>
Dec 05 15:31:23 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:31:23 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:31:23 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk"/>
Dec 05 15:31:23 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:31:23 user nova-compute[75080]:     </disk>
Dec 05 15:31:23 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:31:23 user nova-compute[75080]:       <mac address="fa:16:3e:37:91:eb"/>
Dec 05 15:31:23 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:31:23 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:31:23 user nova-compute[75080]:       <target dev="tapc926ed6d-3e"/>
Dec 05 15:31:23 user nova-compute[75080]:     </interface>
Dec 05 15:31:23 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:31:23 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/console.log" append="off"/>
Dec 05 15:31:23 user nova-compute[75080]:     </serial>
Dec 05 15:31:23 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:31:23 user nova-compute[75080]:     <video>
Dec 05 15:31:23 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:31:23 user nova-compute[75080]:     </video>
Dec 05 15:31:23 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:31:23 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:31:23 user nova-compute[75080]:     </rng>
Dec 05 15:31:23 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:31:23 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:31:23 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:31:23 user nova-compute[75080]:     </memballoon>
Dec 05 15:31:23 user nova-compute[75080]:   </devices>
Dec 05 15:31:23 user nova-compute[75080]: </domain>
Dec 05 15:31:23 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:31:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1736206662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1736206662',id=31,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97145ab79b414c4fb8772c71e9414581',ramdisk_id='',reservation_id='r-6s6lrb02',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2060228993',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:31:22Z,user_data=None,user_id='829d709c32db431199af609ddbc8b090',uuid=b47129e8-c02b-4107-af4f-329173dd453f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c926ed6d-3eed-4727-9a0f-5a9f76c85982", "address": "fa:16:3e:37:91:eb", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc926ed6d-3e", "ovs_interfaceid": "c926ed6d-3eed-4727-9a0f-5a9f76c85982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Converting VIF {"id": "c926ed6d-3eed-4727-9a0f-5a9f76c85982", "address": "fa:16:3e:37:91:eb", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc926ed6d-3e", "ovs_interfaceid": "c926ed6d-3eed-4727-9a0f-5a9f76c85982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:91:eb,bridge_name='br-int',has_traffic_filtering=True,id=c926ed6d-3eed-4727-9a0f-5a9f76c85982,network=Network(61aa968d-7e44-4ef2-955f-2e5441416f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc926ed6d-3e') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG os_vif [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:91:eb,bridge_name='br-int',has_traffic_filtering=True,id=c926ed6d-3eed-4727-9a0f-5a9f76c85982,network=Network(61aa968d-7e44-4ef2-955f-2e5441416f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc926ed6d-3e') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cba8a10c-d8b9-534c-b50c-ac759b026633', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc926ed6d-3e, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc926ed6d-3e, col_values=(('qos', UUID('4e790dec-8d65-4b33-b370-d75af2aac79c')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc926ed6d-3e, col_values=(('external_ids', {'iface-id': 'c926ed6d-3eed-4727-9a0f-5a9f76c85982', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:91:eb', 'vm-uuid': 'b47129e8-c02b-4107-af4f-329173dd453f'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:23 user nova-compute[75080]: INFO os_vif [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:91:eb,bridge_name='br-int',has_traffic_filtering=True,id=c926ed6d-3eed-4727-9a0f-5a9f76c85982,network=Network(61aa968d-7e44-4ef2-955f-2e5441416f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc926ed6d-3e')
Dec 05 15:31:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] No VIF found with MAC fa:16:3e:37:91:eb, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG nova.network.neutron [req-7ee92458-6ca3-4d71-b68c-c2ed1db73e7d req-ca67231e-e7a4-4653-9447-fd9fb30f238c service nova] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Updated VIF entry in instance network info cache for port c926ed6d-3eed-4727-9a0f-5a9f76c85982. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG nova.network.neutron [req-7ee92458-6ca3-4d71-b68c-c2ed1db73e7d req-ca67231e-e7a4-4653-9447-fd9fb30f238c service nova] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Updating instance_info_cache with network_info: [{"id": "c926ed6d-3eed-4727-9a0f-5a9f76c85982", "address": "fa:16:3e:37:91:eb", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc926ed6d-3e", "ovs_interfaceid": "c926ed6d-3eed-4727-9a0f-5a9f76c85982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:31:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7ee92458-6ca3-4d71-b68c-c2ed1db73e7d req-ca67231e-e7a4-4653-9447-fd9fb30f238c service nova] Releasing lock "refresh_cache-b47129e8-c02b-4107-af4f-329173dd453f" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:31:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:25 user nova-compute[75080]: DEBUG nova.compute.manager [req-c52b532a-6d51-40db-b892-046bddb83ef9 req-9e22c6f8-3207-490a-a865-0b868d9ff566 service nova] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Received event network-vif-plugged-c926ed6d-3eed-4727-9a0f-5a9f76c85982 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:31:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c52b532a-6d51-40db-b892-046bddb83ef9 req-9e22c6f8-3207-490a-a865-0b868d9ff566 service nova] Acquiring lock "b47129e8-c02b-4107-af4f-329173dd453f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:31:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c52b532a-6d51-40db-b892-046bddb83ef9 req-9e22c6f8-3207-490a-a865-0b868d9ff566 service nova] Lock "b47129e8-c02b-4107-af4f-329173dd453f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:31:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c52b532a-6d51-40db-b892-046bddb83ef9 req-9e22c6f8-3207-490a-a865-0b868d9ff566 service nova] Lock "b47129e8-c02b-4107-af4f-329173dd453f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:31:25 user nova-compute[75080]: DEBUG nova.compute.manager [req-c52b532a-6d51-40db-b892-046bddb83ef9 req-9e22c6f8-3207-490a-a865-0b868d9ff566 service nova] [instance: b47129e8-c02b-4107-af4f-329173dd453f] No waiting events found dispatching network-vif-plugged-c926ed6d-3eed-4727-9a0f-5a9f76c85982 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:31:25 user nova-compute[75080]: WARNING nova.compute.manager [req-c52b532a-6d51-40db-b892-046bddb83ef9 req-9e22c6f8-3207-490a-a865-0b868d9ff566 service nova] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Received unexpected event network-vif-plugged-c926ed6d-3eed-4727-9a0f-5a9f76c85982 for instance with vm_state building and task_state spawning.
Dec 05 15:31:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:27 user nova-compute[75080]: DEBUG nova.compute.manager [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:31:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:31:27 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Instance spawned successfully.
Dec 05 15:31:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:31:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:31:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:31:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:31:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:31:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:31:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:31:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:27 user nova-compute[75080]: INFO nova.compute.manager [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Took 5.43 seconds to spawn the instance on the hypervisor.
Dec 05 15:31:27 user nova-compute[75080]: DEBUG nova.compute.manager [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:31:27 user nova-compute[75080]: INFO nova.compute.manager [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Took 6.24 seconds to build instance.
Dec 05 15:31:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-53bf4ede-51cc-4369-8745-517631a93f42 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "b47129e8-c02b-4107-af4f-329173dd453f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.363s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:31:27 user nova-compute[75080]: DEBUG nova.compute.manager [req-28f76a6c-ad21-4c2c-a14e-076182839259 req-d6d4237f-d919-440b-aa00-b2b6b35d5ae9 service nova] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Received event network-vif-plugged-c926ed6d-3eed-4727-9a0f-5a9f76c85982 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:31:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-28f76a6c-ad21-4c2c-a14e-076182839259 req-d6d4237f-d919-440b-aa00-b2b6b35d5ae9 service nova] Acquiring lock "b47129e8-c02b-4107-af4f-329173dd453f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:31:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-28f76a6c-ad21-4c2c-a14e-076182839259 req-d6d4237f-d919-440b-aa00-b2b6b35d5ae9 service nova] Lock "b47129e8-c02b-4107-af4f-329173dd453f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:31:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-28f76a6c-ad21-4c2c-a14e-076182839259 req-d6d4237f-d919-440b-aa00-b2b6b35d5ae9 service nova] Lock "b47129e8-c02b-4107-af4f-329173dd453f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:31:27 user nova-compute[75080]: DEBUG nova.compute.manager [req-28f76a6c-ad21-4c2c-a14e-076182839259 req-d6d4237f-d919-440b-aa00-b2b6b35d5ae9 service nova] [instance: b47129e8-c02b-4107-af4f-329173dd453f] No waiting events found dispatching network-vif-plugged-c926ed6d-3eed-4727-9a0f-5a9f76c85982 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:31:27 user nova-compute[75080]: WARNING nova.compute.manager [req-28f76a6c-ad21-4c2c-a14e-076182839259 req-d6d4237f-d919-440b-aa00-b2b6b35d5ae9 service nova] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Received unexpected event network-vif-plugged-c926ed6d-3eed-4727-9a0f-5a9f76c85982 for instance with vm_state active and task_state None.
Dec 05 15:31:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:31:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:31:28 user nova-compute[75080]: DEBUG nova.objects.instance [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lazy-loading 'pci_requests' on Instance uuid 06d40106-075c-4b29-bfc5-a0224ece1d45 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:31:28 user nova-compute[75080]: DEBUG nova.objects.instance [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lazy-loading 'numa_topology' on Instance uuid 06d40106-075c-4b29-bfc5-a0224ece1d45 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:31:28 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:31:28 user nova-compute[75080]: INFO nova.compute.claims [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Claim successful on node user
Dec 05 15:31:29 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:31:29 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:31:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:31:29 user nova-compute[75080]: INFO nova.network.neutron [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Updating port 5b00d45c-4fed-41ce-b3c1-67d45830034b with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Dec 05 15:31:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "refresh_cache-06d40106-075c-4b29-bfc5-a0224ece1d45" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:31:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquired lock "refresh_cache-06d40106-075c-4b29-bfc5-a0224ece1d45" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:31:29 user nova-compute[75080]: DEBUG nova.network.neutron [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:31:29 user nova-compute[75080]: DEBUG nova.compute.manager [req-c83371a8-aba0-4b1e-9243-5325de4ce5b5 req-dfbbfb7a-76f2-45be-afc9-a722566a1105 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Received event network-changed-5b00d45c-4fed-41ce-b3c1-67d45830034b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:31:29 user nova-compute[75080]: DEBUG nova.compute.manager [req-c83371a8-aba0-4b1e-9243-5325de4ce5b5 req-dfbbfb7a-76f2-45be-afc9-a722566a1105 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Refreshing instance network info cache due to event network-changed-5b00d45c-4fed-41ce-b3c1-67d45830034b. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:31:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c83371a8-aba0-4b1e-9243-5325de4ce5b5 req-dfbbfb7a-76f2-45be-afc9-a722566a1105 service nova] Acquiring lock "refresh_cache-06d40106-075c-4b29-bfc5-a0224ece1d45" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:31:30 user nova-compute[75080]: DEBUG nova.network.neutron [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Updating instance_info_cache with network_info: [{"id": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "address": "fa:16:3e:e1:1a:b2", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b00d45c-4f", "ovs_interfaceid": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:31:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Releasing lock "refresh_cache-06d40106-075c-4b29-bfc5-a0224ece1d45" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:31:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:31:30 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Creating image(s)
Dec 05 15:31:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "/opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:31:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "/opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:31:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "/opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:31:30 user nova-compute[75080]: DEBUG nova.objects.instance [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lazy-loading 'trusted_certs' on Instance uuid 06d40106-075c-4b29-bfc5-a0224ece1d45 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:31:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c83371a8-aba0-4b1e-9243-5325de4ce5b5 req-dfbbfb7a-76f2-45be-afc9-a722566a1105 service nova] Acquired lock "refresh_cache-06d40106-075c-4b29-bfc5-a0224ece1d45" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:31:30 user nova-compute[75080]: DEBUG nova.network.neutron [req-c83371a8-aba0-4b1e-9243-5325de4ce5b5 req-dfbbfb7a-76f2-45be-afc9-a722566a1105 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Refreshing network info cache for port 5b00d45c-4fed-41ce-b3c1-67d45830034b {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:31:30 user nova-compute[75080]: DEBUG nova.objects.base [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Object Instance<06d40106-075c-4b29-bfc5-a0224ece1d45> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:31:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "79d3f9a84388fc1fdb2993dc4445d36dd5ea24e1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:31:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "79d3f9a84388fc1fdb2993dc4445d36dd5ea24e1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:31:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79d3f9a84388fc1fdb2993dc4445d36dd5ea24e1.part --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79d3f9a84388fc1fdb2993dc4445d36dd5ea24e1.part --force-share --output=json" returned: 0 in 0.191s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG nova.virt.images [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] 11a45eea-cbbd-445a-9496-c7f17946066a was qcow2, converting to raw {{(pid=75080) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG nova.privsep.utils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75080) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/79d3f9a84388fc1fdb2993dc4445d36dd5ea24e1.part /opt/stack/data/nova/instances/_base/79d3f9a84388fc1fdb2993dc4445d36dd5ea24e1.converted {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Starting finish_migration {{(pid=75080) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11677}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Instance directory exists: not creating {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 05 15:31:32 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Creating image(s)
Dec 05 15:31:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Did not create local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Ensure instance console log exists: /opt/stack/data/nova/instances/308f6ec7-d5c1-46bf-95a4-036e1c192f7f/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Start _get_guest_xml network_info=[{"id": "ae56b484-8712-4d95-aa9f-686b40d2619f", "address": "fa:16:3e:28:be:b7", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-313144289-network", "vif_mac": "fa:16:3e:28:be:b7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae56b484-87", "ovs_interfaceid": "ae56b484-8712-4d95-aa9f-686b40d2619f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qOpctbNu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '308f6ec7-d5c1-46bf-95a4-036e1c192f7f', 'attached_at': '2023-12-05T15:31:31.000000', 'detached_at': '', 'volume_id': '48df39ad-d50b-473c-9675-9c68d4cd1dd5', 'serial': '48df39ad-d50b-473c-9675-9c68d4cd1dd5'}, 'device_type': 'disk', 'attachment_id': '4e85f11f-5390-47f0-a91f-6cdfe070e989', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:31:32 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:31:32 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:31:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qOpctbNu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:31:32 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:31:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:31:32 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:31:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:31:32 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fa028c-430a-46ba-8c6d-25e45adae787]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:31:32 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[01159791-6431-4ba7-ac52-02d158512a8d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5] added
Dec 05 15:31:32 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[db510cc5-8854-434c-a872-330710b45ea9]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG nova.network.neutron [req-c83371a8-aba0-4b1e-9243-5325de4ce5b5 req-dfbbfb7a-76f2-45be-afc9-a722566a1105 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Updated VIF entry in instance network info cache for port 5b00d45c-4fed-41ce-b3c1-67d45830034b. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG nova.network.neutron [req-c83371a8-aba0-4b1e-9243-5325de4ce5b5 req-dfbbfb7a-76f2-45be-afc9-a722566a1105 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Updating instance_info_cache with network_info: [{"id": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "address": "fa:16:3e:e1:1a:b2", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b00d45c-4f", "ovs_interfaceid": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c83371a8-aba0-4b1e-9243-5325de4ce5b5 req-dfbbfb7a-76f2-45be-afc9-a722566a1105 service nova] Releasing lock "refresh_cache-06d40106-075c-4b29-bfc5-a0224ece1d45" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6059fcc7-bfc6-4943-aae0-b70d5b7f1075]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qOpctbNu {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qOpctbNu" returned: 0 in 0.043s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe7f6ae-cbdd-4120-baf1-dc596d33296f]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qOpctbNu'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb62664-fdd1-4a37-a802-d0fcc69fd15a]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3938dc99-0245-4df3-8eb3-2d4a12a09f6a]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:31:32 user nova-compute[75080]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)
Dec 05 15:31:32 user nova-compute[75080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:31:32 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:31:32 user nova-compute[75080]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)
Dec 05 15:31:32 user nova-compute[75080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:31:32 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f7d5a3-ecd2-47f4-83a7-4507303b2214]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5, portal: 172.16.0.220,3260]
Dec 05 15:31:32 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5, portal: 172.16.0.220,3260] successful.
Dec 05 15:31:32 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/79d3f9a84388fc1fdb2993dc4445d36dd5ea24e1.part /opt/stack/data/nova/instances/_base/79d3f9a84388fc1fdb2993dc4445d36dd5ea24e1.converted" returned: 0 in 0.408s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79d3f9a84388fc1fdb2993dc4445d36dd5ea24e1.converted --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[76430ab0-c559-409a-9373-5f9f2b86357d]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0546d80e-8d37-414c-ad81-75c4b71e4036]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:31:32 user nova-compute[75080]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)
Dec 05 15:31:32 user nova-compute[75080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:31:32 user nova-compute[75080]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:31:32 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:31:32 user nova-compute[75080]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)
Dec 05 15:31:32 user nova-compute[75080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:31:32 user nova-compute[75080]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:31:32 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.405s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c36a5b9-3b9c-4480-a946-e2d085e34f6e]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qOpctbNu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79d3f9a84388fc1fdb2993dc4445d36dd5ea24e1.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "79d3f9a84388fc1fdb2993dc4445d36dd5ea24e1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.981s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79d3f9a84388fc1fdb2993dc4445d36dd5ea24e1 --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79d3f9a84388fc1fdb2993dc4445d36dd5ea24e1 --force-share --output=json" returned: 0 in 0.239s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "79d3f9a84388fc1fdb2993dc4445d36dd5ea24e1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "79d3f9a84388fc1fdb2993dc4445d36dd5ea24e1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:31:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79d3f9a84388fc1fdb2993dc4445d36dd5ea24e1 --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79d3f9a84388fc1fdb2993dc4445d36dd5ea24e1 --force-share --output=json" returned: 0 in 0.197s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/79d3f9a84388fc1fdb2993dc4445d36dd5ea24e1,backing_fmt=raw /opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/79d3f9a84388fc1fdb2993dc4445d36dd5ea24e1,backing_fmt=raw /opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45/disk 1073741824" returned: 0 in 0.056s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "79d3f9a84388fc1fdb2993dc4445d36dd5ea24e1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:31:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79d3f9a84388fc1fdb2993dc4445d36dd5ea24e1 --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79d3f9a84388fc1fdb2993dc4445d36dd5ea24e1 --force-share --output=json" returned: 0 in 0.185s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:33 user nova-compute[75080]: DEBUG nova.objects.instance [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lazy-loading 'migration_context' on Instance uuid 06d40106-075c-4b29-bfc5-a0224ece1d45 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:31:33 user nova-compute[75080]: DEBUG nova.objects.base [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Object Instance<06d40106-075c-4b29-bfc5-a0224ece1d45> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:31:33 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Rebasing disk image.
Dec 05 15:31:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:33 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:31:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.175s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee -F raw /opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45/disk {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:33 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.447s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:31:33 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] <== connect_volume: return (1450ms) {'type': 'block', 'scsi_wwn': '23137623435623765', 'path': '/dev/sdc'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:31:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137623435623765', 'path': '/dev/sdc'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:31:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:29:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-77885476',display_name='tempest-ServerActionsTestOtherA-server-77885476',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-77885476',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIP5nbHwDP3MaLimasQ81bdHfaI0CFiTpw2YpAxQTZDkv+5y7AL53TfAVsSe07r4BvGkQeGQdB4lyczKq+WcllL3mLq5dj12AlRuMlnnGy3kUrnJXEIK2cec4EX/PelNSA==',key_name='tempest-keypair-1219993291',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:29:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='50f49255d5b74f448dc941027afbf84a',ramdisk_id='',reservation_id='r-ui3j1gwe',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-393209338',owner_user_name='tempest-ServerActionsTestOtherA-393209338-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:31:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e99cb2f1c4541fd9a656e038f4afac3',uuid=308f6ec7-d5c1-46bf-95a4-036e1c192f7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae56b484-8712-4d95-aa9f-686b40d2619f", "address": "fa:16:3e:28:be:b7", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-313144289-network", "vif_mac": "fa:16:3e:28:be:b7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae56b484-87", "ovs_interfaceid": "ae56b484-8712-4d95-aa9f-686b40d2619f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:31:33 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Converting VIF {"id": "ae56b484-8712-4d95-aa9f-686b40d2619f", "address": "fa:16:3e:28:be:b7", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-313144289-network", "vif_mac": "fa:16:3e:28:be:b7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae56b484-87", "ovs_interfaceid": "ae56b484-8712-4d95-aa9f-686b40d2619f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:31:33 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:be:b7,bridge_name='br-int',has_traffic_filtering=True,id=ae56b484-8712-4d95-aa9f-686b40d2619f,network=Network(efba4a7e-3a56-41d2-8af7-4c064ba641fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae56b484-87') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:31:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:31:33 user nova-compute[75080]:   <uuid>308f6ec7-d5c1-46bf-95a4-036e1c192f7f</uuid>
Dec 05 15:31:33 user nova-compute[75080]:   <name>instance-0000001d</name>
Dec 05 15:31:33 user nova-compute[75080]:   <memory>2097152</memory>
Dec 05 15:31:33 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:31:33 user nova-compute[75080]:   <metadata>
Dec 05 15:31:33 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:31:33 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:31:33 user nova-compute[75080]:       <nova:name>tempest-ServerActionsTestOtherA-server-77885476</nova:name>
Dec 05 15:31:33 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:31:32</nova:creationTime>
Dec 05 15:31:33 user nova-compute[75080]:       <nova:flavor name="m1.small">
Dec 05 15:31:33 user nova-compute[75080]:         <nova:memory>2048</nova:memory>
Dec 05 15:31:33 user nova-compute[75080]:         <nova:disk>20</nova:disk>
Dec 05 15:31:33 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:31:33 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:31:33 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:31:33 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:31:33 user nova-compute[75080]:       <nova:owner>
Dec 05 15:31:33 user nova-compute[75080]:         <nova:user uuid="8e99cb2f1c4541fd9a656e038f4afac3">tempest-ServerActionsTestOtherA-393209338-project-member</nova:user>
Dec 05 15:31:33 user nova-compute[75080]:         <nova:project uuid="50f49255d5b74f448dc941027afbf84a">tempest-ServerActionsTestOtherA-393209338</nova:project>
Dec 05 15:31:33 user nova-compute[75080]:       </nova:owner>
Dec 05 15:31:33 user nova-compute[75080]:       <nova:ports>
Dec 05 15:31:33 user nova-compute[75080]:         <nova:port uuid="ae56b484-8712-4d95-aa9f-686b40d2619f">
Dec 05 15:31:33 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 05 15:31:33 user nova-compute[75080]:         </nova:port>
Dec 05 15:31:33 user nova-compute[75080]:       </nova:ports>
Dec 05 15:31:33 user nova-compute[75080]:     </nova:instance>
Dec 05 15:31:33 user nova-compute[75080]:   </metadata>
Dec 05 15:31:33 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:31:33 user nova-compute[75080]:     <system>
Dec 05 15:31:33 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:31:33 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:31:33 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:31:33 user nova-compute[75080]:       <entry name="serial">308f6ec7-d5c1-46bf-95a4-036e1c192f7f</entry>
Dec 05 15:31:33 user nova-compute[75080]:       <entry name="uuid">308f6ec7-d5c1-46bf-95a4-036e1c192f7f</entry>
Dec 05 15:31:33 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:31:33 user nova-compute[75080]:     </system>
Dec 05 15:31:33 user nova-compute[75080]:   </sysinfo>
Dec 05 15:31:33 user nova-compute[75080]:   <os>
Dec 05 15:31:33 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:31:33 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:31:33 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:31:33 user nova-compute[75080]:   </os>
Dec 05 15:31:33 user nova-compute[75080]:   <features>
Dec 05 15:31:33 user nova-compute[75080]:     <acpi/>
Dec 05 15:31:33 user nova-compute[75080]:     <apic/>
Dec 05 15:31:33 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:31:33 user nova-compute[75080]:   </features>
Dec 05 15:31:33 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:31:33 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:31:33 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:31:33 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:31:33 user nova-compute[75080]:   </clock>
Dec 05 15:31:33 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:31:33 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:31:33 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:31:33 user nova-compute[75080]:   </cpu>
Dec 05 15:31:33 user nova-compute[75080]:   <devices>
Dec 05 15:31:33 user nova-compute[75080]:     <disk type="block" device="disk">
Dec 05 15:31:33 user nova-compute[75080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:31:33 user nova-compute[75080]:       <source dev="/dev/sdc"/>
Dec 05 15:31:33 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:31:33 user nova-compute[75080]:       <serial>48df39ad-d50b-473c-9675-9c68d4cd1dd5</serial>
Dec 05 15:31:33 user nova-compute[75080]:     </disk>
Dec 05 15:31:33 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:31:33 user nova-compute[75080]:       <mac address="fa:16:3e:28:be:b7"/>
Dec 05 15:31:33 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:31:33 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:31:33 user nova-compute[75080]:       <target dev="tapae56b484-87"/>
Dec 05 15:31:33 user nova-compute[75080]:     </interface>
Dec 05 15:31:33 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:31:33 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/308f6ec7-d5c1-46bf-95a4-036e1c192f7f/console.log" append="off"/>
Dec 05 15:31:33 user nova-compute[75080]:     </serial>
Dec 05 15:31:33 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:31:33 user nova-compute[75080]:     <video>
Dec 05 15:31:33 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:31:33 user nova-compute[75080]:     </video>
Dec 05 15:31:33 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:31:33 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:31:33 user nova-compute[75080]:     </rng>
Dec 05 15:31:33 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:31:33 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:31:33 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:31:33 user nova-compute[75080]:     </memballoon>
Dec 05 15:31:33 user nova-compute[75080]:   </devices>
Dec 05 15:31:33 user nova-compute[75080]: </domain>
Dec 05 15:31:33 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:31:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:29:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-77885476',display_name='tempest-ServerActionsTestOtherA-server-77885476',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-77885476',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIP5nbHwDP3MaLimasQ81bdHfaI0CFiTpw2YpAxQTZDkv+5y7AL53TfAVsSe07r4BvGkQeGQdB4lyczKq+WcllL3mLq5dj12AlRuMlnnGy3kUrnJXEIK2cec4EX/PelNSA==',key_name='tempest-keypair-1219993291',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:29:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='50f49255d5b74f448dc941027afbf84a',ramdisk_id='',reservation_id='r-ui3j1gwe',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-393209338',owner_user_name='tempest-ServerActionsTestOtherA-393209338-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:31:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e99cb2f1c4541fd9a656e038f4afac3',uuid=308f6ec7-d5c1-46bf-95a4-036e1c192f7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae56b484-8712-4d95-aa9f-686b40d2619f", "address": "fa:16:3e:28:be:b7", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-313144289-network", "vif_mac": "fa:16:3e:28:be:b7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae56b484-87", "ovs_interfaceid": "ae56b484-8712-4d95-aa9f-686b40d2619f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:31:33 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Converting VIF {"id": "ae56b484-8712-4d95-aa9f-686b40d2619f", "address": "fa:16:3e:28:be:b7", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-313144289-network", "vif_mac": "fa:16:3e:28:be:b7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae56b484-87", "ovs_interfaceid": "ae56b484-8712-4d95-aa9f-686b40d2619f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:31:33 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:be:b7,bridge_name='br-int',has_traffic_filtering=True,id=ae56b484-8712-4d95-aa9f-686b40d2619f,network=Network(efba4a7e-3a56-41d2-8af7-4c064ba641fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae56b484-87') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:31:33 user nova-compute[75080]: DEBUG os_vif [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:be:b7,bridge_name='br-int',has_traffic_filtering=True,id=ae56b484-8712-4d95-aa9f-686b40d2619f,network=Network(efba4a7e-3a56-41d2-8af7-4c064ba641fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae56b484-87') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:31:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:31:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:31:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1cf64c90-a8d6-5891-a611-ec0bbf55bdc0', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:31:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:31:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae56b484-87, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:31:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapae56b484-87, col_values=(('qos', UUID('246b2f40-92e5-496a-a1b5-969440c806a6')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:31:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapae56b484-87, col_values=(('external_ids', {'iface-id': 'ae56b484-8712-4d95-aa9f-686b40d2619f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:be:b7', 'vm-uuid': '308f6ec7-d5c1-46bf-95a4-036e1c192f7f'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:31:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:31:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:33 user nova-compute[75080]: INFO os_vif [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:be:b7,bridge_name='br-int',has_traffic_filtering=True,id=ae56b484-8712-4d95-aa9f-686b40d2619f,network=Network(efba4a7e-3a56-41d2-8af7-4c064ba641fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae56b484-87')
Dec 05 15:31:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:31:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] No VIF found with MAC fa:16:3e:28:be:b7, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:31:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:35 user nova-compute[75080]: DEBUG nova.compute.manager [req-4a3d8b62-2208-4230-8ecf-6364df0d7d81 req-841adc5c-1cfd-4b5d-89af-efd93ccd42ad service nova] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Received event network-vif-plugged-ae56b484-8712-4d95-aa9f-686b40d2619f {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:31:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4a3d8b62-2208-4230-8ecf-6364df0d7d81 req-841adc5c-1cfd-4b5d-89af-efd93ccd42ad service nova] Acquiring lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:31:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4a3d8b62-2208-4230-8ecf-6364df0d7d81 req-841adc5c-1cfd-4b5d-89af-efd93ccd42ad service nova] Lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:31:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4a3d8b62-2208-4230-8ecf-6364df0d7d81 req-841adc5c-1cfd-4b5d-89af-efd93ccd42ad service nova] Lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:31:35 user nova-compute[75080]: DEBUG nova.compute.manager [req-4a3d8b62-2208-4230-8ecf-6364df0d7d81 req-841adc5c-1cfd-4b5d-89af-efd93ccd42ad service nova] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] No waiting events found dispatching network-vif-plugged-ae56b484-8712-4d95-aa9f-686b40d2619f {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:31:35 user nova-compute[75080]: WARNING nova.compute.manager [req-4a3d8b62-2208-4230-8ecf-6364df0d7d81 req-841adc5c-1cfd-4b5d-89af-efd93ccd42ad service nova] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Received unexpected event network-vif-plugged-ae56b484-8712-4d95-aa9f-686b40d2619f for instance with vm_state active and task_state resize_finish.
Dec 05 15:31:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:35 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:31:35 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:31:35 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee -F raw /opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45/disk" returned: 0 in 2.602s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Ensure instance console log exists: /opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Start _get_guest_xml network_info=[{"id": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "address": "fa:16:3e:e1:1a:b2", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b00d45c-4f", "ovs_interfaceid": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='efda63e731207d24b6b032d92e0d194d',container_format='bare',created_at=2023-12-05T15:29:25Z,direct_url=<?>,disk_format='qcow2',id=11a45eea-cbbd-445a-9496-c7f17946066a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1271607709-shelved',owner='6350b8a7b0ce4af7b83a280c0c1ec3e6',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-12-05T15:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OQZmfHaK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '06d40106-075c-4b29-bfc5-a0224ece1d45', 'attached_at': '', 'detached_at': '', 'volume_id': '37bf152b-3fc7-42e2-a431-c1df7895b315', 'serial': '37bf152b-3fc7-42e2-a431-c1df7895b315'}, 'device_type': 'disk', 'attachment_id': '2aa8baeb-7451-4a23-9a3a-b08512fd8dd5', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:31:36 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:31:36 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:31:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='efda63e731207d24b6b032d92e0d194d',container_format='bare',created_at=2023-12-05T15:29:25Z,direct_url=<?>,disk_format='qcow2',id=11a45eea-cbbd-445a-9496-c7f17946066a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1271607709-shelved',owner='6350b8a7b0ce4af7b83a280c0c1ec3e6',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-12-05T15:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG nova.objects.instance [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lazy-loading 'vcpu_model' on Instance uuid 06d40106-075c-4b29-bfc5-a0224ece1d45 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG nova.objects.base [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Object Instance<06d40106-075c-4b29-bfc5-a0224ece1d45> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OQZmfHaK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:31:36 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:31:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:31:36 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:31:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:31:36 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 -p 172.16.0.220:3260" returned: 21 in 0.053s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3873daed-d8a6-4a5f-9022-699c0a891393]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:31:36 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f79c08-628b-4225-aa0b-c6c224dafb92]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315] added
Dec 05 15:31:36 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a63d0d-4597-4c33-9c89-a42cc76067b8]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d9632f-78b7-4503-9814-60dd3b25e27e]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OQZmfHaK {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OQZmfHaK" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24b25ae-d061-403d-9510-e2ffe5245681]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OQZmfHaK'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff58a8bd-3abb-48c7-8dac-ed124b137485]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a112e54-9964-4302-bf80-890cfa60fd3d]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:31:36 user nova-compute[75080]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)
Dec 05 15:31:36 user nova-compute[75080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:31:36 user nova-compute[75080]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:31:36 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:31:36 user nova-compute[75080]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)
Dec 05 15:31:36 user nova-compute[75080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:31:36 user nova-compute[75080]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:31:36 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-07b025ff-4a9d-48a2-b950-b8f2d165f33c" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-07b025ff-4a9d-48a2-b950-b8f2d165f33c" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0312593d-d151-4baa-9e9e-3c26a79fe2aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315, portal: 172.16.0.220,3260]
Dec 05 15:31:36 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315, portal: 172.16.0.220,3260] successful.
Dec 05 15:31:36 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bc1b40-d292-4235-a209-74762897341a]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8634fc5d-f4b6-4bf7-8a60-8a8e5bfbeee2]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:31:36 user nova-compute[75080]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)
Dec 05 15:31:36 user nova-compute[75080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:31:36 user nova-compute[75080]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:31:36 user nova-compute[75080]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 (non-flash)
Dec 05 15:31:36 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:31:36 user nova-compute[75080]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)
Dec 05 15:31:36 user nova-compute[75080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:31:36 user nova-compute[75080]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:31:36 user nova-compute[75080]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 (non-flash)
Dec 05 15:31:36 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.395s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] HCTL ('36', '-', '-', 0) found on session 37 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6934136-c416-425a-8179-0a04854c464f]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:31:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OQZmfHaK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG nova.compute.manager [req-5bebed02-a5bd-4e50-8b3a-3d58abeb3182 req-893c655e-5e13-4bd3-96fb-48bf6c3d654e service nova] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Received event network-vif-plugged-ae56b484-8712-4d95-aa9f-686b40d2619f {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5bebed02-a5bd-4e50-8b3a-3d58abeb3182 req-893c655e-5e13-4bd3-96fb-48bf6c3d654e service nova] Acquiring lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5bebed02-a5bd-4e50-8b3a-3d58abeb3182 req-893c655e-5e13-4bd3-96fb-48bf6c3d654e service nova] Lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5bebed02-a5bd-4e50-8b3a-3d58abeb3182 req-893c655e-5e13-4bd3-96fb-48bf6c3d654e service nova] Lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG nova.compute.manager [req-5bebed02-a5bd-4e50-8b3a-3d58abeb3182 req-893c655e-5e13-4bd3-96fb-48bf6c3d654e service nova] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] No waiting events found dispatching network-vif-plugged-ae56b484-8712-4d95-aa9f-686b40d2619f {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:31:37 user nova-compute[75080]: WARNING nova.compute.manager [req-5bebed02-a5bd-4e50-8b3a-3d58abeb3182 req-893c655e-5e13-4bd3-96fb-48bf6c3d654e service nova] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Received unexpected event network-vif-plugged-ae56b484-8712-4d95-aa9f-686b40d2619f for instance with vm_state active and task_state resize_finish.
Dec 05 15:31:37 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Updating instance_info_cache with network_info: [{"id": "b499a54e-2aab-4f63-a634-66c6a627bb4a", "address": "fa:16:3e:14:03:09", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb499a54e-2a", "ovs_interfaceid": "b499a54e-2aab-4f63-a634-66c6a627bb4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-07b025ff-4a9d-48a2-b950-b8f2d165f33c" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.439s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] <== connect_volume: return (1440ms) {'type': 'block', 'scsi_wwn': '26436636164333135', 'path': '/dev/sde'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436636164333135', 'path': '/dev/sde'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG nova.compute.manager [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:31:37 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Instance running successfully.
Dec 05 15:31:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T15:27:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1271607709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1271607709',id=25,image_ref='11a45eea-cbbd-445a-9496-c7f17946066a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-755329848',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:27:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6350b8a7b0ce4af7b83a280c0c1ec3e6',ramdisk_id='',reservation_id='r-33v9h4hw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-132988477',owner_user_name='tempest-AttachVolumeShelveTestJSON-132988477-project-member',shelved_at='2023-12-05T15:29:29.315398',shelved_host='user',shelved_image_id='11a45eea-cbbd-445a-9496-c7f17946066a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:31:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72a1c29faca44a4095dbda09561e5a91',uuid=06d40106-075c-4b29-bfc5-a0224ece1d45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "address": "fa:16:3e:e1:1a:b2", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b00d45c-4f", "ovs_interfaceid": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Converting VIF {"id": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "address": "fa:16:3e:e1:1a:b2", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b00d45c-4f", "ovs_interfaceid": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1a:b2,bridge_name='br-int',has_traffic_filtering=True,id=5b00d45c-4fed-41ce-b3c1-67d45830034b,network=Network(b94a6985-25b3-480e-b79f-b753c8b23fa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b00d45c-4f') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG nova.objects.instance [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lazy-loading 'pci_devices' on Instance uuid 06d40106-075c-4b29-bfc5-a0224ece1d45 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Failed to set time: agent not configured {{(pid=75080) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-10c3fb7b-461d-4df5-a5f7-222b3327a505 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] finish_migration finished successfully. {{(pid=75080) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11772}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG nova.objects.base [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Object Instance<06d40106-075c-4b29-bfc5-a0224ece1d45> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:31:37 user nova-compute[75080]:   <uuid>06d40106-075c-4b29-bfc5-a0224ece1d45</uuid>
Dec 05 15:31:37 user nova-compute[75080]:   <name>instance-00000019</name>
Dec 05 15:31:37 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:31:37 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:31:37 user nova-compute[75080]:   <metadata>
Dec 05 15:31:37 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:31:37 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:31:37 user nova-compute[75080]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1271607709</nova:name>
Dec 05 15:31:37 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:31:36</nova:creationTime>
Dec 05 15:31:37 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:31:37 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:31:37 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:31:37 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:31:37 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:31:37 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:31:37 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:31:37 user nova-compute[75080]:       <nova:owner>
Dec 05 15:31:37 user nova-compute[75080]:         <nova:user uuid="72a1c29faca44a4095dbda09561e5a91">tempest-AttachVolumeShelveTestJSON-132988477-project-member</nova:user>
Dec 05 15:31:37 user nova-compute[75080]:         <nova:project uuid="6350b8a7b0ce4af7b83a280c0c1ec3e6">tempest-AttachVolumeShelveTestJSON-132988477</nova:project>
Dec 05 15:31:37 user nova-compute[75080]:       </nova:owner>
Dec 05 15:31:37 user nova-compute[75080]:       <nova:root type="image" uuid="11a45eea-cbbd-445a-9496-c7f17946066a"/>
Dec 05 15:31:37 user nova-compute[75080]:       <nova:ports>
Dec 05 15:31:37 user nova-compute[75080]:         <nova:port uuid="5b00d45c-4fed-41ce-b3c1-67d45830034b">
Dec 05 15:31:37 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 05 15:31:37 user nova-compute[75080]:         </nova:port>
Dec 05 15:31:37 user nova-compute[75080]:       </nova:ports>
Dec 05 15:31:37 user nova-compute[75080]:     </nova:instance>
Dec 05 15:31:37 user nova-compute[75080]:   </metadata>
Dec 05 15:31:37 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:31:37 user nova-compute[75080]:     <system>
Dec 05 15:31:37 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:31:37 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:31:37 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:31:37 user nova-compute[75080]:       <entry name="serial">06d40106-075c-4b29-bfc5-a0224ece1d45</entry>
Dec 05 15:31:37 user nova-compute[75080]:       <entry name="uuid">06d40106-075c-4b29-bfc5-a0224ece1d45</entry>
Dec 05 15:31:37 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:31:37 user nova-compute[75080]:     </system>
Dec 05 15:31:37 user nova-compute[75080]:   </sysinfo>
Dec 05 15:31:37 user nova-compute[75080]:   <os>
Dec 05 15:31:37 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:31:37 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:31:37 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:31:37 user nova-compute[75080]:   </os>
Dec 05 15:31:37 user nova-compute[75080]:   <features>
Dec 05 15:31:37 user nova-compute[75080]:     <acpi/>
Dec 05 15:31:37 user nova-compute[75080]:     <apic/>
Dec 05 15:31:37 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:31:37 user nova-compute[75080]:   </features>
Dec 05 15:31:37 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:31:37 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:31:37 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:31:37 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:31:37 user nova-compute[75080]:   </clock>
Dec 05 15:31:37 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:31:37 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:31:37 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:31:37 user nova-compute[75080]:   </cpu>
Dec 05 15:31:37 user nova-compute[75080]:   <devices>
Dec 05 15:31:37 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:31:37 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:31:37 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45/disk"/>
Dec 05 15:31:37 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:31:37 user nova-compute[75080]:     </disk>
Dec 05 15:31:37 user nova-compute[75080]:     <disk type="block" device="disk">
Dec 05 15:31:37 user nova-compute[75080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:31:37 user nova-compute[75080]:       <source dev="/dev/sde"/>
Dec 05 15:31:37 user nova-compute[75080]:       <target dev="vdc" bus="virtio"/>
Dec 05 15:31:37 user nova-compute[75080]:       <serial>37bf152b-3fc7-42e2-a431-c1df7895b315</serial>
Dec 05 15:31:37 user nova-compute[75080]:     </disk>
Dec 05 15:31:37 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:31:37 user nova-compute[75080]:       <mac address="fa:16:3e:e1:1a:b2"/>
Dec 05 15:31:37 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:31:37 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:31:37 user nova-compute[75080]:       <target dev="tap5b00d45c-4f"/>
Dec 05 15:31:37 user nova-compute[75080]:     </interface>
Dec 05 15:31:37 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:31:37 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45/console.log" append="off"/>
Dec 05 15:31:37 user nova-compute[75080]:     </serial>
Dec 05 15:31:37 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:31:37 user nova-compute[75080]:     <video>
Dec 05 15:31:37 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:31:37 user nova-compute[75080]:     </video>
Dec 05 15:31:37 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:31:37 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:31:37 user nova-compute[75080]:     </rng>
Dec 05 15:31:37 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:31:37 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:31:37 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:31:37 user nova-compute[75080]:     </memballoon>
Dec 05 15:31:37 user nova-compute[75080]:   </devices>
Dec 05 15:31:37 user nova-compute[75080]: </domain>
Dec 05 15:31:37 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T15:27:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1271607709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1271607709',id=25,image_ref='11a45eea-cbbd-445a-9496-c7f17946066a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-755329848',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:27:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6350b8a7b0ce4af7b83a280c0c1ec3e6',ramdisk_id='',reservation_id='r-33v9h4hw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-132988477',owner_user_name='tempest-AttachVolumeShelveTestJSON-132988477-project-member',shelved_at='2023-12-05T15:29:29.315398',shelved_host='user',shelved_image_id='11a45eea-cbbd-445a-9496-c7f17946066a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:31:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72a1c29faca44a4095dbda09561e5a91',uuid=06d40106-075c-4b29-bfc5-a0224ece1d45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "address": "fa:16:3e:e1:1a:b2", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b00d45c-4f", "ovs_interfaceid": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Converting VIF {"id": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "address": "fa:16:3e:e1:1a:b2", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b00d45c-4f", "ovs_interfaceid": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1a:b2,bridge_name='br-int',has_traffic_filtering=True,id=5b00d45c-4fed-41ce-b3c1-67d45830034b,network=Network(b94a6985-25b3-480e-b79f-b753c8b23fa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b00d45c-4f') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG os_vif [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1a:b2,bridge_name='br-int',has_traffic_filtering=True,id=5b00d45c-4fed-41ce-b3c1-67d45830034b,network=Network(b94a6985-25b3-480e-b79f-b753c8b23fa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b00d45c-4f') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e14c3219-9cff-5136-97b4-911a534ba506', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b00d45c-4f, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b00d45c-4f, col_values=(('qos', UUID('87bbd7cf-670d-4fd1-9d4d-c54dc6f41c6d')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b00d45c-4f, col_values=(('external_ids', {'iface-id': '5b00d45c-4fed-41ce-b3c1-67d45830034b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:1a:b2', 'vm-uuid': '06d40106-075c-4b29-bfc5-a0224ece1d45'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:37 user nova-compute[75080]: INFO os_vif [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1a:b2,bridge_name='br-int',has_traffic_filtering=True,id=5b00d45c-4fed-41ce-b3c1-67d45830034b,network=Network(b94a6985-25b3-480e-b79f-b753c8b23fa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b00d45c-4f')
Dec 05 15:31:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:31:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] No VIF found with MAC fa:16:3e:e1:1a:b2, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:31:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:38 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:31:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:39 user nova-compute[75080]: DEBUG nova.compute.manager [req-24bd16b4-b0ae-4136-b6b1-ac6063781fce req-04c382ad-78f7-4077-a7ec-e8637c907cfc service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Received event network-vif-plugged-5b00d45c-4fed-41ce-b3c1-67d45830034b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:31:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-24bd16b4-b0ae-4136-b6b1-ac6063781fce req-04c382ad-78f7-4077-a7ec-e8637c907cfc service nova] Acquiring lock "06d40106-075c-4b29-bfc5-a0224ece1d45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:31:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-24bd16b4-b0ae-4136-b6b1-ac6063781fce req-04c382ad-78f7-4077-a7ec-e8637c907cfc service nova] Lock "06d40106-075c-4b29-bfc5-a0224ece1d45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:31:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-24bd16b4-b0ae-4136-b6b1-ac6063781fce req-04c382ad-78f7-4077-a7ec-e8637c907cfc service nova] Lock "06d40106-075c-4b29-bfc5-a0224ece1d45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:31:39 user nova-compute[75080]: DEBUG nova.compute.manager [req-24bd16b4-b0ae-4136-b6b1-ac6063781fce req-04c382ad-78f7-4077-a7ec-e8637c907cfc service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] No waiting events found dispatching network-vif-plugged-5b00d45c-4fed-41ce-b3c1-67d45830034b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:31:39 user nova-compute[75080]: WARNING nova.compute.manager [req-24bd16b4-b0ae-4136-b6b1-ac6063781fce req-04c382ad-78f7-4077-a7ec-e8637c907cfc service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Received unexpected event network-vif-plugged-5b00d45c-4fed-41ce-b3c1-67d45830034b for instance with vm_state shelved_offloaded and task_state spawning.
Dec 05 15:31:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:31:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:31:40 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:31:40 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG nova.compute.manager [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG nova.compute.manager [req-59a6a6ce-27c7-4095-acce-d8c21469dfac req-6d11c1f4-e133-4d72-a173-e222897626a9 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Received event network-vif-plugged-5b00d45c-4fed-41ce-b3c1-67d45830034b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-59a6a6ce-27c7-4095-acce-d8c21469dfac req-6d11c1f4-e133-4d72-a173-e222897626a9 service nova] Acquiring lock "06d40106-075c-4b29-bfc5-a0224ece1d45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-59a6a6ce-27c7-4095-acce-d8c21469dfac req-6d11c1f4-e133-4d72-a173-e222897626a9 service nova] Lock "06d40106-075c-4b29-bfc5-a0224ece1d45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-59a6a6ce-27c7-4095-acce-d8c21469dfac req-6d11c1f4-e133-4d72-a173-e222897626a9 service nova] Lock "06d40106-075c-4b29-bfc5-a0224ece1d45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG nova.compute.manager [req-59a6a6ce-27c7-4095-acce-d8c21469dfac req-6d11c1f4-e133-4d72-a173-e222897626a9 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] No waiting events found dispatching network-vif-plugged-5b00d45c-4fed-41ce-b3c1-67d45830034b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:31:42 user nova-compute[75080]: WARNING nova.compute.manager [req-59a6a6ce-27c7-4095-acce-d8c21469dfac req-6d11c1f4-e133-4d72-a173-e222897626a9 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Received unexpected event network-vif-plugged-5b00d45c-4fed-41ce-b3c1-67d45830034b for instance with vm_state shelved_offloaded and task_state spawning.
Dec 05 15:31:42 user nova-compute[75080]: DEBUG nova.compute.manager [req-2de3e5fd-ad8a-449b-870e-237a1b8b4fb0 req-f1a74eee-1209-487a-9f8c-99b18bb4e9a2 service nova] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Received event network-changed-317f5115-d5c4-4bdd-8c6c-3c5900d15626 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG nova.compute.manager [req-2de3e5fd-ad8a-449b-870e-237a1b8b4fb0 req-f1a74eee-1209-487a-9f8c-99b18bb4e9a2 service nova] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Refreshing instance network info cache due to event network-changed-317f5115-d5c4-4bdd-8c6c-3c5900d15626. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2de3e5fd-ad8a-449b-870e-237a1b8b4fb0 req-f1a74eee-1209-487a-9f8c-99b18bb4e9a2 service nova] Acquiring lock "refresh_cache-c9836958-96d4-4b3e-a45c-fbb97846dbd4" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2de3e5fd-ad8a-449b-870e-237a1b8b4fb0 req-f1a74eee-1209-487a-9f8c-99b18bb4e9a2 service nova] Acquired lock "refresh_cache-c9836958-96d4-4b3e-a45c-fbb97846dbd4" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG nova.network.neutron [req-2de3e5fd-ad8a-449b-870e-237a1b8b4fb0 req-f1a74eee-1209-487a-9f8c-99b18bb4e9a2 service nova] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Refreshing network info cache for port 317f5115-d5c4-4bdd-8c6c-3c5900d15626 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c04a893b-c4a5-4bb2-a934-80dfd9c813ca tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Acquiring lock "c9836958-96d4-4b3e-a45c-fbb97846dbd4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c04a893b-c4a5-4bb2-a934-80dfd9c813ca tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "c9836958-96d4-4b3e-a45c-fbb97846dbd4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c04a893b-c4a5-4bb2-a934-80dfd9c813ca tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Acquiring lock "c9836958-96d4-4b3e-a45c-fbb97846dbd4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c04a893b-c4a5-4bb2-a934-80dfd9c813ca tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "c9836958-96d4-4b3e-a45c-fbb97846dbd4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c04a893b-c4a5-4bb2-a934-80dfd9c813ca tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "c9836958-96d4-4b3e-a45c-fbb97846dbd4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:31:42 user nova-compute[75080]: INFO nova.compute.manager [None req-c04a893b-c4a5-4bb2-a934-80dfd9c813ca tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Terminating instance
Dec 05 15:31:42 user nova-compute[75080]: DEBUG nova.compute.manager [None req-c04a893b-c4a5-4bb2-a934-80dfd9c813ca tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:31:42 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Instance spawned successfully.
Dec 05 15:31:42 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:31:42 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:31:42 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=8266MB free_disk=25.009719848632812GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Applying migration context for instance 308f6ec7-d5c1-46bf-95a4-036e1c192f7f as it has an incoming, in-progress migration a0da3b9d-b45d-4c81-b791-539fb331e53e. Migration status is finished {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Dec 05 15:31:42 user nova-compute[75080]: INFO nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Updating resource usage from migration a0da3b9d-b45d-4c81-b791-539fb331e53e
Dec 05 15:31:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance eedd1529-4feb-4f85-8625-0c20d8e0359d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 07b025ff-4a9d-48a2-b950-b8f2d165f33c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance c9836958-96d4-4b3e-a45c-fbb97846dbd4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance ab882db7-e6d7-44ca-9ea4-ae2fa68f7929 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 011d3446-577a-4f5c-b8f0-ef04940cad17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 40138071-fefc-4686-9344-7df255a1fc9d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Migration a0da3b9d-b45d-4c81-b791-539fb331e53e is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1712}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 308f6ec7-d5c1-46bf-95a4-036e1c192f7f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 06d40106-075c-4b29-bfc5-a0224ece1d45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance b47129e8-c02b-4107-af4f-329173dd453f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG nova.compute.manager [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG nova.compute.manager [req-a53ba9f5-1b04-4c47-bae6-fa6d35755035 req-7e6ade17-e80c-47b7-9986-1ca622367afc service nova] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Received event network-vif-unplugged-317f5115-d5c4-4bdd-8c6c-3c5900d15626 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a53ba9f5-1b04-4c47-bae6-fa6d35755035 req-7e6ade17-e80c-47b7-9986-1ca622367afc service nova] Acquiring lock "c9836958-96d4-4b3e-a45c-fbb97846dbd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a53ba9f5-1b04-4c47-bae6-fa6d35755035 req-7e6ade17-e80c-47b7-9986-1ca622367afc service nova] Lock "c9836958-96d4-4b3e-a45c-fbb97846dbd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a53ba9f5-1b04-4c47-bae6-fa6d35755035 req-7e6ade17-e80c-47b7-9986-1ca622367afc service nova] Lock "c9836958-96d4-4b3e-a45c-fbb97846dbd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG nova.compute.manager [req-a53ba9f5-1b04-4c47-bae6-fa6d35755035 req-7e6ade17-e80c-47b7-9986-1ca622367afc service nova] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] No waiting events found dispatching network-vif-unplugged-317f5115-d5c4-4bdd-8c6c-3c5900d15626 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG nova.compute.manager [req-a53ba9f5-1b04-4c47-bae6-fa6d35755035 req-7e6ade17-e80c-47b7-9986-1ca622367afc service nova] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Received event network-vif-unplugged-317f5115-d5c4-4bdd-8c6c-3c5900d15626 for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a6790724-9ed5-43d3-a5a9-290ae21032ad tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "06d40106-075c-4b29-bfc5-a0224ece1d45" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 24.464s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG nova.network.neutron [req-2de3e5fd-ad8a-449b-870e-237a1b8b4fb0 req-f1a74eee-1209-487a-9f8c-99b18bb4e9a2 service nova] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Updated VIF entry in instance network info cache for port 317f5115-d5c4-4bdd-8c6c-3c5900d15626. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG nova.network.neutron [req-2de3e5fd-ad8a-449b-870e-237a1b8b4fb0 req-f1a74eee-1209-487a-9f8c-99b18bb4e9a2 service nova] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Updating instance_info_cache with network_info: [{"id": "317f5115-d5c4-4bdd-8c6c-3c5900d15626", "address": "fa:16:3e:22:7d:71", "network": {"id": "60895755-a5e0-4195-ace1-7627829ca044", "bridge": "br-int", "label": "tempest-TestStampPattern-2093692741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc899a7995f64588957e55ca0129c812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap317f5115-d5", "ovs_interfaceid": "317f5115-d5c4-4bdd-8c6c-3c5900d15626", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2de3e5fd-ad8a-449b-870e-237a1b8b4fb0 req-f1a74eee-1209-487a-9f8c-99b18bb4e9a2 service nova] Releasing lock "refresh_cache-c9836958-96d4-4b3e-a45c-fbb97846dbd4" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.777s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:42 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Instance destroyed successfully.
Dec 05 15:31:42 user nova-compute[75080]: DEBUG nova.objects.instance [None req-c04a893b-c4a5-4bb2-a934-80dfd9c813ca tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lazy-loading 'resources' on Instance uuid c9836958-96d4-4b3e-a45c-fbb97846dbd4 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-c04a893b-c4a5-4bb2-a934-80dfd9c813ca tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:24:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1137844497',display_name='tempest-TestStampPattern-server-1137844497',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1137844497',id=22,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHAMA1CXZez7MdPSph5S9i392ZBdQjLqQOb8hqMfYY669vYgo8ML8BR0YzkdsvotEWD0HqSrUCtIg33ZSIHfujV9PM0Cii8jO16lDVcp4/zZGFDnycYQV610lx2OhuUeWQ==',key_name='tempest-TestStampPattern-113655159',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:24:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc899a7995f64588957e55ca0129c812',ramdisk_id='',reservation_id='r-stxf1p7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1734509700',owner_user_name='tempest-TestStampPattern-1734509700-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:27:42Z,user_data=None,user_id='3f34ec988b5943aeb8d3b5ae512cb417',uuid=c9836958-96d4-4b3e-a45c-fbb97846dbd4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "317f5115-d5c4-4bdd-8c6c-3c5900d15626", "address": "fa:16:3e:22:7d:71", "network": {"id": "60895755-a5e0-4195-ace1-7627829ca044", "bridge": "br-int", "label": "tempest-TestStampPattern-2093692741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc899a7995f64588957e55ca0129c812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap317f5115-d5", "ovs_interfaceid": "317f5115-d5c4-4bdd-8c6c-3c5900d15626", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c04a893b-c4a5-4bb2-a934-80dfd9c813ca tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Converting VIF {"id": "317f5115-d5c4-4bdd-8c6c-3c5900d15626", "address": "fa:16:3e:22:7d:71", "network": {"id": "60895755-a5e0-4195-ace1-7627829ca044", "bridge": "br-int", "label": "tempest-TestStampPattern-2093692741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc899a7995f64588957e55ca0129c812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap317f5115-d5", "ovs_interfaceid": "317f5115-d5c4-4bdd-8c6c-3c5900d15626", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c04a893b-c4a5-4bb2-a934-80dfd9c813ca tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:7d:71,bridge_name='br-int',has_traffic_filtering=True,id=317f5115-d5c4-4bdd-8c6c-3c5900d15626,network=Network(60895755-a5e0-4195-ace1-7627829ca044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap317f5115-d5') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG os_vif [None req-c04a893b-c4a5-4bb2-a934-80dfd9c813ca tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:7d:71,bridge_name='br-int',has_traffic_filtering=True,id=317f5115-d5c4-4bdd-8c6c-3c5900d15626,network=Network(60895755-a5e0-4195-ace1-7627829ca044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap317f5115-d5') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap317f5115-d5, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b4f59343-cb72-4047-a3d2-e585ba85603f) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:31:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:43 user nova-compute[75080]: INFO os_vif [None req-c04a893b-c4a5-4bb2-a934-80dfd9c813ca tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:7d:71,bridge_name='br-int',has_traffic_filtering=True,id=317f5115-d5c4-4bdd-8c6c-3c5900d15626,network=Network(60895755-a5e0-4195-ace1-7627829ca044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap317f5115-d5')
Dec 05 15:31:43 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-c04a893b-c4a5-4bb2-a934-80dfd9c813ca tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Deleting instance files /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4_del
Dec 05 15:31:43 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-c04a893b-c4a5-4bb2-a934-80dfd9c813ca tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Deletion of /opt/stack/data/nova/instances/c9836958-96d4-4b3e-a45c-fbb97846dbd4_del complete
Dec 05 15:31:43 user nova-compute[75080]: INFO nova.compute.manager [None req-c04a893b-c4a5-4bb2-a934-80dfd9c813ca tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Took 1.00 seconds to destroy the instance on the hypervisor.
Dec 05 15:31:43 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-c04a893b-c4a5-4bb2-a934-80dfd9c813ca tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:31:43 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:31:43 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:31:43 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:31:43 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Took 0.53 seconds to deallocate network for instance.
Dec 05 15:31:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c04a893b-c4a5-4bb2-a934-80dfd9c813ca tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:31:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c04a893b-c4a5-4bb2-a934-80dfd9c813ca tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:31:43 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:31:43 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:31:43 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:31:43 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:31:43 user nova-compute[75080]: DEBUG nova.compute.manager [req-6f4167c9-06dc-45fe-9f9c-c536d50ae1d8 req-a162fb34-42d4-4182-aefb-5e7efbf5587f service nova] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Received event network-vif-deleted-317f5115-d5c4-4bdd-8c6c-3c5900d15626 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:31:44 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-c04a893b-c4a5-4bb2-a934-80dfd9c813ca tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:31:44 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-c04a893b-c4a5-4bb2-a934-80dfd9c813ca tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:31:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c04a893b-c4a5-4bb2-a934-80dfd9c813ca tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:31:44 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-c04a893b-c4a5-4bb2-a934-80dfd9c813ca tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Deleted allocations for instance c9836958-96d4-4b3e-a45c-fbb97846dbd4
Dec 05 15:31:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c04a893b-c4a5-4bb2-a934-80dfd9c813ca tempest-TestStampPattern-1734509700 tempest-TestStampPattern-1734509700-project-member] Lock "c9836958-96d4-4b3e-a45c-fbb97846dbd4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.204s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:31:44 user nova-compute[75080]: DEBUG nova.compute.manager [req-ec9af09c-009f-4de2-a97e-84b9bce04c8f req-a5ebb677-884f-4801-9f39-55dba06c3514 service nova] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Received event network-vif-plugged-317f5115-d5c4-4bdd-8c6c-3c5900d15626 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:31:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-ec9af09c-009f-4de2-a97e-84b9bce04c8f req-a5ebb677-884f-4801-9f39-55dba06c3514 service nova] Acquiring lock "c9836958-96d4-4b3e-a45c-fbb97846dbd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:31:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-ec9af09c-009f-4de2-a97e-84b9bce04c8f req-a5ebb677-884f-4801-9f39-55dba06c3514 service nova] Lock "c9836958-96d4-4b3e-a45c-fbb97846dbd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:31:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-ec9af09c-009f-4de2-a97e-84b9bce04c8f req-a5ebb677-884f-4801-9f39-55dba06c3514 service nova] Lock "c9836958-96d4-4b3e-a45c-fbb97846dbd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:31:44 user nova-compute[75080]: DEBUG nova.compute.manager [req-ec9af09c-009f-4de2-a97e-84b9bce04c8f req-a5ebb677-884f-4801-9f39-55dba06c3514 service nova] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] No waiting events found dispatching network-vif-plugged-317f5115-d5c4-4bdd-8c6c-3c5900d15626 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:31:44 user nova-compute[75080]: WARNING nova.compute.manager [req-ec9af09c-009f-4de2-a97e-84b9bce04c8f req-a5ebb677-884f-4801-9f39-55dba06c3514 service nova] [instance: c9836958-96d4-4b3e-a45c-fbb97846dbd4] Received unexpected event network-vif-plugged-317f5115-d5c4-4bdd-8c6c-3c5900d15626 for instance with vm_state deleted and task_state None.
Dec 05 15:31:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:31:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:32:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:32:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:32:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:32:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:32:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:32:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:32:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:32:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:32:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:32:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:32:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:32:33 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:32:35 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:32:36 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:32:36 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:32:37 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:32:37 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:32:37 user nova-compute[75080]: DEBUG nova.objects.instance [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lazy-loading 'flavor' on Instance uuid 011d3446-577a-4f5c-b8f0-ef04940cad17 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:32:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "refresh_cache-011d3446-577a-4f5c-b8f0-ef04940cad17" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:32:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquired lock "refresh_cache-011d3446-577a-4f5c-b8f0-ef04940cad17" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:32:37 user nova-compute[75080]: DEBUG nova.network.neutron [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:32:37 user nova-compute[75080]: DEBUG nova.objects.instance [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lazy-loading 'info_cache' on Instance uuid 011d3446-577a-4f5c-b8f0-ef04940cad17 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:32:37 user nova-compute[75080]: DEBUG nova.objects.base [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Object Instance<011d3446-577a-4f5c-b8f0-ef04940cad17> lazy-loaded attributes: flavor,info_cache {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:32:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-ab882db7-e6d7-44ca-9ea4-ae2fa68f7929" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:32:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-ab882db7-e6d7-44ca-9ea4-ae2fa68f7929" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:32:37 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Updating instance_info_cache with network_info: [{"id": "af017697-07fb-4000-87d4-87f84dbd53bc", "address": "fa:16:3e:48:4c:fd", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf017697-07", "ovs_interfaceid": "af017697-07fb-4000-87d4-87f84dbd53bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-ab882db7-e6d7-44ca-9ea4-ae2fa68f7929" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG nova.network.neutron [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Updating instance_info_cache with network_info: [{"id": "dfee0a0e-5241-4d51-879d-7667bb06344b", "address": "fa:16:3e:be:d6:bd", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfee0a0e-52", "ovs_interfaceid": "dfee0a0e-5241-4d51-879d-7667bb06344b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Releasing lock "refresh_cache-011d3446-577a-4f5c-b8f0-ef04940cad17" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:32:38 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Instance destroyed successfully.
Dec 05 15:32:38 user nova-compute[75080]: DEBUG nova.objects.instance [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lazy-loading 'resources' on Instance uuid 011d3446-577a-4f5c-b8f0-ef04940cad17 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG nova.objects.base [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Object Instance<011d3446-577a-4f5c-b8f0-ef04940cad17> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:28:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-215552341',display_name='tempest-AttachVolumeTestJSON-server-215552341',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-215552341',id=28,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNR5WqP/N7bn4T+SXNEWvIjtaw5+s7Hk+R+FM8SRLh86FpF209SN9UyEjy0e1+2DKmJSUEmh664j9n8POCm+HUQ9EtbpXmMRPj40zHqJTQgREs+C9f2zqAuxq3d0+o2xbw==',key_name='tempest-keypair-1745876029',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:28:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a01b18b2a93b457c8e160447d44a673e',ramdisk_id='',reservation_id='r-oe6cj9ox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1911411330',owner_user_name='tempest-AttachVolumeTestJSON-1911411330-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:30:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a02caebbfe541209b87adcbf848ede6',uuid=011d3446-577a-4f5c-b8f0-ef04940cad17,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "dfee0a0e-5241-4d51-879d-7667bb06344b", "address": "fa:16:3e:be:d6:bd", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfee0a0e-52", "ovs_interfaceid": "dfee0a0e-5241-4d51-879d-7667bb06344b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Converting VIF {"id": "dfee0a0e-5241-4d51-879d-7667bb06344b", "address": "fa:16:3e:be:d6:bd", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfee0a0e-52", "ovs_interfaceid": "dfee0a0e-5241-4d51-879d-7667bb06344b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:d6:bd,bridge_name='br-int',has_traffic_filtering=True,id=dfee0a0e-5241-4d51-879d-7667bb06344b,network=Network(3037e443-f4eb-446e-8a80-53f409b02ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfee0a0e-52') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG os_vif [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:d6:bd,bridge_name='br-int',has_traffic_filtering=True,id=dfee0a0e-5241-4d51-879d-7667bb06344b,network=Network(3037e443-f4eb-446e-8a80-53f409b02ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfee0a0e-52') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfee0a0e-52, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=edcfe03b-9ac9-44c4-bc58-a73ec84fe265) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:32:38 user nova-compute[75080]: INFO os_vif [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:d6:bd,bridge_name='br-int',has_traffic_filtering=True,id=dfee0a0e-5241-4d51-879d-7667bb06344b,network=Network(3037e443-f4eb-446e-8a80-53f409b02ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfee0a0e-52')
Dec 05 15:32:38 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZlSAkpE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:32:38 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:32:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c86113-dbd4-4975-ae67-73787bac37a8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:32:38 user nova-compute[75080]: No targets found.
Dec 05 15:32:38 user nova-compute[75080]: iSNS:
Dec 05 15:32:38 user nova-compute[75080]: No targets found.
Dec 05 15:32:38 user nova-compute[75080]: STATIC:
Dec 05 15:32:38 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5
Dec 05 15:32:38 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:32:38 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:32:38 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315
Dec 05 15:32:38 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:32:38 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:32:38 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399
Dec 05 15:32:38 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:32:38 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:32:38 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0
Dec 05 15:32:38 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:32:38 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:32:38 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b
Dec 05 15:32:38 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:32:38 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:32:38 user nova-compute[75080]: FIRMWARE:
Dec 05 15:32:38 user nova-compute[75080]: No targets found.
Dec 05 15:32:38 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:32:38 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:32:38 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe8ef43-2ad7-4f93-aaf4-15aaf751a2c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e711f1aa-a7e9-46a9-aa55-ed7754fb87d6]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:32:38 user nova-compute[75080]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)
Dec 05 15:32:38 user nova-compute[75080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:32:38 user nova-compute[75080]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:32:38 user nova-compute[75080]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 (non-flash)
Dec 05 15:32:38 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:32:38 user nova-compute[75080]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)
Dec 05 15:32:38 user nova-compute[75080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:32:38 user nova-compute[75080]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:32:38 user nova-compute[75080]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 (non-flash)
Dec 05 15:32:38 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f665c44bac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0'): ({'sdb'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Removing single pathed devices sdb {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad767d4e-ddbb-4234-8dc1-ff04337115ab]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[abab2a74-6035-4ab5-908d-d5bc398b97a4]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Flushing IO for device /dev/sdb {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0f9417-fb4f-4456-b0e7-a56aa55da281]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a219ea9-0837-42a2-9b7d-c7109b90bded]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de63c3f-b1e1-4b22-be2c-1d7a3d128bba]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[976ce114-322f-43fb-80c1-21bd17831d57]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0, portal: 172.16.0.220,3260]
Dec 05 15:32:38 user nova-compute[75080]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0, portal: 172.16.0.220,3260] successful.
Dec 05 15:32:38 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a2a9ce-74e4-44b6-a55f-e6ef363c336a]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] <== disconnect_volume: return (350ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Start _get_guest_xml network_info=[{"id": "dfee0a0e-5241-4d51-879d-7667bb06344b", "address": "fa:16:3e:be:d6:bd", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfee0a0e-52", "ovs_interfaceid": "dfee0a0e-5241-4d51-879d-7667bb06344b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZlSAkpE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '011d3446-577a-4f5c-b8f0-ef04940cad17', 'attached_at': '', 'detached_at': '', 'volume_id': '37794663-c414-4d76-8796-5c6c60f5efb0', 'serial': '37794663-c414-4d76-8796-5c6c60f5efb0'}, 'device_type': 'disk', 'attachment_id': '07c9514d-71b6-4fc7-977e-efc713dfcfde', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG nova.objects.instance [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lazy-loading 'numa_topology' on Instance uuid 011d3446-577a-4f5c-b8f0-ef04940cad17 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG nova.objects.base [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Object Instance<011d3446-577a-4f5c-b8f0-ef04940cad17> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:32:38 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:32:38 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:32:38 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG nova.objects.instance [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lazy-loading 'vcpu_model' on Instance uuid 011d3446-577a-4f5c-b8f0-ef04940cad17 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG nova.objects.base [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Object Instance<011d3446-577a-4f5c-b8f0-ef04940cad17> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZlSAkpE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:32:38 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:32:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:32:38 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:32:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:32:38 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f4951d-242e-49be-9398-4d33bc882aba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:32:38 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7bf886-d834-4b8f-9c14-a9b39e5e508f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0] added
Dec 05 15:32:38 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9366ad-259d-4d0e-bed3-4e214914fea9]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:32:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[38df136d-b167-416f-b5fd-30c2b929d5ec]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WZlSAkpE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WZlSAkpE" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2cea07-9e77-4fb8-972c-0f12e796c41c]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WZlSAkpE'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c574bfb1-c15c-4dca-ae14-d64d957e6037]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7289f66-3dfe-4bea-a1f7-7200efec859a]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:32:39 user nova-compute[75080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:32:39 user nova-compute[75080]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:32:39 user nova-compute[75080]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 (non-flash)
Dec 05 15:32:39 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:32:39 user nova-compute[75080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:32:39 user nova-compute[75080]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:32:39 user nova-compute[75080]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 (non-flash)
Dec 05 15:32:39 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52631f9-30b2-41b8-a15c-88a69bdd3bbf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0, portal: 172.16.0.220,3260]
Dec 05 15:32:39 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0, portal: 172.16.0.220,3260] successful.
Dec 05 15:32:39 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6808142-5982-4215-8233-0a373a45c585]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[df35bd8b-6019-4e24-a4e7-df0e9e854e0f]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:32:39 user nova-compute[75080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:32:39 user nova-compute[75080]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:32:39 user nova-compute[75080]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 (non-flash)
Dec 05 15:32:39 user nova-compute[75080]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)
Dec 05 15:32:39 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:32:39 user nova-compute[75080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:32:39 user nova-compute[75080]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:32:39 user nova-compute[75080]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 (non-flash)
Dec 05 15:32:39 user nova-compute[75080]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)
Dec 05 15:32:39 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c14e0a-c76e-4e03-b7eb-a78c5cb5b7c7]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: None {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:32:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:32:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:32:40 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:32:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:32:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:32:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:32:40 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:32:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZlSAkpE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:32:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:32:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23631323463326530', 'path': '/dev/sdb'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:32:40 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631323463326530', 'path': '/dev/sdb'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:32:40 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:28:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-215552341',display_name='tempest-AttachVolumeTestJSON-server-215552341',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-215552341',id=28,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNR5WqP/N7bn4T+SXNEWvIjtaw5+s7Hk+R+FM8SRLh86FpF209SN9UyEjy0e1+2DKmJSUEmh664j9n8POCm+HUQ9EtbpXmMRPj40zHqJTQgREs+C9f2zqAuxq3d0+o2xbw==',key_name='tempest-keypair-1745876029',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:28:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a01b18b2a93b457c8e160447d44a673e',ramdisk_id='',reservation_id='r-oe6cj9ox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1911411330',owner_user_name='tempest-AttachVolumeTestJSON-1911411330-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:30:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a02caebbfe541209b87adcbf848ede6',uuid=011d3446-577a-4f5c-b8f0-ef04940cad17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "dfee0a0e-5241-4d51-879d-7667bb06344b", "address": "fa:16:3e:be:d6:bd", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfee0a0e-52", "ovs_interfaceid": "dfee0a0e-5241-4d51-879d-7667bb06344b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:32:40 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Converting VIF {"id": "dfee0a0e-5241-4d51-879d-7667bb06344b", "address": "fa:16:3e:be:d6:bd", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfee0a0e-52", "ovs_interfaceid": "dfee0a0e-5241-4d51-879d-7667bb06344b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:32:40 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:d6:bd,bridge_name='br-int',has_traffic_filtering=True,id=dfee0a0e-5241-4d51-879d-7667bb06344b,network=Network(3037e443-f4eb-446e-8a80-53f409b02ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfee0a0e-52') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:32:40 user nova-compute[75080]: DEBUG nova.objects.instance [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lazy-loading 'pci_devices' on Instance uuid 011d3446-577a-4f5c-b8f0-ef04940cad17 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:32:40 user nova-compute[75080]: DEBUG nova.objects.base [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Object Instance<011d3446-577a-4f5c-b8f0-ef04940cad17> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:32:40 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:32:40 user nova-compute[75080]:   <uuid>011d3446-577a-4f5c-b8f0-ef04940cad17</uuid>
Dec 05 15:32:40 user nova-compute[75080]:   <name>instance-0000001c</name>
Dec 05 15:32:40 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:32:40 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:32:40 user nova-compute[75080]:   <metadata>
Dec 05 15:32:40 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:32:40 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:32:40 user nova-compute[75080]:       <nova:name>tempest-AttachVolumeTestJSON-server-215552341</nova:name>
Dec 05 15:32:40 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:32:38</nova:creationTime>
Dec 05 15:32:40 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:32:40 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:32:40 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:32:40 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:32:40 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:32:40 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:32:40 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:32:40 user nova-compute[75080]:       <nova:owner>
Dec 05 15:32:40 user nova-compute[75080]:         <nova:user uuid="7a02caebbfe541209b87adcbf848ede6">tempest-AttachVolumeTestJSON-1911411330-project-member</nova:user>
Dec 05 15:32:40 user nova-compute[75080]:         <nova:project uuid="a01b18b2a93b457c8e160447d44a673e">tempest-AttachVolumeTestJSON-1911411330</nova:project>
Dec 05 15:32:40 user nova-compute[75080]:       </nova:owner>
Dec 05 15:32:40 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:32:40 user nova-compute[75080]:       <nova:ports>
Dec 05 15:32:40 user nova-compute[75080]:         <nova:port uuid="dfee0a0e-5241-4d51-879d-7667bb06344b">
Dec 05 15:32:40 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 05 15:32:40 user nova-compute[75080]:         </nova:port>
Dec 05 15:32:40 user nova-compute[75080]:       </nova:ports>
Dec 05 15:32:40 user nova-compute[75080]:     </nova:instance>
Dec 05 15:32:40 user nova-compute[75080]:   </metadata>
Dec 05 15:32:40 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:32:40 user nova-compute[75080]:     <system>
Dec 05 15:32:40 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:32:40 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:32:40 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:32:40 user nova-compute[75080]:       <entry name="serial">011d3446-577a-4f5c-b8f0-ef04940cad17</entry>
Dec 05 15:32:40 user nova-compute[75080]:       <entry name="uuid">011d3446-577a-4f5c-b8f0-ef04940cad17</entry>
Dec 05 15:32:40 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:32:40 user nova-compute[75080]:     </system>
Dec 05 15:32:40 user nova-compute[75080]:   </sysinfo>
Dec 05 15:32:40 user nova-compute[75080]:   <os>
Dec 05 15:32:40 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:32:40 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:32:40 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:32:40 user nova-compute[75080]:   </os>
Dec 05 15:32:40 user nova-compute[75080]:   <features>
Dec 05 15:32:40 user nova-compute[75080]:     <acpi/>
Dec 05 15:32:40 user nova-compute[75080]:     <apic/>
Dec 05 15:32:40 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:32:40 user nova-compute[75080]:   </features>
Dec 05 15:32:40 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:32:40 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:32:40 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:32:40 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:32:40 user nova-compute[75080]:   </clock>
Dec 05 15:32:40 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:32:40 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:32:40 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:32:40 user nova-compute[75080]:   </cpu>
Dec 05 15:32:40 user nova-compute[75080]:   <devices>
Dec 05 15:32:40 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:32:40 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:32:40 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk"/>
Dec 05 15:32:40 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:32:40 user nova-compute[75080]:     </disk>
Dec 05 15:32:40 user nova-compute[75080]:     <disk type="block" device="disk">
Dec 05 15:32:40 user nova-compute[75080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:32:40 user nova-compute[75080]:       <source dev="/dev/sdb"/>
Dec 05 15:32:40 user nova-compute[75080]:       <target dev="vdb" bus="virtio"/>
Dec 05 15:32:40 user nova-compute[75080]:       <serial>37794663-c414-4d76-8796-5c6c60f5efb0</serial>
Dec 05 15:32:40 user nova-compute[75080]:     </disk>
Dec 05 15:32:40 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:32:40 user nova-compute[75080]:       <mac address="fa:16:3e:be:d6:bd"/>
Dec 05 15:32:40 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:32:40 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:32:40 user nova-compute[75080]:       <target dev="tapdfee0a0e-52"/>
Dec 05 15:32:40 user nova-compute[75080]:     </interface>
Dec 05 15:32:40 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:32:40 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/console.log" append="off"/>
Dec 05 15:32:40 user nova-compute[75080]:     </serial>
Dec 05 15:32:40 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:32:40 user nova-compute[75080]:     <video>
Dec 05 15:32:40 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:32:40 user nova-compute[75080]:     </video>
Dec 05 15:32:40 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:32:40 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:32:40 user nova-compute[75080]:     </rng>
Dec 05 15:32:40 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:32:40 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:32:40 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:32:40 user nova-compute[75080]:     </memballoon>
Dec 05 15:32:40 user nova-compute[75080]:   </devices>
Dec 05 15:32:40 user nova-compute[75080]: </domain>
Dec 05 15:32:40 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:32:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:32:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:32:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:32:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:32:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:32:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:32:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:32:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:32:40 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:32:40 user nova-compute[75080]: DEBUG nova.objects.instance [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lazy-loading 'trusted_certs' on Instance uuid 011d3446-577a-4f5c-b8f0-ef04940cad17 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:32:40 user nova-compute[75080]: DEBUG nova.objects.base [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Object Instance<011d3446-577a-4f5c-b8f0-ef04940cad17> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:32:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:32:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:32:40 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:32:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:32:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.180s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:32:40 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Checking if we can resize image /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 15:32:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:32:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:32:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:32:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:32:41 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Cannot resize image /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 15:32:41 user nova-compute[75080]: DEBUG nova.objects.instance [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lazy-loading 'migration_context' on Instance uuid 011d3446-577a-4f5c-b8f0-ef04940cad17 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:32:41 user nova-compute[75080]: DEBUG nova.objects.base [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Object Instance<011d3446-577a-4f5c-b8f0-ef04940cad17> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:32:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:28:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-215552341',display_name='tempest-AttachVolumeTestJSON-server-215552341',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-215552341',id=28,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNR5WqP/N7bn4T+SXNEWvIjtaw5+s7Hk+R+FM8SRLh86FpF209SN9UyEjy0e1+2DKmJSUEmh664j9n8POCm+HUQ9EtbpXmMRPj40zHqJTQgREs+C9f2zqAuxq3d0+o2xbw==',key_name='tempest-keypair-1745876029',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:28:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='a01b18b2a93b457c8e160447d44a673e',ramdisk_id='',reservation_id='r-oe6cj9ox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1911411330',owner_user_name='tempest-AttachVolumeTestJSON-1911411330-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:30:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a02caebbfe541209b87adcbf848ede6',uuid=011d3446-577a-4f5c-b8f0-ef04940cad17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "dfee0a0e-5241-4d51-879d-7667bb06344b", "address": "fa:16:3e:be:d6:bd", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfee0a0e-52", "ovs_interfaceid": "dfee0a0e-5241-4d51-879d-7667bb06344b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:32:41 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Converting VIF {"id": "dfee0a0e-5241-4d51-879d-7667bb06344b", "address": "fa:16:3e:be:d6:bd", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfee0a0e-52", "ovs_interfaceid": "dfee0a0e-5241-4d51-879d-7667bb06344b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:32:41 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:d6:bd,bridge_name='br-int',has_traffic_filtering=True,id=dfee0a0e-5241-4d51-879d-7667bb06344b,network=Network(3037e443-f4eb-446e-8a80-53f409b02ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfee0a0e-52') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:32:41 user nova-compute[75080]: DEBUG os_vif [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:d6:bd,bridge_name='br-int',has_traffic_filtering=True,id=dfee0a0e-5241-4d51-879d-7667bb06344b,network=Network(3037e443-f4eb-446e-8a80-53f409b02ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfee0a0e-52') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:32:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:32:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:32:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:32:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:32:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c37e27ee-77ec-598d-b20d-199d1e8f87a2', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:32:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:32:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:32:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfee0a0e-52, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:32:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdfee0a0e-52, col_values=(('qos', UUID('38978b54-719c-454b-b260-5f2173ba4f50')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:32:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdfee0a0e-52, col_values=(('external_ids', {'iface-id': 'dfee0a0e-5241-4d51-879d-7667bb06344b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:d6:bd', 'vm-uuid': '011d3446-577a-4f5c-b8f0-ef04940cad17'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:32:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:32:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:32:41 user nova-compute[75080]: INFO os_vif [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:d6:bd,bridge_name='br-int',has_traffic_filtering=True,id=dfee0a0e-5241-4d51-879d-7667bb06344b,network=Network(3037e443-f4eb-446e-8a80-53f409b02ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfee0a0e-52')
Dec 05 15:32:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:32:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:32:45 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:32:45 user nova-compute[75080]: DEBUG nova.compute.manager [req-3158f9f9-b89f-4d61-9dd4-2484a7ea13f1 req-19fc2057-3d71-4b54-8fd3-2081035796a0 service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Received event network-vif-plugged-dfee0a0e-5241-4d51-879d-7667bb06344b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:32:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-3158f9f9-b89f-4d61-9dd4-2484a7ea13f1 req-19fc2057-3d71-4b54-8fd3-2081035796a0 service nova] Acquiring lock "011d3446-577a-4f5c-b8f0-ef04940cad17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:32:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-3158f9f9-b89f-4d61-9dd4-2484a7ea13f1 req-19fc2057-3d71-4b54-8fd3-2081035796a0 service nova] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:32:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-3158f9f9-b89f-4d61-9dd4-2484a7ea13f1 req-19fc2057-3d71-4b54-8fd3-2081035796a0 service nova] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:32:45 user nova-compute[75080]: DEBUG nova.compute.manager [req-3158f9f9-b89f-4d61-9dd4-2484a7ea13f1 req-19fc2057-3d71-4b54-8fd3-2081035796a0 service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] No waiting events found dispatching network-vif-plugged-dfee0a0e-5241-4d51-879d-7667bb06344b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:32:45 user nova-compute[75080]: WARNING nova.compute.manager [req-3158f9f9-b89f-4d61-9dd4-2484a7ea13f1 req-19fc2057-3d71-4b54-8fd3-2081035796a0 service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Received unexpected event network-vif-plugged-dfee0a0e-5241-4d51-879d-7667bb06344b for instance with vm_state stopped and task_state powering-on.
Dec 05 15:32:45 user nova-compute[75080]: DEBUG nova.compute.manager [req-f19de989-dd3b-4f2d-8b8c-b3f27368523f req-e4303781-7d22-4165-8ec4-739f6aac5cc1 service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Received event network-vif-plugged-dfee0a0e-5241-4d51-879d-7667bb06344b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:32:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f19de989-dd3b-4f2d-8b8c-b3f27368523f req-e4303781-7d22-4165-8ec4-739f6aac5cc1 service nova] Acquiring lock "011d3446-577a-4f5c-b8f0-ef04940cad17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:32:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f19de989-dd3b-4f2d-8b8c-b3f27368523f req-e4303781-7d22-4165-8ec4-739f6aac5cc1 service nova] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:32:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f19de989-dd3b-4f2d-8b8c-b3f27368523f req-e4303781-7d22-4165-8ec4-739f6aac5cc1 service nova] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:32:45 user nova-compute[75080]: DEBUG nova.compute.manager [req-f19de989-dd3b-4f2d-8b8c-b3f27368523f req-e4303781-7d22-4165-8ec4-739f6aac5cc1 service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] No waiting events found dispatching network-vif-plugged-dfee0a0e-5241-4d51-879d-7667bb06344b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:32:45 user nova-compute[75080]: WARNING nova.compute.manager [req-f19de989-dd3b-4f2d-8b8c-b3f27368523f req-e4303781-7d22-4165-8ec4-739f6aac5cc1 service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Received unexpected event network-vif-plugged-dfee0a0e-5241-4d51-879d-7667bb06344b for instance with vm_state stopped and task_state powering-on.
Dec 05 15:32:45 user nova-compute[75080]: DEBUG nova.compute.manager [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:32:45 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Instance rebooted successfully.
Dec 05 15:32:45 user nova-compute[75080]: DEBUG nova.compute.manager [None req-df1c2247-a13b-4381-8b3e-72ab85ee1be3 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:32:45 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:32:45 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:32:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=8030MB free_disk=25.093978881835938GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:32:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:32:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:32:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Applying migration context for instance 308f6ec7-d5c1-46bf-95a4-036e1c192f7f as it has an incoming, in-progress migration a0da3b9d-b45d-4c81-b791-539fb331e53e. Migration status is finished {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Dec 05 15:32:45 user nova-compute[75080]: INFO nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Updating resource usage from migration a0da3b9d-b45d-4c81-b791-539fb331e53e
Dec 05 15:32:45 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:32:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance eedd1529-4feb-4f85-8625-0c20d8e0359d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:32:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 07b025ff-4a9d-48a2-b950-b8f2d165f33c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:32:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance ab882db7-e6d7-44ca-9ea4-ae2fa68f7929 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:32:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 011d3446-577a-4f5c-b8f0-ef04940cad17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:32:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 40138071-fefc-4686-9344-7df255a1fc9d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:32:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Migration a0da3b9d-b45d-4c81-b791-539fb331e53e is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1712}}
Dec 05 15:32:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 308f6ec7-d5c1-46bf-95a4-036e1c192f7f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:32:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 06d40106-075c-4b29-bfc5-a0224ece1d45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:32:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance b47129e8-c02b-4107-af4f-329173dd453f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:32:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:32:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:32:45 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:32:45 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:32:45 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:32:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:32:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.568s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:32:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:32:46 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:32:46 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:32:46 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:32:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:32:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:32:49 user nova-compute[75080]: DEBUG nova.compute.manager [req-fadb52ba-7be4-4990-923e-77adff978021 req-ada6acd3-3e3b-4519-9d67-394755b2f7a9 service nova] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Received event network-changed-022ecfdd-eb21-4d23-8f7d-d993577809e3 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:32:49 user nova-compute[75080]: DEBUG nova.compute.manager [req-fadb52ba-7be4-4990-923e-77adff978021 req-ada6acd3-3e3b-4519-9d67-394755b2f7a9 service nova] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Refreshing instance network info cache due to event network-changed-022ecfdd-eb21-4d23-8f7d-d993577809e3. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:32:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-fadb52ba-7be4-4990-923e-77adff978021 req-ada6acd3-3e3b-4519-9d67-394755b2f7a9 service nova] Acquiring lock "refresh_cache-40138071-fefc-4686-9344-7df255a1fc9d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:32:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-fadb52ba-7be4-4990-923e-77adff978021 req-ada6acd3-3e3b-4519-9d67-394755b2f7a9 service nova] Acquired lock "refresh_cache-40138071-fefc-4686-9344-7df255a1fc9d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:32:49 user nova-compute[75080]: DEBUG nova.network.neutron [req-fadb52ba-7be4-4990-923e-77adff978021 req-ada6acd3-3e3b-4519-9d67-394755b2f7a9 service nova] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Refreshing network info cache for port 022ecfdd-eb21-4d23-8f7d-d993577809e3 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:32:49 user nova-compute[75080]: DEBUG nova.network.neutron [req-fadb52ba-7be4-4990-923e-77adff978021 req-ada6acd3-3e3b-4519-9d67-394755b2f7a9 service nova] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Updated VIF entry in instance network info cache for port 022ecfdd-eb21-4d23-8f7d-d993577809e3. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:32:49 user nova-compute[75080]: DEBUG nova.network.neutron [req-fadb52ba-7be4-4990-923e-77adff978021 req-ada6acd3-3e3b-4519-9d67-394755b2f7a9 service nova] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Updating instance_info_cache with network_info: [{"id": "022ecfdd-eb21-4d23-8f7d-d993577809e3", "address": "fa:16:3e:f2:a5:2b", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022ecfdd-eb", "ovs_interfaceid": "022ecfdd-eb21-4d23-8f7d-d993577809e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:32:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-fadb52ba-7be4-4990-923e-77adff978021 req-ada6acd3-3e3b-4519-9d67-394755b2f7a9 service nova] Releasing lock "refresh_cache-40138071-fefc-4686-9344-7df255a1fc9d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:32:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:32:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:32:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:32:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:32:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "809b8f18-c3a3-4a06-878a-6c4694dc7547" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:32:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "809b8f18-c3a3-4a06-878a-6c4694dc7547" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:32:59 user nova-compute[75080]: DEBUG nova.compute.manager [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:32:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:32:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:32:59 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:32:59 user nova-compute[75080]: INFO nova.compute.claims [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Claim successful on node user
Dec 05 15:33:00 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:33:00 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:33:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.472s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:33:00 user nova-compute[75080]: DEBUG nova.compute.manager [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:33:00 user nova-compute[75080]: DEBUG nova.compute.manager [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:33:00 user nova-compute[75080]: DEBUG nova.network.neutron [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:33:00 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:33:00 user nova-compute[75080]: DEBUG nova.compute.manager [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:33:00 user nova-compute[75080]: DEBUG nova.policy [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '15be5b54cc8346bb86683e4ed2fbba9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11227acd507347ae9c5a3bc710707f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:33:00 user nova-compute[75080]: INFO nova.virt.block_device [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Booting with volume d39d2954-223d-4744-b22e-bf29d049ab20 at /dev/vda
Dec 05 15:33:00 user nova-compute[75080]: DEBUG os_brick.utils [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:33:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:00 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5aaff4-36e6-4fc8-bbe4-ebe499de0e8a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:33:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:00 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8520ce-b1ff-46c7-b05a-20af48a695eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:33:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:00 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f0b3b1-15e7-42f5-b364-1973571b7fdf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:33:00 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[804f4dbf-0445-4551-8c7d-f7da38d8c084]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:33:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:33:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:33:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:33:00 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:33:00 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75846fc-835f-46f9-84aa-53098210bb9f]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:33:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:33:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:33:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:33:00 user nova-compute[75080]: DEBUG os_brick.utils [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:33:00 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Updating existing volume attachment record: 1931f64c-2049-4bc9-a1fb-7f1123033f21 {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:33:01 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:01 user nova-compute[75080]: DEBUG nova.network.neutron [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Successfully created port: 03461529-412e-4039-b713-4a170c38698e {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:33:01 user nova-compute[75080]: DEBUG nova.network.neutron [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Successfully updated port: 03461529-412e-4039-b713-4a170c38698e {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:33:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "refresh_cache-809b8f18-c3a3-4a06-878a-6c4694dc7547" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:33:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquired lock "refresh_cache-809b8f18-c3a3-4a06-878a-6c4694dc7547" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:33:01 user nova-compute[75080]: DEBUG nova.network.neutron [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:33:02 user nova-compute[75080]: DEBUG nova.compute.manager [req-bfd75313-b492-46a2-8111-e05403e382b1 req-b949920c-0a18-4ac3-a818-8ca04e69f8c4 service nova] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Received event network-changed-03461529-412e-4039-b713-4a170c38698e {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:33:02 user nova-compute[75080]: DEBUG nova.compute.manager [req-bfd75313-b492-46a2-8111-e05403e382b1 req-b949920c-0a18-4ac3-a818-8ca04e69f8c4 service nova] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Refreshing instance network info cache due to event network-changed-03461529-412e-4039-b713-4a170c38698e. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:33:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-bfd75313-b492-46a2-8111-e05403e382b1 req-b949920c-0a18-4ac3-a818-8ca04e69f8c4 service nova] Acquiring lock "refresh_cache-809b8f18-c3a3-4a06-878a-6c4694dc7547" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:33:02 user nova-compute[75080]: DEBUG nova.network.neutron [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:33:02 user nova-compute[75080]: DEBUG nova.network.neutron [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Updating instance_info_cache with network_info: [{"id": "03461529-412e-4039-b713-4a170c38698e", "address": "fa:16:3e:06:0b:05", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03461529-41", "ovs_interfaceid": "03461529-412e-4039-b713-4a170c38698e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:33:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Releasing lock "refresh_cache-809b8f18-c3a3-4a06-878a-6c4694dc7547" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:33:02 user nova-compute[75080]: DEBUG nova.compute.manager [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Instance network_info: |[{"id": "03461529-412e-4039-b713-4a170c38698e", "address": "fa:16:3e:06:0b:05", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03461529-41", "ovs_interfaceid": "03461529-412e-4039-b713-4a170c38698e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:33:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-bfd75313-b492-46a2-8111-e05403e382b1 req-b949920c-0a18-4ac3-a818-8ca04e69f8c4 service nova] Acquired lock "refresh_cache-809b8f18-c3a3-4a06-878a-6c4694dc7547" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:33:02 user nova-compute[75080]: DEBUG nova.network.neutron [req-bfd75313-b492-46a2-8111-e05403e382b1 req-b949920c-0a18-4ac3-a818-8ca04e69f8c4 service nova] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Refreshing network info cache for port 03461529-412e-4039-b713-4a170c38698e {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:33:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:02 user nova-compute[75080]: DEBUG nova.network.neutron [req-bfd75313-b492-46a2-8111-e05403e382b1 req-b949920c-0a18-4ac3-a818-8ca04e69f8c4 service nova] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Updated VIF entry in instance network info cache for port 03461529-412e-4039-b713-4a170c38698e. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:33:02 user nova-compute[75080]: DEBUG nova.network.neutron [req-bfd75313-b492-46a2-8111-e05403e382b1 req-b949920c-0a18-4ac3-a818-8ca04e69f8c4 service nova] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Updating instance_info_cache with network_info: [{"id": "03461529-412e-4039-b713-4a170c38698e", "address": "fa:16:3e:06:0b:05", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03461529-41", "ovs_interfaceid": "03461529-412e-4039-b713-4a170c38698e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:33:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-bfd75313-b492-46a2-8111-e05403e382b1 req-b949920c-0a18-4ac3-a818-8ca04e69f8c4 service nova] Releasing lock "refresh_cache-809b8f18-c3a3-4a06-878a-6c4694dc7547" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:33:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ed3395c6-8d30-44a2-868c-168ac240bb47 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:33:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ed3395c6-8d30-44a2-868c-168ac240bb47 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:33:05 user nova-compute[75080]: DEBUG nova.compute.manager [None req-ed3395c6-8d30-44a2-868c-168ac240bb47 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Going to confirm migration 2 {{(pid=75080) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Dec 05 15:33:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ed3395c6-8d30-44a2-868c-168ac240bb47 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "refresh_cache-308f6ec7-d5c1-46bf-95a4-036e1c192f7f" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:33:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ed3395c6-8d30-44a2-868c-168ac240bb47 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquired lock "refresh_cache-308f6ec7-d5c1-46bf-95a4-036e1c192f7f" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:33:06 user nova-compute[75080]: DEBUG nova.network.neutron [None req-ed3395c6-8d30-44a2-868c-168ac240bb47 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:33:06 user nova-compute[75080]: DEBUG nova.objects.instance [None req-ed3395c6-8d30-44a2-868c-168ac240bb47 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lazy-loading 'info_cache' on Instance uuid 308f6ec7-d5c1-46bf-95a4-036e1c192f7f {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:33:06 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:06 user nova-compute[75080]: DEBUG nova.network.neutron [None req-ed3395c6-8d30-44a2-868c-168ac240bb47 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Updating instance_info_cache with network_info: [{"id": "ae56b484-8712-4d95-aa9f-686b40d2619f", "address": "fa:16:3e:28:be:b7", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae56b484-87", "ovs_interfaceid": "ae56b484-8712-4d95-aa9f-686b40d2619f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:33:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ed3395c6-8d30-44a2-868c-168ac240bb47 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Releasing lock "refresh_cache-308f6ec7-d5c1-46bf-95a4-036e1c192f7f" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:33:06 user nova-compute[75080]: DEBUG nova.objects.instance [None req-ed3395c6-8d30-44a2-868c-168ac240bb47 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lazy-loading 'migration_context' on Instance uuid 308f6ec7-d5c1-46bf-95a4-036e1c192f7f {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:33:06 user nova-compute[75080]: DEBUG nova.objects.base [None req-ed3395c6-8d30-44a2-868c-168ac240bb47 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Object Instance<308f6ec7-d5c1-46bf-95a4-036e1c192f7f> lazy-loaded attributes: info_cache,migration_context {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:33:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ed3395c6-8d30-44a2-868c-168ac240bb47 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:33:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ed3395c6-8d30-44a2-868c-168ac240bb47 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:33:06 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-ed3395c6-8d30-44a2-868c-168ac240bb47 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:33:07 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-ed3395c6-8d30-44a2-868c-168ac240bb47 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:33:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ed3395c6-8d30-44a2-868c-168ac240bb47 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.510s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:33:07 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-ed3395c6-8d30-44a2-868c-168ac240bb47 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Deleted allocation for migration a0da3b9d-b45d-4c81-b791-539fb331e53e
Dec 05 15:33:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ed3395c6-8d30-44a2-868c-168ac240bb47 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.506s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:33:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f3bd088c-c9e4-4047-812e-73d2b093572d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "06d40106-075c-4b29-bfc5-a0224ece1d45" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:33:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f3bd088c-c9e4-4047-812e-73d2b093572d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "06d40106-075c-4b29-bfc5-a0224ece1d45" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:33:08 user nova-compute[75080]: INFO nova.compute.manager [None req-f3bd088c-c9e4-4047-812e-73d2b093572d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Detaching volume 37bf152b-3fc7-42e2-a431-c1df7895b315
Dec 05 15:33:08 user nova-compute[75080]: INFO nova.virt.block_device [None req-f3bd088c-c9e4-4047-812e-73d2b093572d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Attempting to driver detach volume 37bf152b-3fc7-42e2-a431-c1df7895b315 from mountpoint /dev/vdc
Dec 05 15:33:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-f3bd088c-c9e4-4047-812e-73d2b093572d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Attempting to detach device vdc from instance 06d40106-075c-4b29-bfc5-a0224ece1d45 from the persistent domain config. {{(pid=75080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 15:33:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-f3bd088c-c9e4-4047-812e-73d2b093572d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:33:08 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:33:08 user nova-compute[75080]:   <source dev="/dev/sde"/>
Dec 05 15:33:08 user nova-compute[75080]:   <target dev="vdc" bus="virtio"/>
Dec 05 15:33:08 user nova-compute[75080]:   <serial>37bf152b-3fc7-42e2-a431-c1df7895b315</serial>
Dec 05 15:33:08 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 05 15:33:08 user nova-compute[75080]: </disk>
Dec 05 15:33:08 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:33:08 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-f3bd088c-c9e4-4047-812e-73d2b093572d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Successfully detached device vdc from instance 06d40106-075c-4b29-bfc5-a0224ece1d45 from the persistent domain config.
Dec 05 15:33:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-f3bd088c-c9e4-4047-812e-73d2b093572d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 06d40106-075c-4b29-bfc5-a0224ece1d45 from the live domain config. {{(pid=75080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 15:33:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-f3bd088c-c9e4-4047-812e-73d2b093572d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:33:08 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:33:08 user nova-compute[75080]:   <source dev="/dev/sde"/>
Dec 05 15:33:08 user nova-compute[75080]:   <target dev="vdc" bus="virtio"/>
Dec 05 15:33:08 user nova-compute[75080]:   <serial>37bf152b-3fc7-42e2-a431-c1df7895b315</serial>
Dec 05 15:33:08 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 05 15:33:08 user nova-compute[75080]: </disk>
Dec 05 15:33:08 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:33:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-f3bd088c-c9e4-4047-812e-73d2b093572d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 06d40106-075c-4b29-bfc5-a0224ece1d45 {{(pid=75080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 15:33:11 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG nova.compute.manager [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:33:12 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Creating image(s)
Dec 05 15:33:12 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Did not create local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Ensure instance console log exists: /opt/stack/data/nova/instances/809b8f18-c3a3-4a06-878a-6c4694dc7547/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Start _get_guest_xml network_info=[{"id": "03461529-412e-4039-b713-4a170c38698e", "address": "fa:16:3e:06:0b:05", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03461529-41", "ovs_interfaceid": "03461529-412e-4039-b713-4a170c38698e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'REwJMSmY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '809b8f18-c3a3-4a06-878a-6c4694dc7547', 'attached_at': '', 'detached_at': '', 'volume_id': 'd39d2954-223d-4744-b22e-bf29d049ab20', 'serial': 'd39d2954-223d-4744-b22e-bf29d049ab20'}, 'device_type': 'disk', 'attachment_id': '1931f64c-2049-4bc9-a1fb-7f1123033f21', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:33:12 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:33:12 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:33:12 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'REwJMSmY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:33:12 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:33:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:33:12 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:33:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:33:12 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:33:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20 -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d92a7d-13df-4e29-97a5-876f9116b29b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:33:12 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20 -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[23276a49-8b10-4b9c-9b89-0e6a70c5a3f5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20] added
Dec 05 15:33:12 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e2b8e4-08ec-4636-9ba6-3053ff8aba74]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b75f8c8-0a0f-4fb5-999b-5a3be8b3be16]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v REwJMSmY {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v REwJMSmY" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8c52e9-b42c-4896-ab23-fa0097dc163f]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'REwJMSmY'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb85189-07d9-45a6-87d2-1ac1f4f96852]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1227132b-3ff1-4f07-846c-7b3275f27fd0]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:33:12 user nova-compute[75080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:33:12 user nova-compute[75080]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:33:12 user nova-compute[75080]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 (non-flash)
Dec 05 15:33:12 user nova-compute[75080]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)
Dec 05 15:33:12 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:33:12 user nova-compute[75080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:33:12 user nova-compute[75080]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:33:12 user nova-compute[75080]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 (non-flash)
Dec 05 15:33:12 user nova-compute[75080]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)
Dec 05 15:33:12 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20 -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG nova.compute.manager [None req-5f38888a-434d-4351-a98e-b4bff05ae844 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ff82a3-58fb-45a1-aac8-0a97ab69ebd8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20, portal: 172.16.0.220,3260]
Dec 05 15:33:12 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20, portal: 172.16.0.220,3260] successful.
Dec 05 15:33:12 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70ab272-d4b8-4b36-9d00-73190cb25583]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:12 user nova-compute[75080]: INFO nova.compute.manager [None req-5f38888a-434d-4351-a98e-b4bff05ae844 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] instance snapshotting
Dec 05 15:33:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55fca58-2395-48ed-8a97-4fb4a55e166b]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:33:12 user nova-compute[75080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:33:12 user nova-compute[75080]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:33:12 user nova-compute[75080]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 (non-flash)
Dec 05 15:33:12 user nova-compute[75080]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)
Dec 05 15:33:12 user nova-compute[75080]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20 (non-flash)
Dec 05 15:33:12 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:33:12 user nova-compute[75080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:33:12 user nova-compute[75080]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:33:12 user nova-compute[75080]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 (non-flash)
Dec 05 15:33:12 user nova-compute[75080]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)
Dec 05 15:33:12 user nova-compute[75080]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20 (non-flash)
Dec 05 15:33:12 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] HCTL ('37', '-', '-', 0) found on session 39 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8237d7e4-abea-43e0-b6ee-8fd423e85889]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Searching for a device in session 39 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:33:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'REwJMSmY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:33:12 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-5f38888a-434d-4351-a98e-b4bff05ae844 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Beginning live snapshot process
Dec 05 15:33:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-5f38888a-434d-4351-a98e-b4bff05ae844 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json -f qcow2 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-5f38888a-434d-4351-a98e-b4bff05ae844 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json -f qcow2" returned: 0 in 0.211s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-5f38888a-434d-4351-a98e-b4bff05ae844 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json -f qcow2 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-5f38888a-434d-4351-a98e-b4bff05ae844 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-5f38888a-434d-4351-a98e-b4bff05ae844 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-5f38888a-434d-4351-a98e-b4bff05ae844 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.181s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-5f38888a-434d-4351-a98e-b4bff05ae844 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpydirou7g/c63de060ff604dca98ac1d1c5a62a093.delta 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-5f38888a-434d-4351-a98e-b4bff05ae844 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpydirou7g/c63de060ff604dca98ac1d1c5a62a093.delta 1073741824" returned: 0 in 0.061s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:13 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-5f38888a-434d-4351-a98e-b4bff05ae844 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Quiescing instance not available: QEMU guest agent is not enabled.
Dec 05 15:33:13 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:33:13 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] <== connect_volume: return (1404ms) {'type': 'block', 'scsi_wwn': '23438623837346330', 'path': '/dev/sdf'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:33:13 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438623837346330', 'path': '/dev/sdf'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:33:13 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:32:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1690542588',display_name='tempest-TestVolumeBootPattern-server-1690542588',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1690542588',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbodyAsCj/LsLD4+fqj081LHmxK6h/6lXtC6JTYG6GWTlsJ9L34SglBGh22zHQ6DhZ8jkeGO+vsFyUrlKxX0aNv4V7kDdiXAt2Ew2tgqS8jk69Jg7JlqDhZvfUPpLsuMg==',key_name='tempest-TestVolumeBootPattern-1935536975',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11227acd507347ae9c5a3bc710707f84',ramdisk_id='',reservation_id='r-h0lts48r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-23416231',owner_user_name='tempest-TestVolumeBootPattern-23416231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:33:01Z,user_data=None,user_id='15be5b54cc8346bb86683e4ed2fbba9e',uuid=809b8f18-c3a3-4a06-878a-6c4694dc7547,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03461529-412e-4039-b713-4a170c38698e", "address": "fa:16:3e:06:0b:05", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03461529-41", "ovs_interfaceid": "03461529-412e-4039-b713-4a170c38698e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:33:13 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Converting VIF {"id": "03461529-412e-4039-b713-4a170c38698e", "address": "fa:16:3e:06:0b:05", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03461529-41", "ovs_interfaceid": "03461529-412e-4039-b713-4a170c38698e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:33:13 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:0b:05,bridge_name='br-int',has_traffic_filtering=True,id=03461529-412e-4039-b713-4a170c38698e,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03461529-41') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:33:13 user nova-compute[75080]: DEBUG nova.objects.instance [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lazy-loading 'pci_devices' on Instance uuid 809b8f18-c3a3-4a06-878a-6c4694dc7547 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:33:13 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:33:13 user nova-compute[75080]:   <uuid>809b8f18-c3a3-4a06-878a-6c4694dc7547</uuid>
Dec 05 15:33:13 user nova-compute[75080]:   <name>instance-00000020</name>
Dec 05 15:33:13 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:33:13 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:33:13 user nova-compute[75080]:   <metadata>
Dec 05 15:33:13 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:33:13 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:33:13 user nova-compute[75080]:       <nova:name>tempest-TestVolumeBootPattern-server-1690542588</nova:name>
Dec 05 15:33:13 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:33:12</nova:creationTime>
Dec 05 15:33:13 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:33:13 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:33:13 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:33:13 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:33:13 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:33:13 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:33:13 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:33:13 user nova-compute[75080]:       <nova:owner>
Dec 05 15:33:13 user nova-compute[75080]:         <nova:user uuid="15be5b54cc8346bb86683e4ed2fbba9e">tempest-TestVolumeBootPattern-23416231-project-member</nova:user>
Dec 05 15:33:13 user nova-compute[75080]:         <nova:project uuid="11227acd507347ae9c5a3bc710707f84">tempest-TestVolumeBootPattern-23416231</nova:project>
Dec 05 15:33:13 user nova-compute[75080]:       </nova:owner>
Dec 05 15:33:13 user nova-compute[75080]:       <nova:ports>
Dec 05 15:33:13 user nova-compute[75080]:         <nova:port uuid="03461529-412e-4039-b713-4a170c38698e">
Dec 05 15:33:13 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 05 15:33:13 user nova-compute[75080]:         </nova:port>
Dec 05 15:33:13 user nova-compute[75080]:       </nova:ports>
Dec 05 15:33:13 user nova-compute[75080]:     </nova:instance>
Dec 05 15:33:13 user nova-compute[75080]:   </metadata>
Dec 05 15:33:13 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:33:13 user nova-compute[75080]:     <system>
Dec 05 15:33:13 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:33:13 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:33:13 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:33:13 user nova-compute[75080]:       <entry name="serial">809b8f18-c3a3-4a06-878a-6c4694dc7547</entry>
Dec 05 15:33:13 user nova-compute[75080]:       <entry name="uuid">809b8f18-c3a3-4a06-878a-6c4694dc7547</entry>
Dec 05 15:33:13 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:33:13 user nova-compute[75080]:     </system>
Dec 05 15:33:13 user nova-compute[75080]:   </sysinfo>
Dec 05 15:33:13 user nova-compute[75080]:   <os>
Dec 05 15:33:13 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:33:13 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:33:13 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:33:13 user nova-compute[75080]:   </os>
Dec 05 15:33:13 user nova-compute[75080]:   <features>
Dec 05 15:33:13 user nova-compute[75080]:     <acpi/>
Dec 05 15:33:13 user nova-compute[75080]:     <apic/>
Dec 05 15:33:13 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:33:13 user nova-compute[75080]:   </features>
Dec 05 15:33:13 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:33:13 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:33:13 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:33:13 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:33:13 user nova-compute[75080]:   </clock>
Dec 05 15:33:13 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:33:13 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:33:13 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:33:13 user nova-compute[75080]:   </cpu>
Dec 05 15:33:13 user nova-compute[75080]:   <devices>
Dec 05 15:33:13 user nova-compute[75080]:     <disk type="block" device="disk">
Dec 05 15:33:13 user nova-compute[75080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:33:13 user nova-compute[75080]:       <source dev="/dev/sdf"/>
Dec 05 15:33:13 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:33:13 user nova-compute[75080]:       <serial>d39d2954-223d-4744-b22e-bf29d049ab20</serial>
Dec 05 15:33:13 user nova-compute[75080]:     </disk>
Dec 05 15:33:13 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:33:13 user nova-compute[75080]:       <mac address="fa:16:3e:06:0b:05"/>
Dec 05 15:33:13 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:33:13 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:33:13 user nova-compute[75080]:       <target dev="tap03461529-41"/>
Dec 05 15:33:13 user nova-compute[75080]:     </interface>
Dec 05 15:33:13 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:33:13 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/809b8f18-c3a3-4a06-878a-6c4694dc7547/console.log" append="off"/>
Dec 05 15:33:13 user nova-compute[75080]:     </serial>
Dec 05 15:33:13 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:33:13 user nova-compute[75080]:     <video>
Dec 05 15:33:13 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:33:13 user nova-compute[75080]:     </video>
Dec 05 15:33:13 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:33:13 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:33:13 user nova-compute[75080]:     </rng>
Dec 05 15:33:13 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:33:13 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:33:13 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:33:13 user nova-compute[75080]:     </memballoon>
Dec 05 15:33:13 user nova-compute[75080]:   </devices>
Dec 05 15:33:13 user nova-compute[75080]: </domain>
Dec 05 15:33:13 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:33:13 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:32:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1690542588',display_name='tempest-TestVolumeBootPattern-server-1690542588',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1690542588',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbodyAsCj/LsLD4+fqj081LHmxK6h/6lXtC6JTYG6GWTlsJ9L34SglBGh22zHQ6DhZ8jkeGO+vsFyUrlKxX0aNv4V7kDdiXAt2Ew2tgqS8jk69Jg7JlqDhZvfUPpLsuMg==',key_name='tempest-TestVolumeBootPattern-1935536975',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11227acd507347ae9c5a3bc710707f84',ramdisk_id='',reservation_id='r-h0lts48r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-23416231',owner_user_name='tempest-TestVolumeBootPattern-23416231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:33:01Z,user_data=None,user_id='15be5b54cc8346bb86683e4ed2fbba9e',uuid=809b8f18-c3a3-4a06-878a-6c4694dc7547,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03461529-412e-4039-b713-4a170c38698e", "address": "fa:16:3e:06:0b:05", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03461529-41", "ovs_interfaceid": "03461529-412e-4039-b713-4a170c38698e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:33:13 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Converting VIF {"id": "03461529-412e-4039-b713-4a170c38698e", "address": "fa:16:3e:06:0b:05", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03461529-41", "ovs_interfaceid": "03461529-412e-4039-b713-4a170c38698e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:33:13 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:0b:05,bridge_name='br-int',has_traffic_filtering=True,id=03461529-412e-4039-b713-4a170c38698e,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03461529-41') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:33:13 user nova-compute[75080]: DEBUG os_vif [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:0b:05,bridge_name='br-int',has_traffic_filtering=True,id=03461529-412e-4039-b713-4a170c38698e,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03461529-41') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:33:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:33:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:33:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '54a1450e-c926-5955-806c-441ac1d88f6d', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:33:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03461529-41, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:33:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap03461529-41, col_values=(('qos', UUID('bb7b0631-a0db-4dd9-b33b-62d06cde94d7')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:33:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap03461529-41, col_values=(('external_ids', {'iface-id': '03461529-412e-4039-b713-4a170c38698e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:0b:05', 'vm-uuid': '809b8f18-c3a3-4a06-878a-6c4694dc7547'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:33:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:33:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:13 user nova-compute[75080]: INFO os_vif [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:0b:05,bridge_name='br-int',has_traffic_filtering=True,id=03461529-412e-4039-b713-4a170c38698e,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03461529-41')
Dec 05 15:33:13 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:33:13 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] No VIF found with MAC fa:16:3e:06:0b:05, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:33:14 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-5f38888a-434d-4351-a98e-b4bff05ae844 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 15:33:14 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-5f38888a-434d-4351-a98e-b4bff05ae844 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 15:33:14 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-5f38888a-434d-4351-a98e-b4bff05ae844 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 05 15:33:15 user nova-compute[75080]: DEBUG nova.privsep.utils [None req-5f38888a-434d-4351-a98e-b4bff05ae844 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75080) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 15:33:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-5f38888a-434d-4351-a98e-b4bff05ae844 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpydirou7g/c63de060ff604dca98ac1d1c5a62a093.delta /opt/stack/data/nova/instances/snapshots/tmpydirou7g/c63de060ff604dca98ac1d1c5a62a093 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:15 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:15 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-5f38888a-434d-4351-a98e-b4bff05ae844 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpydirou7g/c63de060ff604dca98ac1d1c5a62a093.delta /opt/stack/data/nova/instances/snapshots/tmpydirou7g/c63de060ff604dca98ac1d1c5a62a093" returned: 0 in 0.693s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:15 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-5f38888a-434d-4351-a98e-b4bff05ae844 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Snapshot extracted, beginning image upload
Dec 05 15:33:15 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:15 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:15 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:15 user nova-compute[75080]: DEBUG nova.compute.manager [req-4257822a-f674-4f19-8812-f35d1f5ad941 req-1d2a6705-505a-4910-af55-7b773922e8aa service nova] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Received event network-vif-plugged-03461529-412e-4039-b713-4a170c38698e {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:33:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4257822a-f674-4f19-8812-f35d1f5ad941 req-1d2a6705-505a-4910-af55-7b773922e8aa service nova] Acquiring lock "809b8f18-c3a3-4a06-878a-6c4694dc7547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:33:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4257822a-f674-4f19-8812-f35d1f5ad941 req-1d2a6705-505a-4910-af55-7b773922e8aa service nova] Lock "809b8f18-c3a3-4a06-878a-6c4694dc7547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:33:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4257822a-f674-4f19-8812-f35d1f5ad941 req-1d2a6705-505a-4910-af55-7b773922e8aa service nova] Lock "809b8f18-c3a3-4a06-878a-6c4694dc7547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:33:15 user nova-compute[75080]: DEBUG nova.compute.manager [req-4257822a-f674-4f19-8812-f35d1f5ad941 req-1d2a6705-505a-4910-af55-7b773922e8aa service nova] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] No waiting events found dispatching network-vif-plugged-03461529-412e-4039-b713-4a170c38698e {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:33:15 user nova-compute[75080]: WARNING nova.compute.manager [req-4257822a-f674-4f19-8812-f35d1f5ad941 req-1d2a6705-505a-4910-af55-7b773922e8aa service nova] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Received unexpected event network-vif-plugged-03461529-412e-4039-b713-4a170c38698e for instance with vm_state building and task_state spawning.
Dec 05 15:33:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:17 user nova-compute[75080]: DEBUG nova.compute.manager [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:33:17 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:33:17 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Instance spawned successfully.
Dec 05 15:33:17 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:33:18 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:33:18 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:33:18 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:33:18 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:33:18 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:33:18 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:33:18 user nova-compute[75080]: DEBUG nova.compute.manager [req-7208ba4e-c737-4381-b04d-6db1947afc29 req-338cecb8-05f0-4261-bca4-0a771145dad5 service nova] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Received event network-vif-plugged-03461529-412e-4039-b713-4a170c38698e {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:33:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7208ba4e-c737-4381-b04d-6db1947afc29 req-338cecb8-05f0-4261-bca4-0a771145dad5 service nova] Acquiring lock "809b8f18-c3a3-4a06-878a-6c4694dc7547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:33:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7208ba4e-c737-4381-b04d-6db1947afc29 req-338cecb8-05f0-4261-bca4-0a771145dad5 service nova] Lock "809b8f18-c3a3-4a06-878a-6c4694dc7547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:33:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7208ba4e-c737-4381-b04d-6db1947afc29 req-338cecb8-05f0-4261-bca4-0a771145dad5 service nova] Lock "809b8f18-c3a3-4a06-878a-6c4694dc7547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:33:18 user nova-compute[75080]: DEBUG nova.compute.manager [req-7208ba4e-c737-4381-b04d-6db1947afc29 req-338cecb8-05f0-4261-bca4-0a771145dad5 service nova] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] No waiting events found dispatching network-vif-plugged-03461529-412e-4039-b713-4a170c38698e {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:33:18 user nova-compute[75080]: WARNING nova.compute.manager [req-7208ba4e-c737-4381-b04d-6db1947afc29 req-338cecb8-05f0-4261-bca4-0a771145dad5 service nova] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Received unexpected event network-vif-plugged-03461529-412e-4039-b713-4a170c38698e for instance with vm_state building and task_state spawning.
Dec 05 15:33:18 user nova-compute[75080]: INFO nova.compute.manager [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Took 5.96 seconds to spawn the instance on the hypervisor.
Dec 05 15:33:18 user nova-compute[75080]: DEBUG nova.compute.manager [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:33:18 user nova-compute[75080]: INFO nova.compute.manager [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Took 18.26 seconds to build instance.
Dec 05 15:33:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-733fb690-ceee-4a55-b53d-fca910cd1ae5 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "809b8f18-c3a3-4a06-878a-6c4694dc7547" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.376s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:33:18 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-5f38888a-434d-4351-a98e-b4bff05ae844 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Snapshot image upload complete
Dec 05 15:33:18 user nova-compute[75080]: INFO nova.compute.manager [None req-5f38888a-434d-4351-a98e-b4bff05ae844 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Took 5.93 seconds to snapshot the instance on the hypervisor.
Dec 05 15:33:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75080) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 05 15:33:29 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-f3bd088c-c9e4-4047-812e-73d2b093572d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 06d40106-075c-4b29-bfc5-a0224ece1d45 is timed out.
Dec 05 15:33:29 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-f3bd088c-c9e4-4047-812e-73d2b093572d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Successfully detached device vdc from instance 06d40106-075c-4b29-bfc5-a0224ece1d45 from the live domain config.
Dec 05 15:33:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3bd088c-c9e4-4047-812e-73d2b093572d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3bd088c-c9e4-4047-812e-73d2b093572d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OQZmfHaK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:33:29 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-f3bd088c-c9e4-4047-812e-73d2b093572d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:33:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-f3bd088c-c9e4-4047-812e-73d2b093572d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-f3bd088c-c9e4-4047-812e-73d2b093572d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac164d2-e82d-490a-bbe5-62bdf179c75e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3bd088c-c9e4-4047-812e-73d2b093572d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:33:29 user nova-compute[75080]: No targets found.
Dec 05 15:33:29 user nova-compute[75080]: iSNS:
Dec 05 15:33:29 user nova-compute[75080]: No targets found.
Dec 05 15:33:29 user nova-compute[75080]: STATIC:
Dec 05 15:33:29 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5
Dec 05 15:33:29 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:33:29 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:33:29 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315
Dec 05 15:33:29 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:33:29 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:33:29 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399
Dec 05 15:33:29 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:33:29 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:33:29 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20
Dec 05 15:33:29 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:33:29 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:33:29 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0
Dec 05 15:33:29 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:33:29 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:33:29 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b
Dec 05 15:33:29 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:33:29 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:33:29 user nova-compute[75080]: FIRMWARE:
Dec 05 15:33:29 user nova-compute[75080]: No targets found.
Dec 05 15:33:29 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3bd088c-c9e4-4047-812e-73d2b093572d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:33:29 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:33:29 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3bd088c-c9e4-4047-812e-73d2b093572d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.034s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f423833-faa9-4cb5-9c81-e22d2d4b0767]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b83e5e-4b1e-4b16-a21b-0ad8d261844c]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3bd088c-c9e4-4047-812e-73d2b093572d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:33:29 user nova-compute[75080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:33:29 user nova-compute[75080]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:33:29 user nova-compute[75080]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 (non-flash)
Dec 05 15:33:29 user nova-compute[75080]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)
Dec 05 15:33:29 user nova-compute[75080]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20 (non-flash)
Dec 05 15:33:29 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3bd088c-c9e4-4047-812e-73d2b093572d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:33:29 user nova-compute[75080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:33:29 user nova-compute[75080]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:33:29 user nova-compute[75080]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 (non-flash)
Dec 05 15:33:29 user nova-compute[75080]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)
Dec 05 15:33:29 user nova-compute[75080]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20 (non-flash)
Dec 05 15:33:29 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3bd088c-c9e4-4047-812e-73d2b093572d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f665c538310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315'): ({'sde'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-f3bd088c-c9e4-4047-812e-73d2b093572d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Removing single pathed devices sde {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af6c343-0854-4432-99c0-c9492e8efef2]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e263de2-4463-40d6-9c84-84902ac3b23f]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-f3bd088c-c9e4-4047-812e-73d2b093572d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Flushing IO for device /dev/sde {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[855d998a-14f8-4c66-8ebd-49d9abfebfbb]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-f3bd088c-c9e4-4047-812e-73d2b093572d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abfe287-8de2-45f0-8e2f-990f5ba5997d]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-f3bd088c-c9e4-4047-812e-73d2b093572d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-f3bd088c-c9e4-4047-812e-73d2b093572d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] SCSI volumes sde have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3bd088c-c9e4-4047-812e-73d2b093572d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f168fe25-6c5d-4f59-8bba-e0cc5c1a2769]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3bd088c-c9e4-4047-812e-73d2b093572d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c450a5a-c2c9-4fc8-b057-10af462f6213]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3bd088c-c9e4-4047-812e-73d2b093572d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315, portal: 172.16.0.220,3260]
Dec 05 15:33:29 user nova-compute[75080]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315, portal: 172.16.0.220,3260] successful.
Dec 05 15:33:29 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37bf152b-3fc7-42e2-a431-c1df7895b315 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2949db51-7e59-444f-a183-2211d7382d57]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3bd088c-c9e4-4047-812e-73d2b093572d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-f3bd088c-c9e4-4047-812e-73d2b093572d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3bd088c-c9e4-4047-812e-73d2b093572d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] <== disconnect_volume: return (366ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:33:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3bd088c-c9e4-4047-812e-73d2b093572d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:33:30 user nova-compute[75080]: DEBUG nova.objects.instance [None req-f3bd088c-c9e4-4047-812e-73d2b093572d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lazy-loading 'flavor' on Instance uuid 06d40106-075c-4b29-bfc5-a0224ece1d45 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:33:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f3bd088c-c9e4-4047-812e-73d2b093572d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "06d40106-075c-4b29-bfc5-a0224ece1d45" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.960s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:33:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Acquiring lock "94683fe5-8aff-4f71-9940-2d43df85e34d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:33:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Lock "94683fe5-8aff-4f71-9940-2d43df85e34d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:33:31 user nova-compute[75080]: DEBUG nova.compute.manager [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:33:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:33:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:33:31 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:33:31 user nova-compute[75080]: INFO nova.compute.claims [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Claim successful on node user
Dec 05 15:33:31 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:33:31 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:33:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.455s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:33:31 user nova-compute[75080]: DEBUG nova.compute.manager [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:33:32 user nova-compute[75080]: DEBUG nova.compute.manager [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:33:32 user nova-compute[75080]: DEBUG nova.network.neutron [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:33:32 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:33:32 user nova-compute[75080]: DEBUG nova.compute.manager [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:33:32 user nova-compute[75080]: DEBUG nova.compute.manager [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:33:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:33:32 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Creating image(s)
Dec 05 15:33:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Acquiring lock "/opt/stack/data/nova/instances/94683fe5-8aff-4f71-9940-2d43df85e34d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:33:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Lock "/opt/stack/data/nova/instances/94683fe5-8aff-4f71-9940-2d43df85e34d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:33:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Lock "/opt/stack/data/nova/instances/94683fe5-8aff-4f71-9940-2d43df85e34d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:33:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:32 user nova-compute[75080]: DEBUG nova.policy [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5d908b980a6841d0abac2a2f69856dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43c11eb62aa40f691530591414ca4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:33:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.183s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:33:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:33:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:32 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:33:32 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Cleaning up deleted instances {{(pid=75080) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 05 15:33:32 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] There are 0 instances to clean {{(pid=75080) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 05 15:33:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.189s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/94683fe5-8aff-4f71-9940-2d43df85e34d/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/94683fe5-8aff-4f71-9940-2d43df85e34d/disk 1073741824" returned: 0 in 0.057s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:33:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.172s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:32 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Checking if we can resize image /opt/stack/data/nova/instances/94683fe5-8aff-4f71-9940-2d43df85e34d/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 15:33:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94683fe5-8aff-4f71-9940-2d43df85e34d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94683fe5-8aff-4f71-9940-2d43df85e34d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:32 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Cannot resize image /opt/stack/data/nova/instances/94683fe5-8aff-4f71-9940-2d43df85e34d/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 15:33:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:33:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Ensure instance console log exists: /opt/stack/data/nova/instances/94683fe5-8aff-4f71-9940-2d43df85e34d/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:33:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:33:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:33:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:33:33 user nova-compute[75080]: DEBUG nova.network.neutron [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Successfully created port: 5405d4ce-ee0b-4258-9a94-3b0fc8094a73 {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:33:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:33 user nova-compute[75080]: DEBUG nova.network.neutron [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Successfully updated port: 5405d4ce-ee0b-4258-9a94-3b0fc8094a73 {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:33:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Acquiring lock "refresh_cache-94683fe5-8aff-4f71-9940-2d43df85e34d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:33:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Acquired lock "refresh_cache-94683fe5-8aff-4f71-9940-2d43df85e34d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:33:33 user nova-compute[75080]: DEBUG nova.network.neutron [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:33:33 user nova-compute[75080]: DEBUG nova.compute.manager [req-87f1ebd5-b446-433c-9f0b-1e7c2d062ff3 req-090a8382-127b-439f-87d6-8a88498a1530 service nova] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Received event network-changed-5405d4ce-ee0b-4258-9a94-3b0fc8094a73 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:33:33 user nova-compute[75080]: DEBUG nova.compute.manager [req-87f1ebd5-b446-433c-9f0b-1e7c2d062ff3 req-090a8382-127b-439f-87d6-8a88498a1530 service nova] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Refreshing instance network info cache due to event network-changed-5405d4ce-ee0b-4258-9a94-3b0fc8094a73. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:33:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-87f1ebd5-b446-433c-9f0b-1e7c2d062ff3 req-090a8382-127b-439f-87d6-8a88498a1530 service nova] Acquiring lock "refresh_cache-94683fe5-8aff-4f71-9940-2d43df85e34d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:33:33 user nova-compute[75080]: DEBUG nova.network.neutron [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG nova.network.neutron [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Updating instance_info_cache with network_info: [{"id": "5405d4ce-ee0b-4258-9a94-3b0fc8094a73", "address": "fa:16:3e:0d:27:52", "network": {"id": "8ce86bdf-18d7-49ea-ae1d-288f1a452956", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0ca683fa1e094a8fa09c173c4dfc1ba9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5405d4ce-ee", "ovs_interfaceid": "5405d4ce-ee0b-4258-9a94-3b0fc8094a73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Releasing lock "refresh_cache-94683fe5-8aff-4f71-9940-2d43df85e34d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG nova.compute.manager [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Instance network_info: |[{"id": "5405d4ce-ee0b-4258-9a94-3b0fc8094a73", "address": "fa:16:3e:0d:27:52", "network": {"id": "8ce86bdf-18d7-49ea-ae1d-288f1a452956", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0ca683fa1e094a8fa09c173c4dfc1ba9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5405d4ce-ee", "ovs_interfaceid": "5405d4ce-ee0b-4258-9a94-3b0fc8094a73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-87f1ebd5-b446-433c-9f0b-1e7c2d062ff3 req-090a8382-127b-439f-87d6-8a88498a1530 service nova] Acquired lock "refresh_cache-94683fe5-8aff-4f71-9940-2d43df85e34d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG nova.network.neutron [req-87f1ebd5-b446-433c-9f0b-1e7c2d062ff3 req-090a8382-127b-439f-87d6-8a88498a1530 service nova] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Refreshing network info cache for port 5405d4ce-ee0b-4258-9a94-3b0fc8094a73 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Start _get_guest_xml network_info=[{"id": "5405d4ce-ee0b-4258-9a94-3b0fc8094a73", "address": "fa:16:3e:0d:27:52", "network": {"id": "8ce86bdf-18d7-49ea-ae1d-288f1a452956", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0ca683fa1e094a8fa09c173c4dfc1ba9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5405d4ce-ee", "ovs_interfaceid": "5405d4ce-ee0b-4258-9a94-3b0fc8094a73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:33:34 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:33:34 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:33:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:33:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-579945271',display_name='tempest-VolumesNegativeTest-instance-579945271',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-579945271',id=33,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d43c11eb62aa40f691530591414ca4e7',ramdisk_id='',reservation_id='r-0o7ebg9d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-783086599',owner_user_name='tempest-VolumesNegativeTest-783086599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:33:32Z,user_data=None,user_id='5d908b980a6841d0abac2a2f69856dd4',uuid=94683fe5-8aff-4f71-9940-2d43df85e34d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5405d4ce-ee0b-4258-9a94-3b0fc8094a73", "address": "fa:16:3e:0d:27:52", "network": {"id": "8ce86bdf-18d7-49ea-ae1d-288f1a452956", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0ca683fa1e094a8fa09c173c4dfc1ba9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5405d4ce-ee", "ovs_interfaceid": "5405d4ce-ee0b-4258-9a94-3b0fc8094a73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Converting VIF {"id": "5405d4ce-ee0b-4258-9a94-3b0fc8094a73", "address": "fa:16:3e:0d:27:52", "network": {"id": "8ce86bdf-18d7-49ea-ae1d-288f1a452956", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0ca683fa1e094a8fa09c173c4dfc1ba9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5405d4ce-ee", "ovs_interfaceid": "5405d4ce-ee0b-4258-9a94-3b0fc8094a73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:27:52,bridge_name='br-int',has_traffic_filtering=True,id=5405d4ce-ee0b-4258-9a94-3b0fc8094a73,network=Network(8ce86bdf-18d7-49ea-ae1d-288f1a452956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5405d4ce-ee') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG nova.objects.instance [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Lazy-loading 'pci_devices' on Instance uuid 94683fe5-8aff-4f71-9940-2d43df85e34d {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:33:34 user nova-compute[75080]:   <uuid>94683fe5-8aff-4f71-9940-2d43df85e34d</uuid>
Dec 05 15:33:34 user nova-compute[75080]:   <name>instance-00000021</name>
Dec 05 15:33:34 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:33:34 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:33:34 user nova-compute[75080]:   <metadata>
Dec 05 15:33:34 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:33:34 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:33:34 user nova-compute[75080]:       <nova:name>tempest-VolumesNegativeTest-instance-579945271</nova:name>
Dec 05 15:33:34 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:33:34</nova:creationTime>
Dec 05 15:33:34 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:33:34 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:33:34 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:33:34 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:33:34 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:33:34 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:33:34 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:33:34 user nova-compute[75080]:       <nova:owner>
Dec 05 15:33:34 user nova-compute[75080]:         <nova:user uuid="5d908b980a6841d0abac2a2f69856dd4">tempest-VolumesNegativeTest-783086599-project-member</nova:user>
Dec 05 15:33:34 user nova-compute[75080]:         <nova:project uuid="d43c11eb62aa40f691530591414ca4e7">tempest-VolumesNegativeTest-783086599</nova:project>
Dec 05 15:33:34 user nova-compute[75080]:       </nova:owner>
Dec 05 15:33:34 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:33:34 user nova-compute[75080]:       <nova:ports>
Dec 05 15:33:34 user nova-compute[75080]:         <nova:port uuid="5405d4ce-ee0b-4258-9a94-3b0fc8094a73">
Dec 05 15:33:34 user nova-compute[75080]:           <nova:ip type="fixed" address="192.168.233.82" ipVersion="4"/>
Dec 05 15:33:34 user nova-compute[75080]:         </nova:port>
Dec 05 15:33:34 user nova-compute[75080]:       </nova:ports>
Dec 05 15:33:34 user nova-compute[75080]:     </nova:instance>
Dec 05 15:33:34 user nova-compute[75080]:   </metadata>
Dec 05 15:33:34 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:33:34 user nova-compute[75080]:     <system>
Dec 05 15:33:34 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:33:34 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:33:34 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:33:34 user nova-compute[75080]:       <entry name="serial">94683fe5-8aff-4f71-9940-2d43df85e34d</entry>
Dec 05 15:33:34 user nova-compute[75080]:       <entry name="uuid">94683fe5-8aff-4f71-9940-2d43df85e34d</entry>
Dec 05 15:33:34 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:33:34 user nova-compute[75080]:     </system>
Dec 05 15:33:34 user nova-compute[75080]:   </sysinfo>
Dec 05 15:33:34 user nova-compute[75080]:   <os>
Dec 05 15:33:34 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:33:34 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:33:34 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:33:34 user nova-compute[75080]:   </os>
Dec 05 15:33:34 user nova-compute[75080]:   <features>
Dec 05 15:33:34 user nova-compute[75080]:     <acpi/>
Dec 05 15:33:34 user nova-compute[75080]:     <apic/>
Dec 05 15:33:34 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:33:34 user nova-compute[75080]:   </features>
Dec 05 15:33:34 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:33:34 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:33:34 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:33:34 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:33:34 user nova-compute[75080]:   </clock>
Dec 05 15:33:34 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:33:34 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:33:34 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:33:34 user nova-compute[75080]:   </cpu>
Dec 05 15:33:34 user nova-compute[75080]:   <devices>
Dec 05 15:33:34 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:33:34 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:33:34 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/94683fe5-8aff-4f71-9940-2d43df85e34d/disk"/>
Dec 05 15:33:34 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:33:34 user nova-compute[75080]:     </disk>
Dec 05 15:33:34 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:33:34 user nova-compute[75080]:       <mac address="fa:16:3e:0d:27:52"/>
Dec 05 15:33:34 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:33:34 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:33:34 user nova-compute[75080]:       <target dev="tap5405d4ce-ee"/>
Dec 05 15:33:34 user nova-compute[75080]:     </interface>
Dec 05 15:33:34 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:33:34 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/94683fe5-8aff-4f71-9940-2d43df85e34d/console.log" append="off"/>
Dec 05 15:33:34 user nova-compute[75080]:     </serial>
Dec 05 15:33:34 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:33:34 user nova-compute[75080]:     <video>
Dec 05 15:33:34 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:33:34 user nova-compute[75080]:     </video>
Dec 05 15:33:34 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:33:34 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:33:34 user nova-compute[75080]:     </rng>
Dec 05 15:33:34 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:33:34 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:33:34 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:33:34 user nova-compute[75080]:     </memballoon>
Dec 05 15:33:34 user nova-compute[75080]:   </devices>
Dec 05 15:33:34 user nova-compute[75080]: </domain>
Dec 05 15:33:34 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:33:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-579945271',display_name='tempest-VolumesNegativeTest-instance-579945271',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-579945271',id=33,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d43c11eb62aa40f691530591414ca4e7',ramdisk_id='',reservation_id='r-0o7ebg9d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-783086599',owner_user_name='tempest-VolumesNegativeTest-783086599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:33:32Z,user_data=None,user_id='5d908b980a6841d0abac2a2f69856dd4',uuid=94683fe5-8aff-4f71-9940-2d43df85e34d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5405d4ce-ee0b-4258-9a94-3b0fc8094a73", "address": "fa:16:3e:0d:27:52", "network": {"id": "8ce86bdf-18d7-49ea-ae1d-288f1a452956", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0ca683fa1e094a8fa09c173c4dfc1ba9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5405d4ce-ee", "ovs_interfaceid": "5405d4ce-ee0b-4258-9a94-3b0fc8094a73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Converting VIF {"id": "5405d4ce-ee0b-4258-9a94-3b0fc8094a73", "address": "fa:16:3e:0d:27:52", "network": {"id": "8ce86bdf-18d7-49ea-ae1d-288f1a452956", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0ca683fa1e094a8fa09c173c4dfc1ba9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5405d4ce-ee", "ovs_interfaceid": "5405d4ce-ee0b-4258-9a94-3b0fc8094a73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:27:52,bridge_name='br-int',has_traffic_filtering=True,id=5405d4ce-ee0b-4258-9a94-3b0fc8094a73,network=Network(8ce86bdf-18d7-49ea-ae1d-288f1a452956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5405d4ce-ee') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG os_vif [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:27:52,bridge_name='br-int',has_traffic_filtering=True,id=5405d4ce-ee0b-4258-9a94-3b0fc8094a73,network=Network(8ce86bdf-18d7-49ea-ae1d-288f1a452956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5405d4ce-ee') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd535914d-b697-5b65-9112-2edba753bdaf', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5405d4ce-ee, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5405d4ce-ee, col_values=(('qos', UUID('55906b51-7cb2-4caf-98ef-0d9163350f7b')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5405d4ce-ee, col_values=(('external_ids', {'iface-id': '5405d4ce-ee0b-4258-9a94-3b0fc8094a73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:27:52', 'vm-uuid': '94683fe5-8aff-4f71-9940-2d43df85e34d'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:34 user nova-compute[75080]: INFO os_vif [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:27:52,bridge_name='br-int',has_traffic_filtering=True,id=5405d4ce-ee0b-4258-9a94-3b0fc8094a73,network=Network(8ce86bdf-18d7-49ea-ae1d-288f1a452956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5405d4ce-ee')
Dec 05 15:33:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] No VIF found with MAC fa:16:3e:0d:27:52, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG nova.network.neutron [req-87f1ebd5-b446-433c-9f0b-1e7c2d062ff3 req-090a8382-127b-439f-87d6-8a88498a1530 service nova] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Updated VIF entry in instance network info cache for port 5405d4ce-ee0b-4258-9a94-3b0fc8094a73. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG nova.network.neutron [req-87f1ebd5-b446-433c-9f0b-1e7c2d062ff3 req-090a8382-127b-439f-87d6-8a88498a1530 service nova] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Updating instance_info_cache with network_info: [{"id": "5405d4ce-ee0b-4258-9a94-3b0fc8094a73", "address": "fa:16:3e:0d:27:52", "network": {"id": "8ce86bdf-18d7-49ea-ae1d-288f1a452956", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0ca683fa1e094a8fa09c173c4dfc1ba9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5405d4ce-ee", "ovs_interfaceid": "5405d4ce-ee0b-4258-9a94-3b0fc8094a73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:33:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-87f1ebd5-b446-433c-9f0b-1e7c2d062ff3 req-090a8382-127b-439f-87d6-8a88498a1530 service nova] Releasing lock "refresh_cache-94683fe5-8aff-4f71-9940-2d43df85e34d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:33:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:35 user nova-compute[75080]: DEBUG nova.compute.manager [req-0779f7cb-de56-4c14-b1c4-1f39970a0a1a req-e76ed985-6e41-47ef-8348-3046f192f1de service nova] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Received event network-vif-plugged-5405d4ce-ee0b-4258-9a94-3b0fc8094a73 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:33:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0779f7cb-de56-4c14-b1c4-1f39970a0a1a req-e76ed985-6e41-47ef-8348-3046f192f1de service nova] Acquiring lock "94683fe5-8aff-4f71-9940-2d43df85e34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:33:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0779f7cb-de56-4c14-b1c4-1f39970a0a1a req-e76ed985-6e41-47ef-8348-3046f192f1de service nova] Lock "94683fe5-8aff-4f71-9940-2d43df85e34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:33:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0779f7cb-de56-4c14-b1c4-1f39970a0a1a req-e76ed985-6e41-47ef-8348-3046f192f1de service nova] Lock "94683fe5-8aff-4f71-9940-2d43df85e34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:33:35 user nova-compute[75080]: DEBUG nova.compute.manager [req-0779f7cb-de56-4c14-b1c4-1f39970a0a1a req-e76ed985-6e41-47ef-8348-3046f192f1de service nova] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] No waiting events found dispatching network-vif-plugged-5405d4ce-ee0b-4258-9a94-3b0fc8094a73 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:33:35 user nova-compute[75080]: WARNING nova.compute.manager [req-0779f7cb-de56-4c14-b1c4-1f39970a0a1a req-e76ed985-6e41-47ef-8348-3046f192f1de service nova] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Received unexpected event network-vif-plugged-5405d4ce-ee0b-4258-9a94-3b0fc8094a73 for instance with vm_state building and task_state spawning.
Dec 05 15:33:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:36 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:33:36 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:33:36 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:33:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:37 user nova-compute[75080]: DEBUG nova.compute.manager [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:33:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:33:37 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Instance spawned successfully.
Dec 05 15:33:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:33:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:33:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:33:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:33:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:33:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:33:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:33:37 user nova-compute[75080]: INFO nova.compute.manager [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Took 5.77 seconds to spawn the instance on the hypervisor.
Dec 05 15:33:37 user nova-compute[75080]: DEBUG nova.compute.manager [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:33:37 user nova-compute[75080]: INFO nova.compute.manager [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Took 6.54 seconds to build instance.
Dec 05 15:33:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-491234eb-0291-4491-9030-e356af1f0d36 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Lock "94683fe5-8aff-4f71-9940-2d43df85e34d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.634s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:33:38 user nova-compute[75080]: DEBUG nova.compute.manager [req-8405d39e-fa64-45e2-9799-132b65de47eb req-43ca99fa-a1be-4b2a-8abd-c055c707a131 service nova] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Received event network-vif-plugged-5405d4ce-ee0b-4258-9a94-3b0fc8094a73 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:33:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8405d39e-fa64-45e2-9799-132b65de47eb req-43ca99fa-a1be-4b2a-8abd-c055c707a131 service nova] Acquiring lock "94683fe5-8aff-4f71-9940-2d43df85e34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:33:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8405d39e-fa64-45e2-9799-132b65de47eb req-43ca99fa-a1be-4b2a-8abd-c055c707a131 service nova] Lock "94683fe5-8aff-4f71-9940-2d43df85e34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:33:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8405d39e-fa64-45e2-9799-132b65de47eb req-43ca99fa-a1be-4b2a-8abd-c055c707a131 service nova] Lock "94683fe5-8aff-4f71-9940-2d43df85e34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:33:38 user nova-compute[75080]: DEBUG nova.compute.manager [req-8405d39e-fa64-45e2-9799-132b65de47eb req-43ca99fa-a1be-4b2a-8abd-c055c707a131 service nova] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] No waiting events found dispatching network-vif-plugged-5405d4ce-ee0b-4258-9a94-3b0fc8094a73 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:33:38 user nova-compute[75080]: WARNING nova.compute.manager [req-8405d39e-fa64-45e2-9799-132b65de47eb req-43ca99fa-a1be-4b2a-8abd-c055c707a131 service nova] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Received unexpected event network-vif-plugged-5405d4ce-ee0b-4258-9a94-3b0fc8094a73 for instance with vm_state active and task_state None.
Dec 05 15:33:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:39 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:33:39 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:33:39 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:33:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-011d3446-577a-4f5c-b8f0-ef04940cad17" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:33:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-011d3446-577a-4f5c-b8f0-ef04940cad17" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:33:39 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 15:33:40 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Updating instance_info_cache with network_info: [{"id": "dfee0a0e-5241-4d51-879d-7667bb06344b", "address": "fa:16:3e:be:d6:bd", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfee0a0e-52", "ovs_interfaceid": "dfee0a0e-5241-4d51-879d-7667bb06344b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:33:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-011d3446-577a-4f5c-b8f0-ef04940cad17" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:33:40 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 15:33:40 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:33:40 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:33:40 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:33:41 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:33:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:33:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:33:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:33:41 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:33:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:33:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:33:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94683fe5-8aff-4f71-9940-2d43df85e34d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94683fe5-8aff-4f71-9940-2d43df85e34d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94683fe5-8aff-4f71-9940-2d43df85e34d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94683fe5-8aff-4f71-9940-2d43df85e34d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:43 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:33:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:33:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:33:43 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:33:43 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:33:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:44 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:33:44 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:33:44 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=7925MB free_disk=25.037841796875GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:33:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:33:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:33:44 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance eedd1529-4feb-4f85-8625-0c20d8e0359d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:33:44 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 07b025ff-4a9d-48a2-b950-b8f2d165f33c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:33:44 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance ab882db7-e6d7-44ca-9ea4-ae2fa68f7929 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:33:44 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 011d3446-577a-4f5c-b8f0-ef04940cad17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:33:44 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 40138071-fefc-4686-9344-7df255a1fc9d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:33:44 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 308f6ec7-d5c1-46bf-95a4-036e1c192f7f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:33:44 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 06d40106-075c-4b29-bfc5-a0224ece1d45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:33:44 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance b47129e8-c02b-4107-af4f-329173dd453f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:33:44 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 809b8f18-c3a3-4a06-878a-6c4694dc7547 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:33:44 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 94683fe5-8aff-4f71-9940-2d43df85e34d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:33:44 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:33:44 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:33:44 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing inventories for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 05 15:33:44 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Updating ProviderTree inventory for provider 21b770fa-b774-46c9-9415-db26064ccd0f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 05 15:33:44 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Updating inventory in ProviderTree for provider 21b770fa-b774-46c9-9415-db26064ccd0f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 15:33:44 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing aggregate associations for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f, aggregates: None {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 05 15:33:44 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing trait associations for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f, traits: COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 05 15:33:45 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:33:45 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:33:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:33:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.765s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:33:46 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:33:46 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:33:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-eff9c6bf-7f78-415d-baac-dd5c9e5fce8d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "06d40106-075c-4b29-bfc5-a0224ece1d45" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:33:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-eff9c6bf-7f78-415d-baac-dd5c9e5fce8d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "06d40106-075c-4b29-bfc5-a0224ece1d45" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:33:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-eff9c6bf-7f78-415d-baac-dd5c9e5fce8d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "06d40106-075c-4b29-bfc5-a0224ece1d45-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:33:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-eff9c6bf-7f78-415d-baac-dd5c9e5fce8d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "06d40106-075c-4b29-bfc5-a0224ece1d45-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:33:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-eff9c6bf-7f78-415d-baac-dd5c9e5fce8d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "06d40106-075c-4b29-bfc5-a0224ece1d45-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:33:59 user nova-compute[75080]: INFO nova.compute.manager [None req-eff9c6bf-7f78-415d-baac-dd5c9e5fce8d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Terminating instance
Dec 05 15:33:59 user nova-compute[75080]: DEBUG nova.compute.manager [None req-eff9c6bf-7f78-415d-baac-dd5c9e5fce8d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:33:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:33:59 user nova-compute[75080]: DEBUG nova.compute.manager [req-6a138402-bb9e-4ee7-a38b-ba039eba08fa req-701673af-9fc4-4d42-b42f-594287b8041a service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Received event network-vif-unplugged-5b00d45c-4fed-41ce-b3c1-67d45830034b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:33:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-6a138402-bb9e-4ee7-a38b-ba039eba08fa req-701673af-9fc4-4d42-b42f-594287b8041a service nova] Acquiring lock "06d40106-075c-4b29-bfc5-a0224ece1d45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:33:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-6a138402-bb9e-4ee7-a38b-ba039eba08fa req-701673af-9fc4-4d42-b42f-594287b8041a service nova] Lock "06d40106-075c-4b29-bfc5-a0224ece1d45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:33:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-6a138402-bb9e-4ee7-a38b-ba039eba08fa req-701673af-9fc4-4d42-b42f-594287b8041a service nova] Lock "06d40106-075c-4b29-bfc5-a0224ece1d45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:33:59 user nova-compute[75080]: DEBUG nova.compute.manager [req-6a138402-bb9e-4ee7-a38b-ba039eba08fa req-701673af-9fc4-4d42-b42f-594287b8041a service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] No waiting events found dispatching network-vif-unplugged-5b00d45c-4fed-41ce-b3c1-67d45830034b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:33:59 user nova-compute[75080]: DEBUG nova.compute.manager [req-6a138402-bb9e-4ee7-a38b-ba039eba08fa req-701673af-9fc4-4d42-b42f-594287b8041a service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Received event network-vif-unplugged-5b00d45c-4fed-41ce-b3c1-67d45830034b for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:34:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:00 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Instance destroyed successfully.
Dec 05 15:34:00 user nova-compute[75080]: DEBUG nova.objects.instance [None req-eff9c6bf-7f78-415d-baac-dd5c9e5fce8d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lazy-loading 'resources' on Instance uuid 06d40106-075c-4b29-bfc5-a0224ece1d45 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:34:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-eff9c6bf-7f78-415d-baac-dd5c9e5fce8d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T15:27:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1271607709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1271607709',id=25,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGEyzTF/B823LkyDU5gfGCuteT4fw75ySbVBKx+2tT0hOUi9Rmtt937/xjcCneA2bSTThW3EBbFbXM26bm1fIZOeGSIiFiMwCwlEia7YhFfTC54hx2NA1hMW/7xxyngiLg==',key_name='tempest-keypair-755329848',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:31:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6350b8a7b0ce4af7b83a280c0c1ec3e6',ramdisk_id='',reservation_id='r-33v9h4hw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-132988477',owner_user_name='tempest-AttachVolumeShelveTestJSON-132988477-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:31:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72a1c29faca44a4095dbda09561e5a91',uuid=06d40106-075c-4b29-bfc5-a0224ece1d45,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "address": "fa:16:3e:e1:1a:b2", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b00d45c-4f", "ovs_interfaceid": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:34:00 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-eff9c6bf-7f78-415d-baac-dd5c9e5fce8d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Converting VIF {"id": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "address": "fa:16:3e:e1:1a:b2", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b00d45c-4f", "ovs_interfaceid": "5b00d45c-4fed-41ce-b3c1-67d45830034b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:34:00 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-eff9c6bf-7f78-415d-baac-dd5c9e5fce8d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1a:b2,bridge_name='br-int',has_traffic_filtering=True,id=5b00d45c-4fed-41ce-b3c1-67d45830034b,network=Network(b94a6985-25b3-480e-b79f-b753c8b23fa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b00d45c-4f') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:34:00 user nova-compute[75080]: DEBUG os_vif [None req-eff9c6bf-7f78-415d-baac-dd5c9e5fce8d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1a:b2,bridge_name='br-int',has_traffic_filtering=True,id=5b00d45c-4fed-41ce-b3c1-67d45830034b,network=Network(b94a6985-25b3-480e-b79f-b753c8b23fa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b00d45c-4f') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:34:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b00d45c-4f, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:34:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:34:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=87bbd7cf-670d-4fd1-9d4d-c54dc6f41c6d) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:34:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:34:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:00 user nova-compute[75080]: INFO os_vif [None req-eff9c6bf-7f78-415d-baac-dd5c9e5fce8d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1a:b2,bridge_name='br-int',has_traffic_filtering=True,id=5b00d45c-4fed-41ce-b3c1-67d45830034b,network=Network(b94a6985-25b3-480e-b79f-b753c8b23fa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b00d45c-4f')
Dec 05 15:34:00 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-eff9c6bf-7f78-415d-baac-dd5c9e5fce8d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Deleting instance files /opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45_del
Dec 05 15:34:00 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-eff9c6bf-7f78-415d-baac-dd5c9e5fce8d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Deletion of /opt/stack/data/nova/instances/06d40106-075c-4b29-bfc5-a0224ece1d45_del complete
Dec 05 15:34:00 user nova-compute[75080]: INFO nova.compute.manager [None req-eff9c6bf-7f78-415d-baac-dd5c9e5fce8d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Took 0.94 seconds to destroy the instance on the hypervisor.
Dec 05 15:34:00 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-eff9c6bf-7f78-415d-baac-dd5c9e5fce8d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:34:00 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:34:00 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:34:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:01 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:34:01 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Took 0.98 seconds to deallocate network for instance.
Dec 05 15:34:01 user nova-compute[75080]: DEBUG nova.compute.manager [req-539c5029-0dee-47cc-b13d-678f3754bb38 req-f22a3334-cbd1-4bd9-860d-33df05f6b3f8 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Received event network-vif-deleted-5b00d45c-4fed-41ce-b3c1-67d45830034b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:34:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-eff9c6bf-7f78-415d-baac-dd5c9e5fce8d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-eff9c6bf-7f78-415d-baac-dd5c9e5fce8d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:01 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-eff9c6bf-7f78-415d-baac-dd5c9e5fce8d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:34:01 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-eff9c6bf-7f78-415d-baac-dd5c9e5fce8d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:34:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-eff9c6bf-7f78-415d-baac-dd5c9e5fce8d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:01 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-eff9c6bf-7f78-415d-baac-dd5c9e5fce8d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Deleted allocations for instance 06d40106-075c-4b29-bfc5-a0224ece1d45
Dec 05 15:34:01 user nova-compute[75080]: DEBUG nova.compute.manager [req-8437144c-6ac7-4c5f-858d-4d35d6d46545 req-c05e97ee-abcf-4393-9f0c-901a17cd3ee0 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Received event network-vif-plugged-5b00d45c-4fed-41ce-b3c1-67d45830034b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:34:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8437144c-6ac7-4c5f-858d-4d35d6d46545 req-c05e97ee-abcf-4393-9f0c-901a17cd3ee0 service nova] Acquiring lock "06d40106-075c-4b29-bfc5-a0224ece1d45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8437144c-6ac7-4c5f-858d-4d35d6d46545 req-c05e97ee-abcf-4393-9f0c-901a17cd3ee0 service nova] Lock "06d40106-075c-4b29-bfc5-a0224ece1d45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8437144c-6ac7-4c5f-858d-4d35d6d46545 req-c05e97ee-abcf-4393-9f0c-901a17cd3ee0 service nova] Lock "06d40106-075c-4b29-bfc5-a0224ece1d45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:01 user nova-compute[75080]: DEBUG nova.compute.manager [req-8437144c-6ac7-4c5f-858d-4d35d6d46545 req-c05e97ee-abcf-4393-9f0c-901a17cd3ee0 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] No waiting events found dispatching network-vif-plugged-5b00d45c-4fed-41ce-b3c1-67d45830034b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:34:01 user nova-compute[75080]: WARNING nova.compute.manager [req-8437144c-6ac7-4c5f-858d-4d35d6d46545 req-c05e97ee-abcf-4393-9f0c-901a17cd3ee0 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Received unexpected event network-vif-plugged-5b00d45c-4fed-41ce-b3c1-67d45830034b for instance with vm_state deleted and task_state None.
Dec 05 15:34:01 user nova-compute[75080]: DEBUG nova.compute.manager [req-8437144c-6ac7-4c5f-858d-4d35d6d46545 req-c05e97ee-abcf-4393-9f0c-901a17cd3ee0 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Received event network-vif-plugged-5b00d45c-4fed-41ce-b3c1-67d45830034b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:34:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8437144c-6ac7-4c5f-858d-4d35d6d46545 req-c05e97ee-abcf-4393-9f0c-901a17cd3ee0 service nova] Acquiring lock "06d40106-075c-4b29-bfc5-a0224ece1d45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8437144c-6ac7-4c5f-858d-4d35d6d46545 req-c05e97ee-abcf-4393-9f0c-901a17cd3ee0 service nova] Lock "06d40106-075c-4b29-bfc5-a0224ece1d45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8437144c-6ac7-4c5f-858d-4d35d6d46545 req-c05e97ee-abcf-4393-9f0c-901a17cd3ee0 service nova] Lock "06d40106-075c-4b29-bfc5-a0224ece1d45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:01 user nova-compute[75080]: DEBUG nova.compute.manager [req-8437144c-6ac7-4c5f-858d-4d35d6d46545 req-c05e97ee-abcf-4393-9f0c-901a17cd3ee0 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] No waiting events found dispatching network-vif-plugged-5b00d45c-4fed-41ce-b3c1-67d45830034b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:34:01 user nova-compute[75080]: WARNING nova.compute.manager [req-8437144c-6ac7-4c5f-858d-4d35d6d46545 req-c05e97ee-abcf-4393-9f0c-901a17cd3ee0 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Received unexpected event network-vif-plugged-5b00d45c-4fed-41ce-b3c1-67d45830034b for instance with vm_state deleted and task_state None.
Dec 05 15:34:01 user nova-compute[75080]: DEBUG nova.compute.manager [req-8437144c-6ac7-4c5f-858d-4d35d6d46545 req-c05e97ee-abcf-4393-9f0c-901a17cd3ee0 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Received event network-vif-plugged-5b00d45c-4fed-41ce-b3c1-67d45830034b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:34:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8437144c-6ac7-4c5f-858d-4d35d6d46545 req-c05e97ee-abcf-4393-9f0c-901a17cd3ee0 service nova] Acquiring lock "06d40106-075c-4b29-bfc5-a0224ece1d45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8437144c-6ac7-4c5f-858d-4d35d6d46545 req-c05e97ee-abcf-4393-9f0c-901a17cd3ee0 service nova] Lock "06d40106-075c-4b29-bfc5-a0224ece1d45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8437144c-6ac7-4c5f-858d-4d35d6d46545 req-c05e97ee-abcf-4393-9f0c-901a17cd3ee0 service nova] Lock "06d40106-075c-4b29-bfc5-a0224ece1d45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:01 user nova-compute[75080]: DEBUG nova.compute.manager [req-8437144c-6ac7-4c5f-858d-4d35d6d46545 req-c05e97ee-abcf-4393-9f0c-901a17cd3ee0 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] No waiting events found dispatching network-vif-plugged-5b00d45c-4fed-41ce-b3c1-67d45830034b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:34:01 user nova-compute[75080]: WARNING nova.compute.manager [req-8437144c-6ac7-4c5f-858d-4d35d6d46545 req-c05e97ee-abcf-4393-9f0c-901a17cd3ee0 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Received unexpected event network-vif-plugged-5b00d45c-4fed-41ce-b3c1-67d45830034b for instance with vm_state deleted and task_state None.
Dec 05 15:34:01 user nova-compute[75080]: DEBUG nova.compute.manager [req-8437144c-6ac7-4c5f-858d-4d35d6d46545 req-c05e97ee-abcf-4393-9f0c-901a17cd3ee0 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Received event network-vif-unplugged-5b00d45c-4fed-41ce-b3c1-67d45830034b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:34:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8437144c-6ac7-4c5f-858d-4d35d6d46545 req-c05e97ee-abcf-4393-9f0c-901a17cd3ee0 service nova] Acquiring lock "06d40106-075c-4b29-bfc5-a0224ece1d45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8437144c-6ac7-4c5f-858d-4d35d6d46545 req-c05e97ee-abcf-4393-9f0c-901a17cd3ee0 service nova] Lock "06d40106-075c-4b29-bfc5-a0224ece1d45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8437144c-6ac7-4c5f-858d-4d35d6d46545 req-c05e97ee-abcf-4393-9f0c-901a17cd3ee0 service nova] Lock "06d40106-075c-4b29-bfc5-a0224ece1d45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:01 user nova-compute[75080]: DEBUG nova.compute.manager [req-8437144c-6ac7-4c5f-858d-4d35d6d46545 req-c05e97ee-abcf-4393-9f0c-901a17cd3ee0 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] No waiting events found dispatching network-vif-unplugged-5b00d45c-4fed-41ce-b3c1-67d45830034b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:34:01 user nova-compute[75080]: WARNING nova.compute.manager [req-8437144c-6ac7-4c5f-858d-4d35d6d46545 req-c05e97ee-abcf-4393-9f0c-901a17cd3ee0 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Received unexpected event network-vif-unplugged-5b00d45c-4fed-41ce-b3c1-67d45830034b for instance with vm_state deleted and task_state None.
Dec 05 15:34:01 user nova-compute[75080]: DEBUG nova.compute.manager [req-8437144c-6ac7-4c5f-858d-4d35d6d46545 req-c05e97ee-abcf-4393-9f0c-901a17cd3ee0 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Received event network-vif-plugged-5b00d45c-4fed-41ce-b3c1-67d45830034b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:34:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8437144c-6ac7-4c5f-858d-4d35d6d46545 req-c05e97ee-abcf-4393-9f0c-901a17cd3ee0 service nova] Acquiring lock "06d40106-075c-4b29-bfc5-a0224ece1d45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8437144c-6ac7-4c5f-858d-4d35d6d46545 req-c05e97ee-abcf-4393-9f0c-901a17cd3ee0 service nova] Lock "06d40106-075c-4b29-bfc5-a0224ece1d45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8437144c-6ac7-4c5f-858d-4d35d6d46545 req-c05e97ee-abcf-4393-9f0c-901a17cd3ee0 service nova] Lock "06d40106-075c-4b29-bfc5-a0224ece1d45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:01 user nova-compute[75080]: DEBUG nova.compute.manager [req-8437144c-6ac7-4c5f-858d-4d35d6d46545 req-c05e97ee-abcf-4393-9f0c-901a17cd3ee0 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] No waiting events found dispatching network-vif-plugged-5b00d45c-4fed-41ce-b3c1-67d45830034b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:34:01 user nova-compute[75080]: WARNING nova.compute.manager [req-8437144c-6ac7-4c5f-858d-4d35d6d46545 req-c05e97ee-abcf-4393-9f0c-901a17cd3ee0 service nova] [instance: 06d40106-075c-4b29-bfc5-a0224ece1d45] Received unexpected event network-vif-plugged-5b00d45c-4fed-41ce-b3c1-67d45830034b for instance with vm_state deleted and task_state None.
Dec 05 15:34:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-eff9c6bf-7f78-415d-baac-dd5c9e5fce8d tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "06d40106-075c-4b29-bfc5-a0224ece1d45" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.456s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Acquiring lock "a2482d35-2159-4605-b7af-da232886b8d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "a2482d35-2159-4605-b7af-da232886b8d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:07 user nova-compute[75080]: DEBUG nova.compute.manager [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:34:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:07 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:34:07 user nova-compute[75080]: INFO nova.compute.claims [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Claim successful on node user
Dec 05 15:34:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:07 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:34:07 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:34:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.363s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:07 user nova-compute[75080]: DEBUG nova.compute.manager [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:34:07 user nova-compute[75080]: DEBUG nova.compute.manager [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:34:07 user nova-compute[75080]: DEBUG nova.network.neutron [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:34:07 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:34:07 user nova-compute[75080]: DEBUG nova.compute.manager [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:34:07 user nova-compute[75080]: DEBUG nova.policy [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '025ecd26509b46b8b0157d0abe16eec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a1b1f1ed346949ac0f633ae7e530b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:34:07 user nova-compute[75080]: DEBUG nova.compute.manager [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:34:07 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:34:07 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Creating image(s)
Dec 05 15:34:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Acquiring lock "/opt/stack/data/nova/instances/a2482d35-2159-4605-b7af-da232886b8d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "/opt/stack/data/nova/instances/a2482d35-2159-4605-b7af-da232886b8d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "/opt/stack/data/nova/instances/a2482d35-2159-4605-b7af-da232886b8d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:07 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:07 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.172s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:07 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.220s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/a2482d35-2159-4605-b7af-da232886b8d3/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/a2482d35-2159-4605-b7af-da232886b8d3/disk 1073741824" returned: 0 in 0.068s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:08 user nova-compute[75080]: DEBUG nova.network.neutron [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Successfully created port: a92f7043-98a8-4f4e-be46-45fc5cc4778d {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:34:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.181s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:08 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a2482d35-2159-4605-b7af-da232886b8d3/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 15:34:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2482d35-2159-4605-b7af-da232886b8d3/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2482d35-2159-4605-b7af-da232886b8d3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:08 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Cannot resize image /opt/stack/data/nova/instances/a2482d35-2159-4605-b7af-da232886b8d3/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 15:34:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:34:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Ensure instance console log exists: /opt/stack/data/nova/instances/a2482d35-2159-4605-b7af-da232886b8d3/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:34:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG nova.network.neutron [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Successfully updated port: a92f7043-98a8-4f4e-be46-45fc5cc4778d {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Acquiring lock "refresh_cache-a2482d35-2159-4605-b7af-da232886b8d3" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Acquired lock "refresh_cache-a2482d35-2159-4605-b7af-da232886b8d3" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG nova.network.neutron [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG nova.compute.manager [req-49109b0e-088d-4c6d-902f-d2220dba5cff req-357c8307-ea5c-4e94-adb4-c26c7e40df9a service nova] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Received event network-changed-a92f7043-98a8-4f4e-be46-45fc5cc4778d {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG nova.compute.manager [req-49109b0e-088d-4c6d-902f-d2220dba5cff req-357c8307-ea5c-4e94-adb4-c26c7e40df9a service nova] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Refreshing instance network info cache due to event network-changed-a92f7043-98a8-4f4e-be46-45fc5cc4778d. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-49109b0e-088d-4c6d-902f-d2220dba5cff req-357c8307-ea5c-4e94-adb4-c26c7e40df9a service nova] Acquiring lock "refresh_cache-a2482d35-2159-4605-b7af-da232886b8d3" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG nova.network.neutron [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG nova.network.neutron [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Updating instance_info_cache with network_info: [{"id": "a92f7043-98a8-4f4e-be46-45fc5cc4778d", "address": "fa:16:3e:11:21:2b", "network": {"id": "eb187ccd-700a-49df-881f-c61d4b90e612", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053782949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e8a1b1f1ed346949ac0f633ae7e530b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa92f7043-98", "ovs_interfaceid": "a92f7043-98a8-4f4e-be46-45fc5cc4778d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Releasing lock "refresh_cache-a2482d35-2159-4605-b7af-da232886b8d3" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG nova.compute.manager [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Instance network_info: |[{"id": "a92f7043-98a8-4f4e-be46-45fc5cc4778d", "address": "fa:16:3e:11:21:2b", "network": {"id": "eb187ccd-700a-49df-881f-c61d4b90e612", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053782949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e8a1b1f1ed346949ac0f633ae7e530b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa92f7043-98", "ovs_interfaceid": "a92f7043-98a8-4f4e-be46-45fc5cc4778d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-49109b0e-088d-4c6d-902f-d2220dba5cff req-357c8307-ea5c-4e94-adb4-c26c7e40df9a service nova] Acquired lock "refresh_cache-a2482d35-2159-4605-b7af-da232886b8d3" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG nova.network.neutron [req-49109b0e-088d-4c6d-902f-d2220dba5cff req-357c8307-ea5c-4e94-adb4-c26c7e40df9a service nova] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Refreshing network info cache for port a92f7043-98a8-4f4e-be46-45fc5cc4778d {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Start _get_guest_xml network_info=[{"id": "a92f7043-98a8-4f4e-be46-45fc5cc4778d", "address": "fa:16:3e:11:21:2b", "network": {"id": "eb187ccd-700a-49df-881f-c61d4b90e612", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053782949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e8a1b1f1ed346949ac0f633ae7e530b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa92f7043-98", "ovs_interfaceid": "a92f7043-98a8-4f4e-be46-45fc5cc4778d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:34:09 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:34:09 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:34:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:34:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1324524137',display_name='tempest-VolumesSnapshotTestJSON-instance-1324524137',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1324524137',id=34,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGulSmPsFCYlCumm8tBYOY8xbuZacLyInhaBVPorBEE+fURQDCzANEOHxo2Ocla5UEfvNOeZ+dlKCTS9kMCop/2fwlokJE+RCbft7p3lVYHCNLwVZxj60pTm9KrDxNKTtw==',key_name='tempest-keypair-1151776581',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e8a1b1f1ed346949ac0f633ae7e530b',ramdisk_id='',reservation_id='r-zm90okej',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1567075546',owner_user_name='tempest-VolumesSnapshotTestJSON-1567075546-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:34:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='025ecd26509b46b8b0157d0abe16eec8',uuid=a2482d35-2159-4605-b7af-da232886b8d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a92f7043-98a8-4f4e-be46-45fc5cc4778d", "address": "fa:16:3e:11:21:2b", "network": {"id": "eb187ccd-700a-49df-881f-c61d4b90e612", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053782949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e8a1b1f1ed346949ac0f633ae7e530b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa92f7043-98", "ovs_interfaceid": "a92f7043-98a8-4f4e-be46-45fc5cc4778d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Converting VIF {"id": "a92f7043-98a8-4f4e-be46-45fc5cc4778d", "address": "fa:16:3e:11:21:2b", "network": {"id": "eb187ccd-700a-49df-881f-c61d4b90e612", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053782949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e8a1b1f1ed346949ac0f633ae7e530b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa92f7043-98", "ovs_interfaceid": "a92f7043-98a8-4f4e-be46-45fc5cc4778d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:21:2b,bridge_name='br-int',has_traffic_filtering=True,id=a92f7043-98a8-4f4e-be46-45fc5cc4778d,network=Network(eb187ccd-700a-49df-881f-c61d4b90e612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa92f7043-98') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG nova.objects.instance [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lazy-loading 'pci_devices' on Instance uuid a2482d35-2159-4605-b7af-da232886b8d3 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:34:09 user nova-compute[75080]:   <uuid>a2482d35-2159-4605-b7af-da232886b8d3</uuid>
Dec 05 15:34:09 user nova-compute[75080]:   <name>instance-00000022</name>
Dec 05 15:34:09 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:34:09 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:34:09 user nova-compute[75080]:   <metadata>
Dec 05 15:34:09 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:34:09 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:34:09 user nova-compute[75080]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1324524137</nova:name>
Dec 05 15:34:09 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:34:09</nova:creationTime>
Dec 05 15:34:09 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:34:09 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:34:09 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:34:09 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:34:09 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:34:09 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:34:09 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:34:09 user nova-compute[75080]:       <nova:owner>
Dec 05 15:34:09 user nova-compute[75080]:         <nova:user uuid="025ecd26509b46b8b0157d0abe16eec8">tempest-VolumesSnapshotTestJSON-1567075546-project-member</nova:user>
Dec 05 15:34:09 user nova-compute[75080]:         <nova:project uuid="6e8a1b1f1ed346949ac0f633ae7e530b">tempest-VolumesSnapshotTestJSON-1567075546</nova:project>
Dec 05 15:34:09 user nova-compute[75080]:       </nova:owner>
Dec 05 15:34:09 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:34:09 user nova-compute[75080]:       <nova:ports>
Dec 05 15:34:09 user nova-compute[75080]:         <nova:port uuid="a92f7043-98a8-4f4e-be46-45fc5cc4778d">
Dec 05 15:34:09 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 05 15:34:09 user nova-compute[75080]:         </nova:port>
Dec 05 15:34:09 user nova-compute[75080]:       </nova:ports>
Dec 05 15:34:09 user nova-compute[75080]:     </nova:instance>
Dec 05 15:34:09 user nova-compute[75080]:   </metadata>
Dec 05 15:34:09 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:34:09 user nova-compute[75080]:     <system>
Dec 05 15:34:09 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:34:09 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:34:09 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:34:09 user nova-compute[75080]:       <entry name="serial">a2482d35-2159-4605-b7af-da232886b8d3</entry>
Dec 05 15:34:09 user nova-compute[75080]:       <entry name="uuid">a2482d35-2159-4605-b7af-da232886b8d3</entry>
Dec 05 15:34:09 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:34:09 user nova-compute[75080]:     </system>
Dec 05 15:34:09 user nova-compute[75080]:   </sysinfo>
Dec 05 15:34:09 user nova-compute[75080]:   <os>
Dec 05 15:34:09 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:34:09 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:34:09 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:34:09 user nova-compute[75080]:   </os>
Dec 05 15:34:09 user nova-compute[75080]:   <features>
Dec 05 15:34:09 user nova-compute[75080]:     <acpi/>
Dec 05 15:34:09 user nova-compute[75080]:     <apic/>
Dec 05 15:34:09 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:34:09 user nova-compute[75080]:   </features>
Dec 05 15:34:09 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:34:09 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:34:09 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:34:09 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:34:09 user nova-compute[75080]:   </clock>
Dec 05 15:34:09 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:34:09 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:34:09 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:34:09 user nova-compute[75080]:   </cpu>
Dec 05 15:34:09 user nova-compute[75080]:   <devices>
Dec 05 15:34:09 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:34:09 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:34:09 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/a2482d35-2159-4605-b7af-da232886b8d3/disk"/>
Dec 05 15:34:09 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:34:09 user nova-compute[75080]:     </disk>
Dec 05 15:34:09 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:34:09 user nova-compute[75080]:       <mac address="fa:16:3e:11:21:2b"/>
Dec 05 15:34:09 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:34:09 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:34:09 user nova-compute[75080]:       <target dev="tapa92f7043-98"/>
Dec 05 15:34:09 user nova-compute[75080]:     </interface>
Dec 05 15:34:09 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:34:09 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/a2482d35-2159-4605-b7af-da232886b8d3/console.log" append="off"/>
Dec 05 15:34:09 user nova-compute[75080]:     </serial>
Dec 05 15:34:09 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:34:09 user nova-compute[75080]:     <video>
Dec 05 15:34:09 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:34:09 user nova-compute[75080]:     </video>
Dec 05 15:34:09 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:34:09 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:34:09 user nova-compute[75080]:     </rng>
Dec 05 15:34:09 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:34:09 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:34:09 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:34:09 user nova-compute[75080]:     </memballoon>
Dec 05 15:34:09 user nova-compute[75080]:   </devices>
Dec 05 15:34:09 user nova-compute[75080]: </domain>
Dec 05 15:34:09 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:34:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1324524137',display_name='tempest-VolumesSnapshotTestJSON-instance-1324524137',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1324524137',id=34,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGulSmPsFCYlCumm8tBYOY8xbuZacLyInhaBVPorBEE+fURQDCzANEOHxo2Ocla5UEfvNOeZ+dlKCTS9kMCop/2fwlokJE+RCbft7p3lVYHCNLwVZxj60pTm9KrDxNKTtw==',key_name='tempest-keypair-1151776581',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e8a1b1f1ed346949ac0f633ae7e530b',ramdisk_id='',reservation_id='r-zm90okej',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1567075546',owner_user_name='tempest-VolumesSnapshotTestJSON-1567075546-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:34:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='025ecd26509b46b8b0157d0abe16eec8',uuid=a2482d35-2159-4605-b7af-da232886b8d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a92f7043-98a8-4f4e-be46-45fc5cc4778d", "address": "fa:16:3e:11:21:2b", "network": {"id": "eb187ccd-700a-49df-881f-c61d4b90e612", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053782949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e8a1b1f1ed346949ac0f633ae7e530b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa92f7043-98", "ovs_interfaceid": "a92f7043-98a8-4f4e-be46-45fc5cc4778d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Converting VIF {"id": "a92f7043-98a8-4f4e-be46-45fc5cc4778d", "address": "fa:16:3e:11:21:2b", "network": {"id": "eb187ccd-700a-49df-881f-c61d4b90e612", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053782949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e8a1b1f1ed346949ac0f633ae7e530b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa92f7043-98", "ovs_interfaceid": "a92f7043-98a8-4f4e-be46-45fc5cc4778d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:21:2b,bridge_name='br-int',has_traffic_filtering=True,id=a92f7043-98a8-4f4e-be46-45fc5cc4778d,network=Network(eb187ccd-700a-49df-881f-c61d4b90e612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa92f7043-98') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG os_vif [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:21:2b,bridge_name='br-int',has_traffic_filtering=True,id=a92f7043-98a8-4f4e-be46-45fc5cc4778d,network=Network(eb187ccd-700a-49df-881f-c61d4b90e612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa92f7043-98') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3dfa39ce-001c-5e48-9e9f-d526913613dc', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa92f7043-98, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa92f7043-98, col_values=(('qos', UUID('ecb4f5b0-e025-400d-9cb3-8cb11a9bbd47')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa92f7043-98, col_values=(('external_ids', {'iface-id': 'a92f7043-98a8-4f4e-be46-45fc5cc4778d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:21:2b', 'vm-uuid': 'a2482d35-2159-4605-b7af-da232886b8d3'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:09 user nova-compute[75080]: INFO os_vif [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:21:2b,bridge_name='br-int',has_traffic_filtering=True,id=a92f7043-98a8-4f4e-be46-45fc5cc4778d,network=Network(eb187ccd-700a-49df-881f-c61d4b90e612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa92f7043-98')
Dec 05 15:34:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] No VIF found with MAC fa:16:3e:11:21:2b, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG nova.network.neutron [req-49109b0e-088d-4c6d-902f-d2220dba5cff req-357c8307-ea5c-4e94-adb4-c26c7e40df9a service nova] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Updated VIF entry in instance network info cache for port a92f7043-98a8-4f4e-be46-45fc5cc4778d. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:34:09 user nova-compute[75080]: DEBUG nova.network.neutron [req-49109b0e-088d-4c6d-902f-d2220dba5cff req-357c8307-ea5c-4e94-adb4-c26c7e40df9a service nova] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Updating instance_info_cache with network_info: [{"id": "a92f7043-98a8-4f4e-be46-45fc5cc4778d", "address": "fa:16:3e:11:21:2b", "network": {"id": "eb187ccd-700a-49df-881f-c61d4b90e612", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053782949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e8a1b1f1ed346949ac0f633ae7e530b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa92f7043-98", "ovs_interfaceid": "a92f7043-98a8-4f4e-be46-45fc5cc4778d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:34:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-49109b0e-088d-4c6d-902f-d2220dba5cff req-357c8307-ea5c-4e94-adb4-c26c7e40df9a service nova] Releasing lock "refresh_cache-a2482d35-2159-4605-b7af-da232886b8d3" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:34:11 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:11 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:11 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:11 user nova-compute[75080]: DEBUG nova.compute.manager [req-9ec03b18-8076-4664-86fd-d49bdff7f8ea req-4862c692-a317-4162-a581-ed9437e1f0e5 service nova] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Received event network-vif-plugged-a92f7043-98a8-4f4e-be46-45fc5cc4778d {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:34:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9ec03b18-8076-4664-86fd-d49bdff7f8ea req-4862c692-a317-4162-a581-ed9437e1f0e5 service nova] Acquiring lock "a2482d35-2159-4605-b7af-da232886b8d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9ec03b18-8076-4664-86fd-d49bdff7f8ea req-4862c692-a317-4162-a581-ed9437e1f0e5 service nova] Lock "a2482d35-2159-4605-b7af-da232886b8d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9ec03b18-8076-4664-86fd-d49bdff7f8ea req-4862c692-a317-4162-a581-ed9437e1f0e5 service nova] Lock "a2482d35-2159-4605-b7af-da232886b8d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:11 user nova-compute[75080]: DEBUG nova.compute.manager [req-9ec03b18-8076-4664-86fd-d49bdff7f8ea req-4862c692-a317-4162-a581-ed9437e1f0e5 service nova] [instance: a2482d35-2159-4605-b7af-da232886b8d3] No waiting events found dispatching network-vif-plugged-a92f7043-98a8-4f4e-be46-45fc5cc4778d {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:34:11 user nova-compute[75080]: WARNING nova.compute.manager [req-9ec03b18-8076-4664-86fd-d49bdff7f8ea req-4862c692-a317-4162-a581-ed9437e1f0e5 service nova] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Received unexpected event network-vif-plugged-a92f7043-98a8-4f4e-be46-45fc5cc4778d for instance with vm_state building and task_state spawning.
Dec 05 15:34:11 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:11 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:11 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:11 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:13 user nova-compute[75080]: DEBUG nova.compute.manager [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:34:13 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:34:13 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Instance spawned successfully.
Dec 05 15:34:13 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:34:13 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:34:13 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:34:13 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:34:13 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:34:13 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:34:13 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:34:13 user nova-compute[75080]: INFO nova.compute.manager [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Took 5.54 seconds to spawn the instance on the hypervisor.
Dec 05 15:34:13 user nova-compute[75080]: DEBUG nova.compute.manager [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:34:13 user nova-compute[75080]: INFO nova.compute.manager [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Took 6.25 seconds to build instance.
Dec 05 15:34:13 user nova-compute[75080]: DEBUG nova.compute.manager [req-ddb6666e-764f-41cb-860f-87ed15810d2b req-233c1028-4c96-49f7-9bd5-fba1e62e4f9c service nova] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Received event network-vif-plugged-a92f7043-98a8-4f4e-be46-45fc5cc4778d {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:34:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-ddb6666e-764f-41cb-860f-87ed15810d2b req-233c1028-4c96-49f7-9bd5-fba1e62e4f9c service nova] Acquiring lock "a2482d35-2159-4605-b7af-da232886b8d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-ddb6666e-764f-41cb-860f-87ed15810d2b req-233c1028-4c96-49f7-9bd5-fba1e62e4f9c service nova] Lock "a2482d35-2159-4605-b7af-da232886b8d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-ddb6666e-764f-41cb-860f-87ed15810d2b req-233c1028-4c96-49f7-9bd5-fba1e62e4f9c service nova] Lock "a2482d35-2159-4605-b7af-da232886b8d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:13 user nova-compute[75080]: DEBUG nova.compute.manager [req-ddb6666e-764f-41cb-860f-87ed15810d2b req-233c1028-4c96-49f7-9bd5-fba1e62e4f9c service nova] [instance: a2482d35-2159-4605-b7af-da232886b8d3] No waiting events found dispatching network-vif-plugged-a92f7043-98a8-4f4e-be46-45fc5cc4778d {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:34:13 user nova-compute[75080]: WARNING nova.compute.manager [req-ddb6666e-764f-41cb-860f-87ed15810d2b req-233c1028-4c96-49f7-9bd5-fba1e62e4f9c service nova] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Received unexpected event network-vif-plugged-a92f7043-98a8-4f4e-be46-45fc5cc4778d for instance with vm_state active and task_state None.
Dec 05 15:34:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-20c76ae7-c81e-4823-b955-2b99284734ab tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "a2482d35-2159-4605-b7af-da232886b8d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.356s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:14 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Triggering sync for uuid eedd1529-4feb-4f85-8625-0c20d8e0359d {{(pid=75080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Triggering sync for uuid 07b025ff-4a9d-48a2-b950-b8f2d165f33c {{(pid=75080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Triggering sync for uuid ab882db7-e6d7-44ca-9ea4-ae2fa68f7929 {{(pid=75080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Triggering sync for uuid 011d3446-577a-4f5c-b8f0-ef04940cad17 {{(pid=75080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Triggering sync for uuid 308f6ec7-d5c1-46bf-95a4-036e1c192f7f {{(pid=75080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Triggering sync for uuid 40138071-fefc-4686-9344-7df255a1fc9d {{(pid=75080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Triggering sync for uuid b47129e8-c02b-4107-af4f-329173dd453f {{(pid=75080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Triggering sync for uuid 809b8f18-c3a3-4a06-878a-6c4694dc7547 {{(pid=75080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Triggering sync for uuid 94683fe5-8aff-4f71-9940-2d43df85e34d {{(pid=75080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Triggering sync for uuid a2482d35-2159-4605-b7af-da232886b8d3 {{(pid=75080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "eedd1529-4feb-4f85-8625-0c20d8e0359d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "eedd1529-4feb-4f85-8625-0c20d8e0359d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "07b025ff-4a9d-48a2-b950-b8f2d165f33c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "07b025ff-4a9d-48a2-b950-b8f2d165f33c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "011d3446-577a-4f5c-b8f0-ef04940cad17" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "40138071-fefc-4686-9344-7df255a1fc9d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "40138071-fefc-4686-9344-7df255a1fc9d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "b47129e8-c02b-4107-af4f-329173dd453f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "b47129e8-c02b-4107-af4f-329173dd453f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "809b8f18-c3a3-4a06-878a-6c4694dc7547" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "809b8f18-c3a3-4a06-878a-6c4694dc7547" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "94683fe5-8aff-4f71-9940-2d43df85e34d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "94683fe5-8aff-4f71-9940-2d43df85e34d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "a2482d35-2159-4605-b7af-da232886b8d3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "a2482d35-2159-4605-b7af-da232886b8d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "eedd1529-4feb-4f85-8625-0c20d8e0359d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "07b025ff-4a9d-48a2-b950-b8f2d165f33c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "40138071-fefc-4686-9344-7df255a1fc9d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "b47129e8-c02b-4107-af4f-329173dd453f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "94683fe5-8aff-4f71-9940-2d43df85e34d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "809b8f18-c3a3-4a06-878a-6c4694dc7547" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "a2482d35-2159-4605-b7af-da232886b8d3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:34:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 15:34:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:34:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:34:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-713fb48a-9498-4fe6-9070-433dc71c08a4 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "011d3446-577a-4f5c-b8f0-ef04940cad17" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-713fb48a-9498-4fe6-9070-433dc71c08a4 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:29 user nova-compute[75080]: INFO nova.compute.manager [None req-713fb48a-9498-4fe6-9070-433dc71c08a4 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Detaching volume 37794663-c414-4d76-8796-5c6c60f5efb0
Dec 05 15:34:29 user nova-compute[75080]: INFO nova.virt.block_device [None req-713fb48a-9498-4fe6-9070-433dc71c08a4 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Attempting to driver detach volume 37794663-c414-4d76-8796-5c6c60f5efb0 from mountpoint /dev/vdb
Dec 05 15:34:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-713fb48a-9498-4fe6-9070-433dc71c08a4 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Attempting to detach device vdb from instance 011d3446-577a-4f5c-b8f0-ef04940cad17 from the persistent domain config. {{(pid=75080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 15:34:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-713fb48a-9498-4fe6-9070-433dc71c08a4 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:34:29 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:34:29 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 15:34:29 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:34:29 user nova-compute[75080]:   <serial>37794663-c414-4d76-8796-5c6c60f5efb0</serial>
Dec 05 15:34:29 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 05 15:34:29 user nova-compute[75080]: </disk>
Dec 05 15:34:29 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:34:29 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-713fb48a-9498-4fe6-9070-433dc71c08a4 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Successfully detached device vdb from instance 011d3446-577a-4f5c-b8f0-ef04940cad17 from the persistent domain config.
Dec 05 15:34:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-713fb48a-9498-4fe6-9070-433dc71c08a4 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 011d3446-577a-4f5c-b8f0-ef04940cad17 from the live domain config. {{(pid=75080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 15:34:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-713fb48a-9498-4fe6-9070-433dc71c08a4 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:34:29 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:34:29 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 15:34:29 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:34:29 user nova-compute[75080]:   <serial>37794663-c414-4d76-8796-5c6c60f5efb0</serial>
Dec 05 15:34:29 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 05 15:34:29 user nova-compute[75080]: </disk>
Dec 05 15:34:29 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:34:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-713fb48a-9498-4fe6-9070-433dc71c08a4 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 011d3446-577a-4f5c-b8f0-ef04940cad17 {{(pid=75080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 15:34:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:36 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:34:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:37 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:34:37 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:34:37 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:34:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:41 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:34:41 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:34:41 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Rebuilding the list of instances to heal {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 15:34:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-eedd1529-4feb-4f85-8625-0c20d8e0359d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:34:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-eedd1529-4feb-4f85-8625-0c20d8e0359d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:34:41 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 15:34:41 user nova-compute[75080]: DEBUG nova.objects.instance [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lazy-loading 'info_cache' on Instance uuid eedd1529-4feb-4f85-8625-0c20d8e0359d {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:34:41 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Updating instance_info_cache with network_info: [{"id": "f0094ba7-45c2-445b-bd35-d5c7aedd68bd", "address": "fa:16:3e:f9:84:93", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0094ba7-45", "ovs_interfaceid": "f0094ba7-45c2-445b-bd35-d5c7aedd68bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:34:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-eedd1529-4feb-4f85-8625-0c20d8e0359d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:34:41 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 15:34:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:42 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:34:42 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:34:42 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:34:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:42 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:34:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:34:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:43 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:34:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94683fe5-8aff-4f71-9940-2d43df85e34d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94683fe5-8aff-4f71-9940-2d43df85e34d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94683fe5-8aff-4f71-9940-2d43df85e34d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94683fe5-8aff-4f71-9940-2d43df85e34d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:43 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:34:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2482d35-2159-4605-b7af-da232886b8d3/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2482d35-2159-4605-b7af-da232886b8d3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2482d35-2159-4605-b7af-da232886b8d3/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2482d35-2159-4605-b7af-da232886b8d3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:44 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:34:45 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:34:45 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:34:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=7780MB free_disk=24.999187469482422GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:34:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance eedd1529-4feb-4f85-8625-0c20d8e0359d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:34:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 07b025ff-4a9d-48a2-b950-b8f2d165f33c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:34:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance ab882db7-e6d7-44ca-9ea4-ae2fa68f7929 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:34:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 011d3446-577a-4f5c-b8f0-ef04940cad17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:34:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 40138071-fefc-4686-9344-7df255a1fc9d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:34:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 308f6ec7-d5c1-46bf-95a4-036e1c192f7f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:34:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance b47129e8-c02b-4107-af4f-329173dd453f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:34:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 809b8f18-c3a3-4a06-878a-6c4694dc7547 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:34:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 94683fe5-8aff-4f71-9940-2d43df85e34d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:34:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance a2482d35-2159-4605-b7af-da232886b8d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:34:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:34:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:34:45 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:34:45 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:34:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:34:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.412s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:47 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:34:47 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:49 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-713fb48a-9498-4fe6-9070-433dc71c08a4 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 011d3446-577a-4f5c-b8f0-ef04940cad17 is timed out.
Dec 05 15:34:49 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-713fb48a-9498-4fe6-9070-433dc71c08a4 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Successfully detached device vdb from instance 011d3446-577a-4f5c-b8f0-ef04940cad17 from the live domain config.
Dec 05 15:34:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-713fb48a-9498-4fe6-9070-433dc71c08a4 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fb48a-9498-4fe6-9070-433dc71c08a4 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZlSAkpE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:34:49 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-713fb48a-9498-4fe6-9070-433dc71c08a4 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:34:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-713fb48a-9498-4fe6-9070-433dc71c08a4 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-713fb48a-9498-4fe6-9070-433dc71c08a4 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3f39b8-9e9a-4d8d-98bd-0d6340cc6e07]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fb48a-9498-4fe6-9070-433dc71c08a4 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:34:49 user nova-compute[75080]: No targets found.
Dec 05 15:34:49 user nova-compute[75080]: iSNS:
Dec 05 15:34:49 user nova-compute[75080]: No targets found.
Dec 05 15:34:49 user nova-compute[75080]: STATIC:
Dec 05 15:34:49 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5
Dec 05 15:34:49 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:34:49 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:34:49 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399
Dec 05 15:34:49 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:34:49 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:34:49 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20
Dec 05 15:34:49 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:34:49 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:34:49 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0
Dec 05 15:34:49 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:34:49 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:34:49 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b
Dec 05 15:34:49 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:34:49 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:34:49 user nova-compute[75080]: FIRMWARE:
Dec 05 15:34:49 user nova-compute[75080]: No targets found.
Dec 05 15:34:49 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fb48a-9498-4fe6-9070-433dc71c08a4 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:34:49 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:34:49 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fb48a-9498-4fe6-9070-433dc71c08a4 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b26290-876a-4752-9974-2642377b8b1e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6474c091-eb3b-4055-8456-684ac6952491]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fb48a-9498-4fe6-9070-433dc71c08a4 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:34:49 user nova-compute[75080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:34:49 user nova-compute[75080]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:34:49 user nova-compute[75080]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)
Dec 05 15:34:49 user nova-compute[75080]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20 (non-flash)
Dec 05 15:34:49 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fb48a-9498-4fe6-9070-433dc71c08a4 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:34:49 user nova-compute[75080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:34:49 user nova-compute[75080]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:34:49 user nova-compute[75080]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 (non-flash)
Dec 05 15:34:49 user nova-compute[75080]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20 (non-flash)
Dec 05 15:34:49 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fb48a-9498-4fe6-9070-433dc71c08a4 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f663835d630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0'): ({'sdb'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-713fb48a-9498-4fe6-9070-433dc71c08a4 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Removing single pathed devices sdb {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d5492f-b22e-48a1-a165-e454b326281d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7cb1ea-478c-47b3-8049-0b3b276cc8af]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-713fb48a-9498-4fe6-9070-433dc71c08a4 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Flushing IO for device /dev/sdb {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36d6cfd-319d-47b2-868d-d4e6a73e6df1]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-713fb48a-9498-4fe6-9070-433dc71c08a4 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1759673d-957f-40d1-9298-4da02598301d]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-713fb48a-9498-4fe6-9070-433dc71c08a4 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-713fb48a-9498-4fe6-9070-433dc71c08a4 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fb48a-9498-4fe6-9070-433dc71c08a4 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dda86e4-0c3e-4162-912e-e53b14626d92]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fb48a-9498-4fe6-9070-433dc71c08a4 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:34:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:50 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e78d73-ed9d-427d-9d12-31a406db2f70]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:34:50 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fb48a-9498-4fe6-9070-433dc71c08a4 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0, portal: 172.16.0.220,3260]
Dec 05 15:34:50 user nova-compute[75080]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0, portal: 172.16.0.220,3260] successful.
Dec 05 15:34:50 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:34:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37794663-c414-4d76-8796-5c6c60f5efb0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:50 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[267b23b7-19b8-4567-b224-64470de349f5]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:34:50 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fb48a-9498-4fe6-9070-433dc71c08a4 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:34:50 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-713fb48a-9498-4fe6-9070-433dc71c08a4 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:34:50 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-713fb48a-9498-4fe6-9070-433dc71c08a4 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] <== disconnect_volume: return (334ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:34:50 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-713fb48a-9498-4fe6-9070-433dc71c08a4 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:34:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:51 user nova-compute[75080]: DEBUG nova.objects.instance [None req-713fb48a-9498-4fe6-9070-433dc71c08a4 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lazy-loading 'flavor' on Instance uuid 011d3446-577a-4f5c-b8f0-ef04940cad17 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:34:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-713fb48a-9498-4fe6-9070-433dc71c08a4 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.922s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-0384deae-c596-42ce-ab18-5ef26b2ecf3c req-7679439a-34c8-43e7-bbc4-de718ec3b187 service nova] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Received event network-changed-03461529-412e-4039-b713-4a170c38698e {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:34:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-0384deae-c596-42ce-ab18-5ef26b2ecf3c req-7679439a-34c8-43e7-bbc4-de718ec3b187 service nova] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Refreshing instance network info cache due to event network-changed-03461529-412e-4039-b713-4a170c38698e. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:34:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0384deae-c596-42ce-ab18-5ef26b2ecf3c req-7679439a-34c8-43e7-bbc4-de718ec3b187 service nova] Acquiring lock "refresh_cache-809b8f18-c3a3-4a06-878a-6c4694dc7547" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:34:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0384deae-c596-42ce-ab18-5ef26b2ecf3c req-7679439a-34c8-43e7-bbc4-de718ec3b187 service nova] Acquired lock "refresh_cache-809b8f18-c3a3-4a06-878a-6c4694dc7547" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:34:51 user nova-compute[75080]: DEBUG nova.network.neutron [req-0384deae-c596-42ce-ab18-5ef26b2ecf3c req-7679439a-34c8-43e7-bbc4-de718ec3b187 service nova] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Refreshing network info cache for port 03461529-412e-4039-b713-4a170c38698e {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:34:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-afca604c-a2a0-4c56-800d-d0ed1f7b280a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "011d3446-577a-4f5c-b8f0-ef04940cad17" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-afca604c-a2a0-4c56-800d-d0ed1f7b280a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:52 user nova-compute[75080]: DEBUG nova.compute.manager [None req-afca604c-a2a0-4c56-800d-d0ed1f7b280a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:34:52 user nova-compute[75080]: DEBUG nova.compute.manager [None req-afca604c-a2a0-4c56-800d-d0ed1f7b280a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75080) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Dec 05 15:34:52 user nova-compute[75080]: DEBUG nova.objects.instance [None req-afca604c-a2a0-4c56-800d-d0ed1f7b280a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lazy-loading 'flavor' on Instance uuid 011d3446-577a-4f5c-b8f0-ef04940cad17 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:34:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:52 user nova-compute[75080]: DEBUG nova.network.neutron [req-0384deae-c596-42ce-ab18-5ef26b2ecf3c req-7679439a-34c8-43e7-bbc4-de718ec3b187 service nova] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Updated VIF entry in instance network info cache for port 03461529-412e-4039-b713-4a170c38698e. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:34:52 user nova-compute[75080]: DEBUG nova.network.neutron [req-0384deae-c596-42ce-ab18-5ef26b2ecf3c req-7679439a-34c8-43e7-bbc4-de718ec3b187 service nova] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Updating instance_info_cache with network_info: [{"id": "03461529-412e-4039-b713-4a170c38698e", "address": "fa:16:3e:06:0b:05", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03461529-41", "ovs_interfaceid": "03461529-412e-4039-b713-4a170c38698e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:34:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0384deae-c596-42ce-ab18-5ef26b2ecf3c req-7679439a-34c8-43e7-bbc4-de718ec3b187 service nova] Releasing lock "refresh_cache-809b8f18-c3a3-4a06-878a-6c4694dc7547" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:34:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:52 user nova-compute[75080]: DEBUG nova.compute.manager [req-63bd123d-1cb8-406f-892c-c467ecb8f967 req-4ca1e38b-a7fa-4caa-80f0-e1ce2c0e2683 service nova] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Received event network-changed-03461529-412e-4039-b713-4a170c38698e {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:34:52 user nova-compute[75080]: DEBUG nova.compute.manager [req-63bd123d-1cb8-406f-892c-c467ecb8f967 req-4ca1e38b-a7fa-4caa-80f0-e1ce2c0e2683 service nova] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Refreshing instance network info cache due to event network-changed-03461529-412e-4039-b713-4a170c38698e. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:34:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-63bd123d-1cb8-406f-892c-c467ecb8f967 req-4ca1e38b-a7fa-4caa-80f0-e1ce2c0e2683 service nova] Acquiring lock "refresh_cache-809b8f18-c3a3-4a06-878a-6c4694dc7547" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:34:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-63bd123d-1cb8-406f-892c-c467ecb8f967 req-4ca1e38b-a7fa-4caa-80f0-e1ce2c0e2683 service nova] Acquired lock "refresh_cache-809b8f18-c3a3-4a06-878a-6c4694dc7547" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:34:52 user nova-compute[75080]: DEBUG nova.network.neutron [req-63bd123d-1cb8-406f-892c-c467ecb8f967 req-4ca1e38b-a7fa-4caa-80f0-e1ce2c0e2683 service nova] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Refreshing network info cache for port 03461529-412e-4039-b713-4a170c38698e {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:34:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "809b8f18-c3a3-4a06-878a-6c4694dc7547" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "809b8f18-c3a3-4a06-878a-6c4694dc7547" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "809b8f18-c3a3-4a06-878a-6c4694dc7547-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "809b8f18-c3a3-4a06-878a-6c4694dc7547-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "809b8f18-c3a3-4a06-878a-6c4694dc7547-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:52 user nova-compute[75080]: INFO nova.compute.manager [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Terminating instance
Dec 05 15:34:52 user nova-compute[75080]: DEBUG nova.compute.manager [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:34:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:52 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Instance destroyed successfully.
Dec 05 15:34:52 user nova-compute[75080]: DEBUG nova.compute.manager [None req-afca604c-a2a0-4c56-800d-d0ed1f7b280a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:34:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-afca604c-a2a0-4c56-800d-d0ed1f7b280a tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.866s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG nova.compute.manager [req-6be157c9-12e7-4815-b461-bbd5a4e29dc7 req-3db0f4f2-9ab7-4388-9db2-7bc4b7f1223d service nova] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Received event network-vif-unplugged-03461529-412e-4039-b713-4a170c38698e {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-6be157c9-12e7-4815-b461-bbd5a4e29dc7 req-3db0f4f2-9ab7-4388-9db2-7bc4b7f1223d service nova] Acquiring lock "809b8f18-c3a3-4a06-878a-6c4694dc7547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-6be157c9-12e7-4815-b461-bbd5a4e29dc7 req-3db0f4f2-9ab7-4388-9db2-7bc4b7f1223d service nova] Lock "809b8f18-c3a3-4a06-878a-6c4694dc7547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-6be157c9-12e7-4815-b461-bbd5a4e29dc7 req-3db0f4f2-9ab7-4388-9db2-7bc4b7f1223d service nova] Lock "809b8f18-c3a3-4a06-878a-6c4694dc7547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG nova.compute.manager [req-6be157c9-12e7-4815-b461-bbd5a4e29dc7 req-3db0f4f2-9ab7-4388-9db2-7bc4b7f1223d service nova] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] No waiting events found dispatching network-vif-unplugged-03461529-412e-4039-b713-4a170c38698e {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG nova.compute.manager [req-6be157c9-12e7-4815-b461-bbd5a4e29dc7 req-3db0f4f2-9ab7-4388-9db2-7bc4b7f1223d service nova] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Received event network-vif-unplugged-03461529-412e-4039-b713-4a170c38698e for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:34:53 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Instance destroyed successfully.
Dec 05 15:34:53 user nova-compute[75080]: DEBUG nova.objects.instance [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lazy-loading 'resources' on Instance uuid 809b8f18-c3a3-4a06-878a-6c4694dc7547 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:32:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1690542588',display_name='tempest-TestVolumeBootPattern-server-1690542588',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1690542588',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbodyAsCj/LsLD4+fqj081LHmxK6h/6lXtC6JTYG6GWTlsJ9L34SglBGh22zHQ6DhZ8jkeGO+vsFyUrlKxX0aNv4V7kDdiXAt2Ew2tgqS8jk69Jg7JlqDhZvfUPpLsuMg==',key_name='tempest-TestVolumeBootPattern-1935536975',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:33:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11227acd507347ae9c5a3bc710707f84',ramdisk_id='',reservation_id='r-h0lts48r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-23416231',owner_user_name='tempest-TestVolumeBootPattern-23416231-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:33:18Z,user_data=None,user_id='15be5b54cc8346bb86683e4ed2fbba9e',uuid=809b8f18-c3a3-4a06-878a-6c4694dc7547,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03461529-412e-4039-b713-4a170c38698e", "address": "fa:16:3e:06:0b:05", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03461529-41", "ovs_interfaceid": "03461529-412e-4039-b713-4a170c38698e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Converting VIF {"id": "03461529-412e-4039-b713-4a170c38698e", "address": "fa:16:3e:06:0b:05", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03461529-41", "ovs_interfaceid": "03461529-412e-4039-b713-4a170c38698e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:0b:05,bridge_name='br-int',has_traffic_filtering=True,id=03461529-412e-4039-b713-4a170c38698e,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03461529-41') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG os_vif [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:0b:05,bridge_name='br-int',has_traffic_filtering=True,id=03461529-412e-4039-b713-4a170c38698e,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03461529-41') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03461529-41, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG nova.network.neutron [req-63bd123d-1cb8-406f-892c-c467ecb8f967 req-4ca1e38b-a7fa-4caa-80f0-e1ce2c0e2683 service nova] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Updated VIF entry in instance network info cache for port 03461529-412e-4039-b713-4a170c38698e. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG nova.network.neutron [req-63bd123d-1cb8-406f-892c-c467ecb8f967 req-4ca1e38b-a7fa-4caa-80f0-e1ce2c0e2683 service nova] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Updating instance_info_cache with network_info: [{"id": "03461529-412e-4039-b713-4a170c38698e", "address": "fa:16:3e:06:0b:05", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03461529-41", "ovs_interfaceid": "03461529-412e-4039-b713-4a170c38698e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bb7b0631-a0db-4dd9-b33b-62d06cde94d7) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:53 user nova-compute[75080]: INFO os_vif [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:0b:05,bridge_name='br-int',has_traffic_filtering=True,id=03461529-412e-4039-b713-4a170c38698e,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03461529-41')
Dec 05 15:34:53 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'REwJMSmY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:34:53 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:34:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-63bd123d-1cb8-406f-892c-c467ecb8f967 req-4ca1e38b-a7fa-4caa-80f0-e1ce2c0e2683 service nova] Releasing lock "refresh_cache-809b8f18-c3a3-4a06-878a-6c4694dc7547" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[081ffc36-ffc7-48ad-8bca-a52f09e041cf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:34:53 user nova-compute[75080]: No targets found.
Dec 05 15:34:53 user nova-compute[75080]: iSNS:
Dec 05 15:34:53 user nova-compute[75080]: No targets found.
Dec 05 15:34:53 user nova-compute[75080]: STATIC:
Dec 05 15:34:53 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5
Dec 05 15:34:53 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:34:53 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:34:53 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399
Dec 05 15:34:53 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:34:53 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:34:53 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20
Dec 05 15:34:53 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:34:53 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:34:53 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b
Dec 05 15:34:53 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:34:53 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:34:53 user nova-compute[75080]: FIRMWARE:
Dec 05 15:34:53 user nova-compute[75080]: No targets found.
Dec 05 15:34:53 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:34:53 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:34:53 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba106d7-b777-4dd3-a7da-5e17351c3444]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f382737f-5aae-480a-9949-eb3c03031cef]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:34:53 user nova-compute[75080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:34:53 user nova-compute[75080]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:34:53 user nova-compute[75080]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20 (non-flash)
Dec 05 15:34:53 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:34:53 user nova-compute[75080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:34:53 user nova-compute[75080]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:34:53 user nova-compute[75080]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20 (non-flash)
Dec 05 15:34:53 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f66384bb010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20'): ({'sdf'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Removing single pathed devices sdf {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d9e010-fdef-4051-90b6-22409bc8f3ab]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[23834af2-a5f9-43fa-90bf-46ec7d479796]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Flushing IO for device /dev/sdf {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e238909b-c379-467a-b3f6-aa8c45cf19a4]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c825ed-0c0b-4b3f-b92e-3cfb8aafffc2]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] SCSI volumes sdf have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0502cec-06d3-4ad9-a071-dd03814d8682]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20 -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0e746d-f3fb-46a0-93be-bd43a75e203d]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20, portal: 172.16.0.220,3260]
Dec 05 15:34:53 user nova-compute[75080]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20, portal: 172.16.0.220,3260] successful.
Dec 05 15:34:53 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20 -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d2954-223d-4744-b22e-bf29d049ab20 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[54723681-049d-4cc2-8b47-fa6c660913de]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] <== disconnect_volume: return (329ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:34:53 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Deleting instance files /opt/stack/data/nova/instances/809b8f18-c3a3-4a06-878a-6c4694dc7547_del
Dec 05 15:34:53 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Deletion of /opt/stack/data/nova/instances/809b8f18-c3a3-4a06-878a-6c4694dc7547_del complete
Dec 05 15:34:53 user nova-compute[75080]: DEBUG nova.compute.manager [req-174b11d3-1354-4615-a39b-bfd63f50d85a req-4e7d4b2d-7afe-4a20-90a1-f0fbf784e168 service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Received event network-vif-unplugged-dfee0a0e-5241-4d51-879d-7667bb06344b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-174b11d3-1354-4615-a39b-bfd63f50d85a req-4e7d4b2d-7afe-4a20-90a1-f0fbf784e168 service nova] Acquiring lock "011d3446-577a-4f5c-b8f0-ef04940cad17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-174b11d3-1354-4615-a39b-bfd63f50d85a req-4e7d4b2d-7afe-4a20-90a1-f0fbf784e168 service nova] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-174b11d3-1354-4615-a39b-bfd63f50d85a req-4e7d4b2d-7afe-4a20-90a1-f0fbf784e168 service nova] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG nova.compute.manager [req-174b11d3-1354-4615-a39b-bfd63f50d85a req-4e7d4b2d-7afe-4a20-90a1-f0fbf784e168 service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] No waiting events found dispatching network-vif-unplugged-dfee0a0e-5241-4d51-879d-7667bb06344b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:34:53 user nova-compute[75080]: WARNING nova.compute.manager [req-174b11d3-1354-4615-a39b-bfd63f50d85a req-4e7d4b2d-7afe-4a20-90a1-f0fbf784e168 service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Received unexpected event network-vif-unplugged-dfee0a0e-5241-4d51-879d-7667bb06344b for instance with vm_state stopped and task_state None.
Dec 05 15:34:53 user nova-compute[75080]: DEBUG nova.compute.manager [req-174b11d3-1354-4615-a39b-bfd63f50d85a req-4e7d4b2d-7afe-4a20-90a1-f0fbf784e168 service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Received event network-vif-plugged-dfee0a0e-5241-4d51-879d-7667bb06344b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-174b11d3-1354-4615-a39b-bfd63f50d85a req-4e7d4b2d-7afe-4a20-90a1-f0fbf784e168 service nova] Acquiring lock "011d3446-577a-4f5c-b8f0-ef04940cad17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-174b11d3-1354-4615-a39b-bfd63f50d85a req-4e7d4b2d-7afe-4a20-90a1-f0fbf784e168 service nova] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-174b11d3-1354-4615-a39b-bfd63f50d85a req-4e7d4b2d-7afe-4a20-90a1-f0fbf784e168 service nova] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG nova.compute.manager [req-174b11d3-1354-4615-a39b-bfd63f50d85a req-4e7d4b2d-7afe-4a20-90a1-f0fbf784e168 service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] No waiting events found dispatching network-vif-plugged-dfee0a0e-5241-4d51-879d-7667bb06344b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:34:53 user nova-compute[75080]: WARNING nova.compute.manager [req-174b11d3-1354-4615-a39b-bfd63f50d85a req-4e7d4b2d-7afe-4a20-90a1-f0fbf784e168 service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Received unexpected event network-vif-plugged-dfee0a0e-5241-4d51-879d-7667bb06344b for instance with vm_state stopped and task_state None.
Dec 05 15:34:53 user nova-compute[75080]: INFO nova.compute.manager [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Took 1.21 seconds to destroy the instance on the hypervisor.
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "b5a4b977-1e76-45c7-bf97-b4db5fb615e2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "b5a4b977-1e76-45c7-bf97-b4db5fb615e2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:53 user nova-compute[75080]: DEBUG nova.compute.manager [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:34:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:54 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:34:54 user nova-compute[75080]: INFO nova.compute.claims [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Claim successful on node user
Dec 05 15:34:54 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:34:54 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Took 0.56 seconds to deallocate network for instance.
Dec 05 15:34:54 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:34:54 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:34:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:54 user nova-compute[75080]: DEBUG nova.compute.manager [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:34:54 user nova-compute[75080]: DEBUG nova.compute.manager [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:34:54 user nova-compute[75080]: DEBUG nova.network.neutron [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:34:54 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:34:54 user nova-compute[75080]: DEBUG nova.compute.manager [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:34:54 user nova-compute[75080]: DEBUG nova.policy [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72a1c29faca44a4095dbda09561e5a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350b8a7b0ce4af7b83a280c0c1ec3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:34:54 user nova-compute[75080]: DEBUG nova.compute.manager [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:34:54 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:34:54 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Creating image(s)
Dec 05 15:34:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "/opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "/opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.173s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.177s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:55 user nova-compute[75080]: DEBUG nova.compute.manager [req-b2bfadd4-03c2-443d-b5a4-d83495bd928c req-35cc4eeb-26b1-4f2d-ba1a-ad472184541f service nova] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Received event network-vif-plugged-03461529-412e-4039-b713-4a170c38698e {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:34:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-b2bfadd4-03c2-443d-b5a4-d83495bd928c req-35cc4eeb-26b1-4f2d-ba1a-ad472184541f service nova] Acquiring lock "809b8f18-c3a3-4a06-878a-6c4694dc7547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-b2bfadd4-03c2-443d-b5a4-d83495bd928c req-35cc4eeb-26b1-4f2d-ba1a-ad472184541f service nova] Lock "809b8f18-c3a3-4a06-878a-6c4694dc7547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-b2bfadd4-03c2-443d-b5a4-d83495bd928c req-35cc4eeb-26b1-4f2d-ba1a-ad472184541f service nova] Lock "809b8f18-c3a3-4a06-878a-6c4694dc7547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:55 user nova-compute[75080]: DEBUG nova.compute.manager [req-b2bfadd4-03c2-443d-b5a4-d83495bd928c req-35cc4eeb-26b1-4f2d-ba1a-ad472184541f service nova] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] No waiting events found dispatching network-vif-plugged-03461529-412e-4039-b713-4a170c38698e {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:34:55 user nova-compute[75080]: WARNING nova.compute.manager [req-b2bfadd4-03c2-443d-b5a4-d83495bd928c req-35cc4eeb-26b1-4f2d-ba1a-ad472184541f service nova] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Received unexpected event network-vif-plugged-03461529-412e-4039-b713-4a170c38698e for instance with vm_state active and task_state deleting.
Dec 05 15:34:55 user nova-compute[75080]: DEBUG nova.compute.manager [req-b2bfadd4-03c2-443d-b5a4-d83495bd928c req-35cc4eeb-26b1-4f2d-ba1a-ad472184541f service nova] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Received event network-vif-deleted-03461529-412e-4039-b713-4a170c38698e {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:34:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2/disk 1073741824" returned: 0 in 0.052s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:55 user nova-compute[75080]: INFO nova.compute.manager [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 809b8f18-c3a3-4a06-878a-6c4694dc7547] Took 1.05 seconds to detach 1 volumes for instance.
Dec 05 15:34:55 user nova-compute[75080]: DEBUG nova.network.neutron [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Successfully created port: 4fcca870-3cc7-4338-b912-84e32dc7d4c0 {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:34:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.190s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:55 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 15:34:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:34:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:34:55 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Cannot resize image /opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 15:34:55 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:34:55 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Ensure instance console log exists: /opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:34:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:55 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:34:55 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:34:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.437s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:55 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Deleted allocations for instance 809b8f18-c3a3-4a06-878a-6c4694dc7547
Dec 05 15:34:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-dde428c9-565a-421a-8bd3-ce2be036045f tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "809b8f18-c3a3-4a06-878a-6c4694dc7547" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.477s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG nova.network.neutron [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Successfully updated port: 4fcca870-3cc7-4338-b912-84e32dc7d4c0 {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "refresh_cache-b5a4b977-1e76-45c7-bf97-b4db5fb615e2" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquired lock "refresh_cache-b5a4b977-1e76-45c7-bf97-b4db5fb615e2" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG nova.network.neutron [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG nova.network.neutron [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG nova.network.neutron [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Updating instance_info_cache with network_info: [{"id": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "address": "fa:16:3e:c3:a0:3b", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fcca870-3c", "ovs_interfaceid": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Releasing lock "refresh_cache-b5a4b977-1e76-45c7-bf97-b4db5fb615e2" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG nova.compute.manager [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Instance network_info: |[{"id": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "address": "fa:16:3e:c3:a0:3b", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fcca870-3c", "ovs_interfaceid": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Start _get_guest_xml network_info=[{"id": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "address": "fa:16:3e:c3:a0:3b", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fcca870-3c", "ovs_interfaceid": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:34:56 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:34:56 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:34:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:34:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-951113717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-951113717',id=35,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKBO63DOhU+xhQzfzScYvd8cH7epBciaesPrZyAVqXwpkpGKTiFjE9AiOmbkLAgktbf3ya7OlNM2u5P2yMCu6Vc9LOTQMY57W9Z9bmYvYbSt+s8cBaUKdRs9xFP2gX0YQ==',key_name='tempest-keypair-331505788',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6350b8a7b0ce4af7b83a280c0c1ec3e6',ramdisk_id='',reservation_id='r-goq5cviw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-132988477',owner_user_name='tempest-AttachVolumeShelveTestJSON-132988477-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:34:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72a1c29faca44a4095dbda09561e5a91',uuid=b5a4b977-1e76-45c7-bf97-b4db5fb615e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "address": "fa:16:3e:c3:a0:3b", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fcca870-3c", "ovs_interfaceid": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Converting VIF {"id": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "address": "fa:16:3e:c3:a0:3b", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fcca870-3c", "ovs_interfaceid": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a0:3b,bridge_name='br-int',has_traffic_filtering=True,id=4fcca870-3cc7-4338-b912-84e32dc7d4c0,network=Network(b94a6985-25b3-480e-b79f-b753c8b23fa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fcca870-3c') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG nova.objects.instance [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lazy-loading 'pci_devices' on Instance uuid b5a4b977-1e76-45c7-bf97-b4db5fb615e2 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:34:56 user nova-compute[75080]:   <uuid>b5a4b977-1e76-45c7-bf97-b4db5fb615e2</uuid>
Dec 05 15:34:56 user nova-compute[75080]:   <name>instance-00000023</name>
Dec 05 15:34:56 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:34:56 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:34:56 user nova-compute[75080]:   <metadata>
Dec 05 15:34:56 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:34:56 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:34:56 user nova-compute[75080]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-951113717</nova:name>
Dec 05 15:34:56 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:34:56</nova:creationTime>
Dec 05 15:34:56 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:34:56 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:34:56 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:34:56 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:34:56 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:34:56 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:34:56 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:34:56 user nova-compute[75080]:       <nova:owner>
Dec 05 15:34:56 user nova-compute[75080]:         <nova:user uuid="72a1c29faca44a4095dbda09561e5a91">tempest-AttachVolumeShelveTestJSON-132988477-project-member</nova:user>
Dec 05 15:34:56 user nova-compute[75080]:         <nova:project uuid="6350b8a7b0ce4af7b83a280c0c1ec3e6">tempest-AttachVolumeShelveTestJSON-132988477</nova:project>
Dec 05 15:34:56 user nova-compute[75080]:       </nova:owner>
Dec 05 15:34:56 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:34:56 user nova-compute[75080]:       <nova:ports>
Dec 05 15:34:56 user nova-compute[75080]:         <nova:port uuid="4fcca870-3cc7-4338-b912-84e32dc7d4c0">
Dec 05 15:34:56 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 05 15:34:56 user nova-compute[75080]:         </nova:port>
Dec 05 15:34:56 user nova-compute[75080]:       </nova:ports>
Dec 05 15:34:56 user nova-compute[75080]:     </nova:instance>
Dec 05 15:34:56 user nova-compute[75080]:   </metadata>
Dec 05 15:34:56 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:34:56 user nova-compute[75080]:     <system>
Dec 05 15:34:56 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:34:56 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:34:56 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:34:56 user nova-compute[75080]:       <entry name="serial">b5a4b977-1e76-45c7-bf97-b4db5fb615e2</entry>
Dec 05 15:34:56 user nova-compute[75080]:       <entry name="uuid">b5a4b977-1e76-45c7-bf97-b4db5fb615e2</entry>
Dec 05 15:34:56 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:34:56 user nova-compute[75080]:     </system>
Dec 05 15:34:56 user nova-compute[75080]:   </sysinfo>
Dec 05 15:34:56 user nova-compute[75080]:   <os>
Dec 05 15:34:56 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:34:56 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:34:56 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:34:56 user nova-compute[75080]:   </os>
Dec 05 15:34:56 user nova-compute[75080]:   <features>
Dec 05 15:34:56 user nova-compute[75080]:     <acpi/>
Dec 05 15:34:56 user nova-compute[75080]:     <apic/>
Dec 05 15:34:56 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:34:56 user nova-compute[75080]:   </features>
Dec 05 15:34:56 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:34:56 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:34:56 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:34:56 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:34:56 user nova-compute[75080]:   </clock>
Dec 05 15:34:56 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:34:56 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:34:56 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:34:56 user nova-compute[75080]:   </cpu>
Dec 05 15:34:56 user nova-compute[75080]:   <devices>
Dec 05 15:34:56 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:34:56 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:34:56 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2/disk"/>
Dec 05 15:34:56 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:34:56 user nova-compute[75080]:     </disk>
Dec 05 15:34:56 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:34:56 user nova-compute[75080]:       <mac address="fa:16:3e:c3:a0:3b"/>
Dec 05 15:34:56 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:34:56 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:34:56 user nova-compute[75080]:       <target dev="tap4fcca870-3c"/>
Dec 05 15:34:56 user nova-compute[75080]:     </interface>
Dec 05 15:34:56 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:34:56 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2/console.log" append="off"/>
Dec 05 15:34:56 user nova-compute[75080]:     </serial>
Dec 05 15:34:56 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:34:56 user nova-compute[75080]:     <video>
Dec 05 15:34:56 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:34:56 user nova-compute[75080]:     </video>
Dec 05 15:34:56 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:34:56 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:34:56 user nova-compute[75080]:     </rng>
Dec 05 15:34:56 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:34:56 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:34:56 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:34:56 user nova-compute[75080]:     </memballoon>
Dec 05 15:34:56 user nova-compute[75080]:   </devices>
Dec 05 15:34:56 user nova-compute[75080]: </domain>
Dec 05 15:34:56 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:34:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-951113717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-951113717',id=35,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKBO63DOhU+xhQzfzScYvd8cH7epBciaesPrZyAVqXwpkpGKTiFjE9AiOmbkLAgktbf3ya7OlNM2u5P2yMCu6Vc9LOTQMY57W9Z9bmYvYbSt+s8cBaUKdRs9xFP2gX0YQ==',key_name='tempest-keypair-331505788',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6350b8a7b0ce4af7b83a280c0c1ec3e6',ramdisk_id='',reservation_id='r-goq5cviw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-132988477',owner_user_name='tempest-AttachVolumeShelveTestJSON-132988477-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:34:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72a1c29faca44a4095dbda09561e5a91',uuid=b5a4b977-1e76-45c7-bf97-b4db5fb615e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "address": "fa:16:3e:c3:a0:3b", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fcca870-3c", "ovs_interfaceid": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Converting VIF {"id": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "address": "fa:16:3e:c3:a0:3b", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fcca870-3c", "ovs_interfaceid": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a0:3b,bridge_name='br-int',has_traffic_filtering=True,id=4fcca870-3cc7-4338-b912-84e32dc7d4c0,network=Network(b94a6985-25b3-480e-b79f-b753c8b23fa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fcca870-3c') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG os_vif [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a0:3b,bridge_name='br-int',has_traffic_filtering=True,id=4fcca870-3cc7-4338-b912-84e32dc7d4c0,network=Network(b94a6985-25b3-480e-b79f-b753c8b23fa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fcca870-3c') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd7373c10-9052-56ea-a4c9-4b652ac6bebd', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4fcca870-3c, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4fcca870-3c, col_values=(('qos', UUID('914f3717-8d7e-4585-8914-88c76b9d7d48')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4fcca870-3c, col_values=(('external_ids', {'iface-id': '4fcca870-3cc7-4338-b912-84e32dc7d4c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:a0:3b', 'vm-uuid': 'b5a4b977-1e76-45c7-bf97-b4db5fb615e2'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:56 user nova-compute[75080]: INFO os_vif [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a0:3b,bridge_name='br-int',has_traffic_filtering=True,id=4fcca870-3cc7-4338-b912-84e32dc7d4c0,network=Network(b94a6985-25b3-480e-b79f-b753c8b23fa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fcca870-3c')
Dec 05 15:34:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:34:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] No VIF found with MAC fa:16:3e:c3:a0:3b, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:34:56 user nova-compute[75080]: INFO nova.compute.manager [None req-7ad42dad-0798-40af-8571-335b1e6f3828 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Get console output
Dec 05 15:34:57 user nova-compute[75080]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Dec 05 15:34:57 user nova-compute[75080]: DEBUG nova.compute.manager [req-1e3a4ab0-0d4d-4d09-a87f-5e9664110ecd req-62062045-f77c-4c55-900d-dd138229cf20 service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Received event network-changed-4fcca870-3cc7-4338-b912-84e32dc7d4c0 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:34:57 user nova-compute[75080]: DEBUG nova.compute.manager [req-1e3a4ab0-0d4d-4d09-a87f-5e9664110ecd req-62062045-f77c-4c55-900d-dd138229cf20 service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Refreshing instance network info cache due to event network-changed-4fcca870-3cc7-4338-b912-84e32dc7d4c0. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:34:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-1e3a4ab0-0d4d-4d09-a87f-5e9664110ecd req-62062045-f77c-4c55-900d-dd138229cf20 service nova] Acquiring lock "refresh_cache-b5a4b977-1e76-45c7-bf97-b4db5fb615e2" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:34:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-1e3a4ab0-0d4d-4d09-a87f-5e9664110ecd req-62062045-f77c-4c55-900d-dd138229cf20 service nova] Acquired lock "refresh_cache-b5a4b977-1e76-45c7-bf97-b4db5fb615e2" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:34:57 user nova-compute[75080]: DEBUG nova.network.neutron [req-1e3a4ab0-0d4d-4d09-a87f-5e9664110ecd req-62062045-f77c-4c55-900d-dd138229cf20 service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Refreshing network info cache for port 4fcca870-3cc7-4338-b912-84e32dc7d4c0 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:34:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:57 user nova-compute[75080]: DEBUG nova.network.neutron [req-1e3a4ab0-0d4d-4d09-a87f-5e9664110ecd req-62062045-f77c-4c55-900d-dd138229cf20 service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Updated VIF entry in instance network info cache for port 4fcca870-3cc7-4338-b912-84e32dc7d4c0. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:34:57 user nova-compute[75080]: DEBUG nova.network.neutron [req-1e3a4ab0-0d4d-4d09-a87f-5e9664110ecd req-62062045-f77c-4c55-900d-dd138229cf20 service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Updating instance_info_cache with network_info: [{"id": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "address": "fa:16:3e:c3:a0:3b", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fcca870-3c", "ovs_interfaceid": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:34:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-1e3a4ab0-0d4d-4d09-a87f-5e9664110ecd req-62062045-f77c-4c55-900d-dd138229cf20 service nova] Releasing lock "refresh_cache-b5a4b977-1e76-45c7-bf97-b4db5fb615e2" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:34:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:58 user nova-compute[75080]: DEBUG nova.compute.manager [req-eff82af6-921b-4bff-ab13-4a5abdb18e09 req-99804790-1103-4339-bc59-694cbcad4d5e service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Received event network-vif-plugged-4fcca870-3cc7-4338-b912-84e32dc7d4c0 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:34:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-eff82af6-921b-4bff-ab13-4a5abdb18e09 req-99804790-1103-4339-bc59-694cbcad4d5e service nova] Acquiring lock "b5a4b977-1e76-45c7-bf97-b4db5fb615e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:34:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-eff82af6-921b-4bff-ab13-4a5abdb18e09 req-99804790-1103-4339-bc59-694cbcad4d5e service nova] Lock "b5a4b977-1e76-45c7-bf97-b4db5fb615e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:34:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-eff82af6-921b-4bff-ab13-4a5abdb18e09 req-99804790-1103-4339-bc59-694cbcad4d5e service nova] Lock "b5a4b977-1e76-45c7-bf97-b4db5fb615e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:34:58 user nova-compute[75080]: DEBUG nova.compute.manager [req-eff82af6-921b-4bff-ab13-4a5abdb18e09 req-99804790-1103-4339-bc59-694cbcad4d5e service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] No waiting events found dispatching network-vif-plugged-4fcca870-3cc7-4338-b912-84e32dc7d4c0 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:34:58 user nova-compute[75080]: WARNING nova.compute.manager [req-eff82af6-921b-4bff-ab13-4a5abdb18e09 req-99804790-1103-4339-bc59-694cbcad4d5e service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Received unexpected event network-vif-plugged-4fcca870-3cc7-4338-b912-84e32dc7d4c0 for instance with vm_state building and task_state spawning.
Dec 05 15:34:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:34:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:00 user nova-compute[75080]: DEBUG nova.compute.manager [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:35:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:35:00 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Instance spawned successfully.
Dec 05 15:35:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:35:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:35:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:35:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:35:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:35:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:35:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:35:00 user nova-compute[75080]: INFO nova.compute.manager [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Took 5.60 seconds to spawn the instance on the hypervisor.
Dec 05 15:35:00 user nova-compute[75080]: DEBUG nova.compute.manager [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:35:00 user nova-compute[75080]: DEBUG nova.compute.manager [req-6eb28ef6-b79b-4a21-9c52-3011bb684518 req-0273f905-7da2-43e8-b9c0-302a54e8a9d3 service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Received event network-vif-plugged-4fcca870-3cc7-4338-b912-84e32dc7d4c0 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:35:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-6eb28ef6-b79b-4a21-9c52-3011bb684518 req-0273f905-7da2-43e8-b9c0-302a54e8a9d3 service nova] Acquiring lock "b5a4b977-1e76-45c7-bf97-b4db5fb615e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:35:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-6eb28ef6-b79b-4a21-9c52-3011bb684518 req-0273f905-7da2-43e8-b9c0-302a54e8a9d3 service nova] Lock "b5a4b977-1e76-45c7-bf97-b4db5fb615e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:35:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-6eb28ef6-b79b-4a21-9c52-3011bb684518 req-0273f905-7da2-43e8-b9c0-302a54e8a9d3 service nova] Lock "b5a4b977-1e76-45c7-bf97-b4db5fb615e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:35:00 user nova-compute[75080]: DEBUG nova.compute.manager [req-6eb28ef6-b79b-4a21-9c52-3011bb684518 req-0273f905-7da2-43e8-b9c0-302a54e8a9d3 service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] No waiting events found dispatching network-vif-plugged-4fcca870-3cc7-4338-b912-84e32dc7d4c0 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:35:00 user nova-compute[75080]: WARNING nova.compute.manager [req-6eb28ef6-b79b-4a21-9c52-3011bb684518 req-0273f905-7da2-43e8-b9c0-302a54e8a9d3 service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Received unexpected event network-vif-plugged-4fcca870-3cc7-4338-b912-84e32dc7d4c0 for instance with vm_state building and task_state spawning.
Dec 05 15:35:00 user nova-compute[75080]: INFO nova.compute.manager [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Took 6.40 seconds to build instance.
Dec 05 15:35:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1e17babe-ac0c-424b-9ed5-67a86b799c03 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "b5a4b977-1e76-45c7-bf97-b4db5fb615e2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.544s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:35:01 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:06 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "e0331194-6106-4621-ab60-94bcf681222e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:35:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "e0331194-6106-4621-ab60-94bcf681222e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:35:10 user nova-compute[75080]: DEBUG nova.compute.manager [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:35:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:35:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:35:10 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:35:10 user nova-compute[75080]: INFO nova.compute.claims [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Claim successful on node user
Dec 05 15:35:11 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:35:11 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:35:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.388s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:35:11 user nova-compute[75080]: DEBUG nova.compute.manager [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:35:11 user nova-compute[75080]: DEBUG nova.compute.manager [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:35:11 user nova-compute[75080]: DEBUG nova.network.neutron [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:35:11 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:35:11 user nova-compute[75080]: DEBUG nova.compute.manager [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:35:11 user nova-compute[75080]: DEBUG nova.policy [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '829d709c32db431199af609ddbc8b090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97145ab79b414c4fb8772c71e9414581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:35:11 user nova-compute[75080]: INFO nova.virt.block_device [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Booting with volume-backed-image 945b9282-153c-4cca-bc1c-40b0d399f793 at /dev/vda
Dec 05 15:35:11 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:11 user nova-compute[75080]: DEBUG nova.network.neutron [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Successfully created port: 12153aa9-8336-46dc-8491-6c28da3646a3 {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:35:12 user nova-compute[75080]: DEBUG nova.network.neutron [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Successfully updated port: 12153aa9-8336-46dc-8491-6c28da3646a3 {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:35:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "refresh_cache-e0331194-6106-4621-ab60-94bcf681222e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:35:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquired lock "refresh_cache-e0331194-6106-4621-ab60-94bcf681222e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:35:12 user nova-compute[75080]: DEBUG nova.network.neutron [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:35:12 user nova-compute[75080]: DEBUG nova.compute.manager [req-8490709a-833b-417c-ae77-73c0a9656238 req-7921368e-c38c-464e-b334-1dd6221c492b service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] Received event network-changed-12153aa9-8336-46dc-8491-6c28da3646a3 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:35:12 user nova-compute[75080]: DEBUG nova.compute.manager [req-8490709a-833b-417c-ae77-73c0a9656238 req-7921368e-c38c-464e-b334-1dd6221c492b service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] Refreshing instance network info cache due to event network-changed-12153aa9-8336-46dc-8491-6c28da3646a3. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:35:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8490709a-833b-417c-ae77-73c0a9656238 req-7921368e-c38c-464e-b334-1dd6221c492b service nova] Acquiring lock "refresh_cache-e0331194-6106-4621-ab60-94bcf681222e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:35:12 user nova-compute[75080]: DEBUG nova.network.neutron [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:35:12 user nova-compute[75080]: DEBUG nova.network.neutron [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Updating instance_info_cache with network_info: [{"id": "12153aa9-8336-46dc-8491-6c28da3646a3", "address": "fa:16:3e:0d:84:cd", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12153aa9-83", "ovs_interfaceid": "12153aa9-8336-46dc-8491-6c28da3646a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:35:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Releasing lock "refresh_cache-e0331194-6106-4621-ab60-94bcf681222e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:35:12 user nova-compute[75080]: DEBUG nova.compute.manager [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Instance network_info: |[{"id": "12153aa9-8336-46dc-8491-6c28da3646a3", "address": "fa:16:3e:0d:84:cd", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12153aa9-83", "ovs_interfaceid": "12153aa9-8336-46dc-8491-6c28da3646a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:35:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8490709a-833b-417c-ae77-73c0a9656238 req-7921368e-c38c-464e-b334-1dd6221c492b service nova] Acquired lock "refresh_cache-e0331194-6106-4621-ab60-94bcf681222e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:35:12 user nova-compute[75080]: DEBUG nova.network.neutron [req-8490709a-833b-417c-ae77-73c0a9656238 req-7921368e-c38c-464e-b334-1dd6221c492b service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] Refreshing network info cache for port 12153aa9-8336-46dc-8491-6c28da3646a3 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:35:13 user nova-compute[75080]: DEBUG nova.network.neutron [req-8490709a-833b-417c-ae77-73c0a9656238 req-7921368e-c38c-464e-b334-1dd6221c492b service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] Updated VIF entry in instance network info cache for port 12153aa9-8336-46dc-8491-6c28da3646a3. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:35:13 user nova-compute[75080]: DEBUG nova.network.neutron [req-8490709a-833b-417c-ae77-73c0a9656238 req-7921368e-c38c-464e-b334-1dd6221c492b service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] Updating instance_info_cache with network_info: [{"id": "12153aa9-8336-46dc-8491-6c28da3646a3", "address": "fa:16:3e:0d:84:cd", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12153aa9-83", "ovs_interfaceid": "12153aa9-8336-46dc-8491-6c28da3646a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:35:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8490709a-833b-417c-ae77-73c0a9656238 req-7921368e-c38c-464e-b334-1dd6221c492b service nova] Releasing lock "refresh_cache-e0331194-6106-4621-ab60-94bcf681222e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:35:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8d539bff-5690-4550-a30e-1fc08dc6e3d8 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Acquiring lock "94683fe5-8aff-4f71-9940-2d43df85e34d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:35:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8d539bff-5690-4550-a30e-1fc08dc6e3d8 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Lock "94683fe5-8aff-4f71-9940-2d43df85e34d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:35:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8d539bff-5690-4550-a30e-1fc08dc6e3d8 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Acquiring lock "94683fe5-8aff-4f71-9940-2d43df85e34d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:35:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8d539bff-5690-4550-a30e-1fc08dc6e3d8 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Lock "94683fe5-8aff-4f71-9940-2d43df85e34d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:35:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8d539bff-5690-4550-a30e-1fc08dc6e3d8 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Lock "94683fe5-8aff-4f71-9940-2d43df85e34d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:35:21 user nova-compute[75080]: INFO nova.compute.manager [None req-8d539bff-5690-4550-a30e-1fc08dc6e3d8 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Terminating instance
Dec 05 15:35:21 user nova-compute[75080]: DEBUG nova.compute.manager [None req-8d539bff-5690-4550-a30e-1fc08dc6e3d8 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:35:21 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:21 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:21 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:21 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:21 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG nova.compute.manager [req-6e5d1378-0eee-43c8-a444-8ecd01269d45 req-692be347-9851-4102-bf74-7e4317de8f7b service nova] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Received event network-vif-unplugged-5405d4ce-ee0b-4258-9a94-3b0fc8094a73 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-6e5d1378-0eee-43c8-a444-8ecd01269d45 req-692be347-9851-4102-bf74-7e4317de8f7b service nova] Acquiring lock "94683fe5-8aff-4f71-9940-2d43df85e34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-6e5d1378-0eee-43c8-a444-8ecd01269d45 req-692be347-9851-4102-bf74-7e4317de8f7b service nova] Lock "94683fe5-8aff-4f71-9940-2d43df85e34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-6e5d1378-0eee-43c8-a444-8ecd01269d45 req-692be347-9851-4102-bf74-7e4317de8f7b service nova] Lock "94683fe5-8aff-4f71-9940-2d43df85e34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG nova.compute.manager [req-6e5d1378-0eee-43c8-a444-8ecd01269d45 req-692be347-9851-4102-bf74-7e4317de8f7b service nova] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] No waiting events found dispatching network-vif-unplugged-5405d4ce-ee0b-4258-9a94-3b0fc8094a73 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG nova.compute.manager [req-6e5d1378-0eee-43c8-a444-8ecd01269d45 req-692be347-9851-4102-bf74-7e4317de8f7b service nova] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Received event network-vif-unplugged-5405d4ce-ee0b-4258-9a94-3b0fc8094a73 for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:35:22 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Instance destroyed successfully.
Dec 05 15:35:22 user nova-compute[75080]: DEBUG nova.objects.instance [None req-8d539bff-5690-4550-a30e-1fc08dc6e3d8 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Lazy-loading 'resources' on Instance uuid 94683fe5-8aff-4f71-9940-2d43df85e34d {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-8d539bff-5690-4550-a30e-1fc08dc6e3d8 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:33:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-579945271',display_name='tempest-VolumesNegativeTest-instance-579945271',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-579945271',id=33,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:33:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d43c11eb62aa40f691530591414ca4e7',ramdisk_id='',reservation_id='r-0o7ebg9d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-783086599',owner_user_name='tempest-VolumesNegativeTest-783086599-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:33:38Z,user_data=None,user_id='5d908b980a6841d0abac2a2f69856dd4',uuid=94683fe5-8aff-4f71-9940-2d43df85e34d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5405d4ce-ee0b-4258-9a94-3b0fc8094a73", "address": "fa:16:3e:0d:27:52", "network": {"id": "8ce86bdf-18d7-49ea-ae1d-288f1a452956", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0ca683fa1e094a8fa09c173c4dfc1ba9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5405d4ce-ee", "ovs_interfaceid": "5405d4ce-ee0b-4258-9a94-3b0fc8094a73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-8d539bff-5690-4550-a30e-1fc08dc6e3d8 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Converting VIF {"id": "5405d4ce-ee0b-4258-9a94-3b0fc8094a73", "address": "fa:16:3e:0d:27:52", "network": {"id": "8ce86bdf-18d7-49ea-ae1d-288f1a452956", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0ca683fa1e094a8fa09c173c4dfc1ba9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5405d4ce-ee", "ovs_interfaceid": "5405d4ce-ee0b-4258-9a94-3b0fc8094a73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-8d539bff-5690-4550-a30e-1fc08dc6e3d8 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:27:52,bridge_name='br-int',has_traffic_filtering=True,id=5405d4ce-ee0b-4258-9a94-3b0fc8094a73,network=Network(8ce86bdf-18d7-49ea-ae1d-288f1a452956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5405d4ce-ee') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG os_vif [None req-8d539bff-5690-4550-a30e-1fc08dc6e3d8 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:27:52,bridge_name='br-int',has_traffic_filtering=True,id=5405d4ce-ee0b-4258-9a94-3b0fc8094a73,network=Network(8ce86bdf-18d7-49ea-ae1d-288f1a452956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5405d4ce-ee') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5405d4ce-ee, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=55906b51-7cb2-4caf-98ef-0d9163350f7b) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG os_brick.utils [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:35:22 user nova-compute[75080]: INFO os_vif [None req-8d539bff-5690-4550-a30e-1fc08dc6e3d8 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:27:52,bridge_name='br-int',has_traffic_filtering=True,id=5405d4ce-ee0b-4258-9a94-3b0fc8094a73,network=Network(8ce86bdf-18d7-49ea-ae1d-288f1a452956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5405d4ce-ee')
Dec 05 15:35:22 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-8d539bff-5690-4550-a30e-1fc08dc6e3d8 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Deleting instance files /opt/stack/data/nova/instances/94683fe5-8aff-4f71-9940-2d43df85e34d_del
Dec 05 15:35:22 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-8d539bff-5690-4550-a30e-1fc08dc6e3d8 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Deletion of /opt/stack/data/nova/instances/94683fe5-8aff-4f71-9940-2d43df85e34d_del complete
Dec 05 15:35:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4cca22-07a3-4cc8-a88e-c359d43de03e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb5ff27-d09b-4946-a64e-e6ede7153803]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:22 user nova-compute[75080]: INFO nova.compute.manager [None req-8d539bff-5690-4550-a30e-1fc08dc6e3d8 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Took 0.70 seconds to destroy the instance on the hypervisor.
Dec 05 15:35:22 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-8d539bff-5690-4550-a30e-1fc08dc6e3d8 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.034s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6562655-0edd-4811-b2d4-eb2fc341130b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc01276-36d7-42e8-aac3-bacac8986f15]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:35:22 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:35:22 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3b6e84-b07f-45cb-af4a-008454e2c2ff]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG os_brick.utils [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Updating existing volume attachment record: 40cc1a50-44e2-4114-b5eb-df5a3d8f7196 {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:35:22 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Took 0.46 seconds to deallocate network for instance.
Dec 05 15:35:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8d539bff-5690-4550-a30e-1fc08dc6e3d8 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:35:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8d539bff-5690-4550-a30e-1fc08dc6e3d8 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:35:23 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-8d539bff-5690-4550-a30e-1fc08dc6e3d8 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:35:23 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-8d539bff-5690-4550-a30e-1fc08dc6e3d8 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:35:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8d539bff-5690-4550-a30e-1fc08dc6e3d8 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:35:23 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-8d539bff-5690-4550-a30e-1fc08dc6e3d8 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Deleted allocations for instance 94683fe5-8aff-4f71-9940-2d43df85e34d
Dec 05 15:35:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8d539bff-5690-4550-a30e-1fc08dc6e3d8 tempest-VolumesNegativeTest-783086599 tempest-VolumesNegativeTest-783086599-project-member] Lock "94683fe5-8aff-4f71-9940-2d43df85e34d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.708s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:35:24 user nova-compute[75080]: DEBUG nova.compute.manager [req-f2c111fd-22cd-4249-a5d8-194b47747939 req-16232679-41ec-456d-b40e-a49728c4b116 service nova] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Received event network-vif-plugged-5405d4ce-ee0b-4258-9a94-3b0fc8094a73 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:35:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f2c111fd-22cd-4249-a5d8-194b47747939 req-16232679-41ec-456d-b40e-a49728c4b116 service nova] Acquiring lock "94683fe5-8aff-4f71-9940-2d43df85e34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:35:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f2c111fd-22cd-4249-a5d8-194b47747939 req-16232679-41ec-456d-b40e-a49728c4b116 service nova] Lock "94683fe5-8aff-4f71-9940-2d43df85e34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:35:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f2c111fd-22cd-4249-a5d8-194b47747939 req-16232679-41ec-456d-b40e-a49728c4b116 service nova] Lock "94683fe5-8aff-4f71-9940-2d43df85e34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:35:24 user nova-compute[75080]: DEBUG nova.compute.manager [req-f2c111fd-22cd-4249-a5d8-194b47747939 req-16232679-41ec-456d-b40e-a49728c4b116 service nova] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] No waiting events found dispatching network-vif-plugged-5405d4ce-ee0b-4258-9a94-3b0fc8094a73 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:35:24 user nova-compute[75080]: WARNING nova.compute.manager [req-f2c111fd-22cd-4249-a5d8-194b47747939 req-16232679-41ec-456d-b40e-a49728c4b116 service nova] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Received unexpected event network-vif-plugged-5405d4ce-ee0b-4258-9a94-3b0fc8094a73 for instance with vm_state deleted and task_state None.
Dec 05 15:35:24 user nova-compute[75080]: DEBUG nova.compute.manager [req-f2c111fd-22cd-4249-a5d8-194b47747939 req-16232679-41ec-456d-b40e-a49728c4b116 service nova] [instance: 94683fe5-8aff-4f71-9940-2d43df85e34d] Received event network-vif-deleted-5405d4ce-ee0b-4258-9a94-3b0fc8094a73 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:35:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:31 user nova-compute[75080]: DEBUG nova.compute.manager [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:35:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:35:31 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Creating image(s)
Dec 05 15:35:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Did not create local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 05 15:35:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Ensure instance console log exists: /opt/stack/data/nova/instances/e0331194-6106-4621-ab60-94bcf681222e/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:35:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:35:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:35:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:35:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Start _get_guest_xml network_info=[{"id": "12153aa9-8336-46dc-8491-6c28da3646a3", "address": "fa:16:3e:0d:84:cd", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12153aa9-83", "ovs_interfaceid": "12153aa9-8336-46dc-8491-6c28da3646a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ySIZWThQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e0331194-6106-4621-ab60-94bcf681222e', 'attached_at': '', 'detached_at': '', 'volume_id': '127a183f-56a0-46a7-b282-3478ffda6e14', 'serial': '127a183f-56a0-46a7-b282-3478ffda6e14'}, 'device_type': 'disk', 'attachment_id': '40cc1a50-44e2-4114-b5eb-df5a3d8f7196', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:35:31 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:35:31 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:35:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:35:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:35:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:35:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:35:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:35:31 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:35:31 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:35:31 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:35:31 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:35:31 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:35:31 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:35:31 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:35:31 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:35:31 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:35:31 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:35:31 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ySIZWThQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:35:32 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:35:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:35:32 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:35:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:35:32 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:35:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa5f275-7294-4687-9c4b-dfb9510f02bd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:35:32 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a181bf-6983-4b4f-b044-441ebd16fc15]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14] added
Dec 05 15:35:32 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[58770bd7-a816-4302-8b56-87350db3d27e]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ed9aa3-3c17-4bea-8177-4c167fdd4a97]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ySIZWThQ {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ySIZWThQ" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[41968b33-87f6-43fc-a005-97d04cde31f9]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ySIZWThQ'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de61ad2-d641-41f2-bc3d-455b63116fbe]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef92272-5f7f-49c8-81ad-c60d5795e070]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:35:32 user nova-compute[75080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:35:32 user nova-compute[75080]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:35:32 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:35:32 user nova-compute[75080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:35:32 user nova-compute[75080]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:35:32 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb710832-9cd7-4a13-90f2-04dd56e0ce97]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14, portal: 172.16.0.220,3260]
Dec 05 15:35:32 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14, portal: 172.16.0.220,3260] successful.
Dec 05 15:35:32 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc87207-805d-4251-9e29-057ea6bacc33]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[60457252-3f02-4b3e-8a35-21466bac8c71]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:35:32 user nova-compute[75080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:35:32 user nova-compute[75080]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:35:32 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:35:32 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:35:32 user nova-compute[75080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:35:32 user nova-compute[75080]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:35:32 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:35:32 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6264837f-aad7-474e-90f9-c22fbca5bdb7]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:32 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: None {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:35:33 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:35:33 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ySIZWThQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:35:33 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:35:33 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23264326563353334', 'path': '/dev/sdb'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:35:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264326563353334', 'path': '/dev/sdb'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:35:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:35:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1468368929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1468368929',id=36,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97145ab79b414c4fb8772c71e9414581',ramdisk_id='',reservation_id='r-cqnwpz86',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2060228993',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:35:11Z,user_data=None,user_id='829d709c32db431199af609ddbc8b090',uuid=e0331194-6106-4621-ab60-94bcf681222e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12153aa9-8336-46dc-8491-6c28da3646a3", "address": "fa:16:3e:0d:84:cd", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12153aa9-83", "ovs_interfaceid": "12153aa9-8336-46dc-8491-6c28da3646a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:35:33 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Converting VIF {"id": "12153aa9-8336-46dc-8491-6c28da3646a3", "address": "fa:16:3e:0d:84:cd", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12153aa9-83", "ovs_interfaceid": "12153aa9-8336-46dc-8491-6c28da3646a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:35:33 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:84:cd,bridge_name='br-int',has_traffic_filtering=True,id=12153aa9-8336-46dc-8491-6c28da3646a3,network=Network(61aa968d-7e44-4ef2-955f-2e5441416f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12153aa9-83') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:35:33 user nova-compute[75080]: DEBUG nova.objects.instance [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lazy-loading 'pci_devices' on Instance uuid e0331194-6106-4621-ab60-94bcf681222e {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:35:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:35:33 user nova-compute[75080]:   <uuid>e0331194-6106-4621-ab60-94bcf681222e</uuid>
Dec 05 15:35:33 user nova-compute[75080]:   <name>instance-00000024</name>
Dec 05 15:35:33 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:35:33 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:35:33 user nova-compute[75080]:   <metadata>
Dec 05 15:35:33 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:35:33 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:35:33 user nova-compute[75080]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1468368929</nova:name>
Dec 05 15:35:33 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:35:31</nova:creationTime>
Dec 05 15:35:33 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:35:33 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:35:33 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:35:33 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:35:33 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:35:33 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:35:33 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:35:33 user nova-compute[75080]:       <nova:owner>
Dec 05 15:35:33 user nova-compute[75080]:         <nova:user uuid="829d709c32db431199af609ddbc8b090">tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member</nova:user>
Dec 05 15:35:33 user nova-compute[75080]:         <nova:project uuid="97145ab79b414c4fb8772c71e9414581">tempest-ServerBootFromVolumeStableRescueTest-2060228993</nova:project>
Dec 05 15:35:33 user nova-compute[75080]:       </nova:owner>
Dec 05 15:35:33 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:35:33 user nova-compute[75080]:       <nova:ports>
Dec 05 15:35:33 user nova-compute[75080]:         <nova:port uuid="12153aa9-8336-46dc-8491-6c28da3646a3">
Dec 05 15:35:33 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 05 15:35:33 user nova-compute[75080]:         </nova:port>
Dec 05 15:35:33 user nova-compute[75080]:       </nova:ports>
Dec 05 15:35:33 user nova-compute[75080]:     </nova:instance>
Dec 05 15:35:33 user nova-compute[75080]:   </metadata>
Dec 05 15:35:33 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:35:33 user nova-compute[75080]:     <system>
Dec 05 15:35:33 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:35:33 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:35:33 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:35:33 user nova-compute[75080]:       <entry name="serial">e0331194-6106-4621-ab60-94bcf681222e</entry>
Dec 05 15:35:33 user nova-compute[75080]:       <entry name="uuid">e0331194-6106-4621-ab60-94bcf681222e</entry>
Dec 05 15:35:33 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:35:33 user nova-compute[75080]:     </system>
Dec 05 15:35:33 user nova-compute[75080]:   </sysinfo>
Dec 05 15:35:33 user nova-compute[75080]:   <os>
Dec 05 15:35:33 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:35:33 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:35:33 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:35:33 user nova-compute[75080]:   </os>
Dec 05 15:35:33 user nova-compute[75080]:   <features>
Dec 05 15:35:33 user nova-compute[75080]:     <acpi/>
Dec 05 15:35:33 user nova-compute[75080]:     <apic/>
Dec 05 15:35:33 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:35:33 user nova-compute[75080]:   </features>
Dec 05 15:35:33 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:35:33 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:35:33 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:35:33 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:35:33 user nova-compute[75080]:   </clock>
Dec 05 15:35:33 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:35:33 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:35:33 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:35:33 user nova-compute[75080]:   </cpu>
Dec 05 15:35:33 user nova-compute[75080]:   <devices>
Dec 05 15:35:33 user nova-compute[75080]:     <disk type="block" device="disk">
Dec 05 15:35:33 user nova-compute[75080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:35:33 user nova-compute[75080]:       <source dev="/dev/sdb"/>
Dec 05 15:35:33 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:35:33 user nova-compute[75080]:       <serial>127a183f-56a0-46a7-b282-3478ffda6e14</serial>
Dec 05 15:35:33 user nova-compute[75080]:     </disk>
Dec 05 15:35:33 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:35:33 user nova-compute[75080]:       <mac address="fa:16:3e:0d:84:cd"/>
Dec 05 15:35:33 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:35:33 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:35:33 user nova-compute[75080]:       <target dev="tap12153aa9-83"/>
Dec 05 15:35:33 user nova-compute[75080]:     </interface>
Dec 05 15:35:33 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:35:33 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/e0331194-6106-4621-ab60-94bcf681222e/console.log" append="off"/>
Dec 05 15:35:33 user nova-compute[75080]:     </serial>
Dec 05 15:35:33 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:35:33 user nova-compute[75080]:     <video>
Dec 05 15:35:33 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:35:33 user nova-compute[75080]:     </video>
Dec 05 15:35:33 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:35:33 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:35:33 user nova-compute[75080]:     </rng>
Dec 05 15:35:33 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:35:33 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:35:33 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:35:33 user nova-compute[75080]:     </memballoon>
Dec 05 15:35:33 user nova-compute[75080]:   </devices>
Dec 05 15:35:33 user nova-compute[75080]: </domain>
Dec 05 15:35:33 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:35:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:35:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1468368929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1468368929',id=36,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97145ab79b414c4fb8772c71e9414581',ramdisk_id='',reservation_id='r-cqnwpz86',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2060228993',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:35:11Z,user_data=None,user_id='829d709c32db431199af609ddbc8b090',uuid=e0331194-6106-4621-ab60-94bcf681222e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12153aa9-8336-46dc-8491-6c28da3646a3", "address": "fa:16:3e:0d:84:cd", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12153aa9-83", "ovs_interfaceid": "12153aa9-8336-46dc-8491-6c28da3646a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:35:33 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Converting VIF {"id": "12153aa9-8336-46dc-8491-6c28da3646a3", "address": "fa:16:3e:0d:84:cd", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12153aa9-83", "ovs_interfaceid": "12153aa9-8336-46dc-8491-6c28da3646a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:35:33 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:84:cd,bridge_name='br-int',has_traffic_filtering=True,id=12153aa9-8336-46dc-8491-6c28da3646a3,network=Network(61aa968d-7e44-4ef2-955f-2e5441416f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12153aa9-83') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:35:33 user nova-compute[75080]: DEBUG os_vif [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:84:cd,bridge_name='br-int',has_traffic_filtering=True,id=12153aa9-8336-46dc-8491-6c28da3646a3,network=Network(61aa968d-7e44-4ef2-955f-2e5441416f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12153aa9-83') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:35:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:35:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:35:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'faff1f05-7528-5770-9d71-d2fbb0991a01', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:35:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:35:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap12153aa9-83, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:35:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap12153aa9-83, col_values=(('qos', UUID('f23a7748-438f-483c-9555-0d32d56115a4')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:35:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap12153aa9-83, col_values=(('external_ids', {'iface-id': '12153aa9-8336-46dc-8491-6c28da3646a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:84:cd', 'vm-uuid': 'e0331194-6106-4621-ab60-94bcf681222e'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:35:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:35:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:33 user nova-compute[75080]: INFO os_vif [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:84:cd,bridge_name='br-int',has_traffic_filtering=True,id=12153aa9-8336-46dc-8491-6c28da3646a3,network=Network(61aa968d-7e44-4ef2-955f-2e5441416f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12153aa9-83')
Dec 05 15:35:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:35:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] No VIF found with MAC fa:16:3e:0d:84:cd, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:35:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:34 user nova-compute[75080]: DEBUG nova.compute.manager [req-03a0444b-974c-45c8-98a8-d46da23c1005 req-aab72613-ae7f-478c-ac43-79a2c367bf89 service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] Received event network-vif-plugged-12153aa9-8336-46dc-8491-6c28da3646a3 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:35:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-03a0444b-974c-45c8-98a8-d46da23c1005 req-aab72613-ae7f-478c-ac43-79a2c367bf89 service nova] Acquiring lock "e0331194-6106-4621-ab60-94bcf681222e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:35:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-03a0444b-974c-45c8-98a8-d46da23c1005 req-aab72613-ae7f-478c-ac43-79a2c367bf89 service nova] Lock "e0331194-6106-4621-ab60-94bcf681222e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:35:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-03a0444b-974c-45c8-98a8-d46da23c1005 req-aab72613-ae7f-478c-ac43-79a2c367bf89 service nova] Lock "e0331194-6106-4621-ab60-94bcf681222e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:35:34 user nova-compute[75080]: DEBUG nova.compute.manager [req-03a0444b-974c-45c8-98a8-d46da23c1005 req-aab72613-ae7f-478c-ac43-79a2c367bf89 service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] No waiting events found dispatching network-vif-plugged-12153aa9-8336-46dc-8491-6c28da3646a3 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:35:34 user nova-compute[75080]: WARNING nova.compute.manager [req-03a0444b-974c-45c8-98a8-d46da23c1005 req-aab72613-ae7f-478c-ac43-79a2c367bf89 service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] Received unexpected event network-vif-plugged-12153aa9-8336-46dc-8491-6c28da3646a3 for instance with vm_state building and task_state spawning.
Dec 05 15:35:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:36 user nova-compute[75080]: DEBUG nova.compute.manager [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:35:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:35:36 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: e0331194-6106-4621-ab60-94bcf681222e] Instance spawned successfully.
Dec 05 15:35:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:35:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:35:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:35:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:35:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:35:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:35:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:35:36 user nova-compute[75080]: INFO nova.compute.manager [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Took 4.92 seconds to spawn the instance on the hypervisor.
Dec 05 15:35:36 user nova-compute[75080]: DEBUG nova.compute.manager [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:35:36 user nova-compute[75080]: INFO nova.compute.manager [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Took 26.22 seconds to build instance.
Dec 05 15:35:36 user nova-compute[75080]: DEBUG nova.compute.manager [req-42673cd6-17b4-47c0-a8f8-39b2f2dfcf74 req-cc1a30c2-a6c5-4214-b104-5e4cc7a23c7f service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] Received event network-vif-plugged-12153aa9-8336-46dc-8491-6c28da3646a3 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:35:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-42673cd6-17b4-47c0-a8f8-39b2f2dfcf74 req-cc1a30c2-a6c5-4214-b104-5e4cc7a23c7f service nova] Acquiring lock "e0331194-6106-4621-ab60-94bcf681222e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:35:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-42673cd6-17b4-47c0-a8f8-39b2f2dfcf74 req-cc1a30c2-a6c5-4214-b104-5e4cc7a23c7f service nova] Lock "e0331194-6106-4621-ab60-94bcf681222e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:35:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-42673cd6-17b4-47c0-a8f8-39b2f2dfcf74 req-cc1a30c2-a6c5-4214-b104-5e4cc7a23c7f service nova] Lock "e0331194-6106-4621-ab60-94bcf681222e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:35:36 user nova-compute[75080]: DEBUG nova.compute.manager [req-42673cd6-17b4-47c0-a8f8-39b2f2dfcf74 req-cc1a30c2-a6c5-4214-b104-5e4cc7a23c7f service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] No waiting events found dispatching network-vif-plugged-12153aa9-8336-46dc-8491-6c28da3646a3 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:35:36 user nova-compute[75080]: WARNING nova.compute.manager [req-42673cd6-17b4-47c0-a8f8-39b2f2dfcf74 req-cc1a30c2-a6c5-4214-b104-5e4cc7a23c7f service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] Received unexpected event network-vif-plugged-12153aa9-8336-46dc-8491-6c28da3646a3 for instance with vm_state active and task_state None.
Dec 05 15:35:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5ebf4505-ebb6-4bdd-963e-4bf3d25f49f7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "e0331194-6106-4621-ab60-94bcf681222e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.342s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:35:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:38 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:35:38 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:35:39 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:35:39 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:35:41 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:35:41 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:35:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-07b025ff-4a9d-48a2-b950-b8f2d165f33c" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:35:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-07b025ff-4a9d-48a2-b950-b8f2d165f33c" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:35:41 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 15:35:41 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Updating instance_info_cache with network_info: [{"id": "b499a54e-2aab-4f63-a634-66c6a627bb4a", "address": "fa:16:3e:14:03:09", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb499a54e-2a", "ovs_interfaceid": "b499a54e-2aab-4f63-a634-66c6a627bb4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:35:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-07b025ff-4a9d-48a2-b950-b8f2d165f33c" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:35:41 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 15:35:42 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:35:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:35:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:35:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:35:42 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:35:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:35:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:35:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:43 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:35:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2482d35-2159-4605-b7af-da232886b8d3/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2482d35-2159-4605-b7af-da232886b8d3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2482d35-2159-4605-b7af-da232886b8d3/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2482d35-2159-4605-b7af-da232886b8d3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:44 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:35:45 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:35:45 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:35:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=8077MB free_disk=24.995525360107422GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:35:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:35:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:35:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance eedd1529-4feb-4f85-8625-0c20d8e0359d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:35:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 07b025ff-4a9d-48a2-b950-b8f2d165f33c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:35:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance ab882db7-e6d7-44ca-9ea4-ae2fa68f7929 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:35:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 011d3446-577a-4f5c-b8f0-ef04940cad17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:35:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 40138071-fefc-4686-9344-7df255a1fc9d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:35:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 308f6ec7-d5c1-46bf-95a4-036e1c192f7f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:35:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance b47129e8-c02b-4107-af4f-329173dd453f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:35:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance a2482d35-2159-4605-b7af-da232886b8d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:35:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance b5a4b977-1e76-45c7-bf97-b4db5fb615e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:35:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance e0331194-6106-4621-ab60-94bcf681222e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:35:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:35:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:35:45 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:35:45 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:35:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:35:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.506s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:35:46 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:35:46 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:35:46 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:35:46 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:35:46 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:35:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:35:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:54 user nova-compute[75080]: DEBUG nova.compute.manager [req-4a1ffa92-ac1c-4e9f-9978-b173d84c18aa req-20ebf3b2-9b1a-464f-8c98-2023532d417a service nova] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Received event network-changed-022ecfdd-eb21-4d23-8f7d-d993577809e3 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:35:54 user nova-compute[75080]: DEBUG nova.compute.manager [req-4a1ffa92-ac1c-4e9f-9978-b173d84c18aa req-20ebf3b2-9b1a-464f-8c98-2023532d417a service nova] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Refreshing instance network info cache due to event network-changed-022ecfdd-eb21-4d23-8f7d-d993577809e3. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:35:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4a1ffa92-ac1c-4e9f-9978-b173d84c18aa req-20ebf3b2-9b1a-464f-8c98-2023532d417a service nova] Acquiring lock "refresh_cache-40138071-fefc-4686-9344-7df255a1fc9d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:35:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4a1ffa92-ac1c-4e9f-9978-b173d84c18aa req-20ebf3b2-9b1a-464f-8c98-2023532d417a service nova] Acquired lock "refresh_cache-40138071-fefc-4686-9344-7df255a1fc9d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:35:54 user nova-compute[75080]: DEBUG nova.network.neutron [req-4a1ffa92-ac1c-4e9f-9978-b173d84c18aa req-20ebf3b2-9b1a-464f-8c98-2023532d417a service nova] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Refreshing network info cache for port 022ecfdd-eb21-4d23-8f7d-d993577809e3 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:35:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "40138071-fefc-4686-9344-7df255a1fc9d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:35:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "40138071-fefc-4686-9344-7df255a1fc9d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:35:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "40138071-fefc-4686-9344-7df255a1fc9d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:35:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "40138071-fefc-4686-9344-7df255a1fc9d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:35:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "40138071-fefc-4686-9344-7df255a1fc9d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:35:54 user nova-compute[75080]: INFO nova.compute.manager [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Terminating instance
Dec 05 15:35:54 user nova-compute[75080]: DEBUG nova.compute.manager [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:35:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:54 user nova-compute[75080]: DEBUG nova.compute.manager [req-cccad000-97cb-414a-88e7-df28803afa0d req-a6a62eb9-eebf-40c6-b1f0-0fdbd118c0eb service nova] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Received event network-vif-unplugged-022ecfdd-eb21-4d23-8f7d-d993577809e3 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:35:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-cccad000-97cb-414a-88e7-df28803afa0d req-a6a62eb9-eebf-40c6-b1f0-0fdbd118c0eb service nova] Acquiring lock "40138071-fefc-4686-9344-7df255a1fc9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:35:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-cccad000-97cb-414a-88e7-df28803afa0d req-a6a62eb9-eebf-40c6-b1f0-0fdbd118c0eb service nova] Lock "40138071-fefc-4686-9344-7df255a1fc9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:35:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-cccad000-97cb-414a-88e7-df28803afa0d req-a6a62eb9-eebf-40c6-b1f0-0fdbd118c0eb service nova] Lock "40138071-fefc-4686-9344-7df255a1fc9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:35:54 user nova-compute[75080]: DEBUG nova.compute.manager [req-cccad000-97cb-414a-88e7-df28803afa0d req-a6a62eb9-eebf-40c6-b1f0-0fdbd118c0eb service nova] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] No waiting events found dispatching network-vif-unplugged-022ecfdd-eb21-4d23-8f7d-d993577809e3 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:35:54 user nova-compute[75080]: DEBUG nova.compute.manager [req-cccad000-97cb-414a-88e7-df28803afa0d req-a6a62eb9-eebf-40c6-b1f0-0fdbd118c0eb service nova] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Received event network-vif-unplugged-022ecfdd-eb21-4d23-8f7d-d993577809e3 for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:35:54 user nova-compute[75080]: DEBUG nova.network.neutron [req-4a1ffa92-ac1c-4e9f-9978-b173d84c18aa req-20ebf3b2-9b1a-464f-8c98-2023532d417a service nova] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Updated VIF entry in instance network info cache for port 022ecfdd-eb21-4d23-8f7d-d993577809e3. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:35:54 user nova-compute[75080]: DEBUG nova.network.neutron [req-4a1ffa92-ac1c-4e9f-9978-b173d84c18aa req-20ebf3b2-9b1a-464f-8c98-2023532d417a service nova] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Updating instance_info_cache with network_info: [{"id": "022ecfdd-eb21-4d23-8f7d-d993577809e3", "address": "fa:16:3e:f2:a5:2b", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022ecfdd-eb", "ovs_interfaceid": "022ecfdd-eb21-4d23-8f7d-d993577809e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:35:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4a1ffa92-ac1c-4e9f-9978-b173d84c18aa req-20ebf3b2-9b1a-464f-8c98-2023532d417a service nova] Releasing lock "refresh_cache-40138071-fefc-4686-9344-7df255a1fc9d" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:35:55 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Instance destroyed successfully.
Dec 05 15:35:55 user nova-compute[75080]: DEBUG nova.objects.instance [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lazy-loading 'resources' on Instance uuid 40138071-fefc-4686-9344-7df255a1fc9d {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:30:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-261500703',display_name='tempest-TestVolumeBootPattern-server-261500703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-261500703',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbodyAsCj/LsLD4+fqj081LHmxK6h/6lXtC6JTYG6GWTlsJ9L34SglBGh22zHQ6DhZ8jkeGO+vsFyUrlKxX0aNv4V7kDdiXAt2Ew2tgqS8jk69Jg7JlqDhZvfUPpLsuMg==',key_name='tempest-TestVolumeBootPattern-1935536975',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:31:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11227acd507347ae9c5a3bc710707f84',ramdisk_id='',reservation_id='r-xnkfxslm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-23416231',owner_user_name='tempest-TestVolumeBootPattern-23416231-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:31:12Z,user_data=None,user_id='15be5b54cc8346bb86683e4ed2fbba9e',uuid=40138071-fefc-4686-9344-7df255a1fc9d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "022ecfdd-eb21-4d23-8f7d-d993577809e3", "address": "fa:16:3e:f2:a5:2b", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022ecfdd-eb", "ovs_interfaceid": "022ecfdd-eb21-4d23-8f7d-d993577809e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Converting VIF {"id": "022ecfdd-eb21-4d23-8f7d-d993577809e3", "address": "fa:16:3e:f2:a5:2b", "network": {"id": "b8fa0b3d-788d-42c6-8811-3212f2bc25eb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529307677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11227acd507347ae9c5a3bc710707f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022ecfdd-eb", "ovs_interfaceid": "022ecfdd-eb21-4d23-8f7d-d993577809e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:a5:2b,bridge_name='br-int',has_traffic_filtering=True,id=022ecfdd-eb21-4d23-8f7d-d993577809e3,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap022ecfdd-eb') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG os_vif [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:a5:2b,bridge_name='br-int',has_traffic_filtering=True,id=022ecfdd-eb21-4d23-8f7d-d993577809e3,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap022ecfdd-eb') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap022ecfdd-eb, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=936a3c4c-1bee-460c-90c3-f6ab973d4ca6) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:55 user nova-compute[75080]: INFO os_vif [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:a5:2b,bridge_name='br-int',has_traffic_filtering=True,id=022ecfdd-eb21-4d23-8f7d-d993577809e3,network=Network(b8fa0b3d-788d-42c6-8811-3212f2bc25eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap022ecfdd-eb')
Dec 05 15:35:55 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UuagHdeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:35:55 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:35:55 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[08644da6-d4dc-40be-ba72-2d2e139491e4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:35:55 user nova-compute[75080]: No targets found.
Dec 05 15:35:55 user nova-compute[75080]: iSNS:
Dec 05 15:35:55 user nova-compute[75080]: No targets found.
Dec 05 15:35:55 user nova-compute[75080]: STATIC:
Dec 05 15:35:55 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5
Dec 05 15:35:55 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:35:55 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:35:55 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399
Dec 05 15:35:55 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:35:55 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:35:55 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b
Dec 05 15:35:55 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:35:55 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:35:55 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14
Dec 05 15:35:55 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:35:55 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:35:55 user nova-compute[75080]: FIRMWARE:
Dec 05 15:35:55 user nova-compute[75080]: No targets found.
Dec 05 15:35:55 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:35:55 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:35:55 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f5e075-86f1-467e-a063-e02eea358eac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a9f6f9-5771-40ef-bb78-3d0714429800]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:35:55 user nova-compute[75080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:35:55 user nova-compute[75080]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:35:55 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:35:55 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:35:55 user nova-compute[75080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b (non-flash)
Dec 05 15:35:55 user nova-compute[75080]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:35:55 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:35:55 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f663833ae60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b'): ({'sdd'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Removing single pathed devices sdd {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ac7c82-f08b-47f6-be16-e392de5262c7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d86269f-4627-4d33-a04a-02464d66adcb]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Flushing IO for device /dev/sdd {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[63775fb9-85b3-47a7-84f6-6257cbb97588]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ac85eb-1aae-47a4-8857-069b51b4613f]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] SCSI volumes sdd have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4336908-5493-4113-a5cd-16efebc59f2a]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a181e102-414e-4719-a5f0-4a8e883d5aaa]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b, portal: 172.16.0.220,3260]
Dec 05 15:35:55 user nova-compute[75080]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b, portal: 172.16.0.220,3260] successful.
Dec 05 15:35:55 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59fe9cca-1acd-4fca-b52f-bfeb33e4dc3b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed90251-e88f-4b72-ab74-ece144203df2]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] <== disconnect_volume: return (301ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:35:55 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Deleting instance files /opt/stack/data/nova/instances/40138071-fefc-4686-9344-7df255a1fc9d_del
Dec 05 15:35:55 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Deletion of /opt/stack/data/nova/instances/40138071-fefc-4686-9344-7df255a1fc9d_del complete
Dec 05 15:35:55 user nova-compute[75080]: INFO nova.compute.manager [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Took 1.23 seconds to destroy the instance on the hypervisor.
Dec 05 15:35:55 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:35:55 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:35:55 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Took 0.44 seconds to deallocate network for instance.
Dec 05 15:35:56 user nova-compute[75080]: DEBUG nova.compute.manager [req-791db93b-93dc-4f26-9595-fc628bfbe340 req-addc796d-cfc6-432c-9cec-470141e7235a service nova] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Received event network-vif-plugged-022ecfdd-eb21-4d23-8f7d-d993577809e3 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:35:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-791db93b-93dc-4f26-9595-fc628bfbe340 req-addc796d-cfc6-432c-9cec-470141e7235a service nova] Acquiring lock "40138071-fefc-4686-9344-7df255a1fc9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:35:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-791db93b-93dc-4f26-9595-fc628bfbe340 req-addc796d-cfc6-432c-9cec-470141e7235a service nova] Lock "40138071-fefc-4686-9344-7df255a1fc9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:35:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-791db93b-93dc-4f26-9595-fc628bfbe340 req-addc796d-cfc6-432c-9cec-470141e7235a service nova] Lock "40138071-fefc-4686-9344-7df255a1fc9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:35:56 user nova-compute[75080]: DEBUG nova.compute.manager [req-791db93b-93dc-4f26-9595-fc628bfbe340 req-addc796d-cfc6-432c-9cec-470141e7235a service nova] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] No waiting events found dispatching network-vif-plugged-022ecfdd-eb21-4d23-8f7d-d993577809e3 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:35:56 user nova-compute[75080]: WARNING nova.compute.manager [req-791db93b-93dc-4f26-9595-fc628bfbe340 req-addc796d-cfc6-432c-9cec-470141e7235a service nova] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Received unexpected event network-vif-plugged-022ecfdd-eb21-4d23-8f7d-d993577809e3 for instance with vm_state active and task_state deleting.
Dec 05 15:35:56 user nova-compute[75080]: DEBUG nova.compute.manager [req-791db93b-93dc-4f26-9595-fc628bfbe340 req-addc796d-cfc6-432c-9cec-470141e7235a service nova] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Received event network-vif-deleted-022ecfdd-eb21-4d23-8f7d-d993577809e3 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:35:56 user nova-compute[75080]: INFO nova.compute.manager [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] [instance: 40138071-fefc-4686-9344-7df255a1fc9d] Took 0.82 seconds to detach 1 volumes for instance.
Dec 05 15:35:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:35:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:35:57 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:35:57 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:35:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.328s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:35:57 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Deleted allocations for instance 40138071-fefc-4686-9344-7df255a1fc9d
Dec 05 15:35:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-89eccb81-a6ca-4334-be99-c22746d9dca9 tempest-TestVolumeBootPattern-23416231 tempest-TestVolumeBootPattern-23416231-project-member] Lock "40138071-fefc-4686-9344-7df255a1fc9d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.018s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:35:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:35:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:35:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:35:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:35:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:35:57 user nova-compute[75080]: INFO nova.compute.manager [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Terminating instance
Dec 05 15:35:57 user nova-compute[75080]: DEBUG nova.compute.manager [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:35:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG nova.compute.manager [req-03828105-07e0-41e9-951e-e377c6a3ce6e req-b7cc43d0-e3f9-430f-a623-04611ad0be88 service nova] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Received event network-vif-unplugged-ae56b484-8712-4d95-aa9f-686b40d2619f {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-03828105-07e0-41e9-951e-e377c6a3ce6e req-b7cc43d0-e3f9-430f-a623-04611ad0be88 service nova] Acquiring lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-03828105-07e0-41e9-951e-e377c6a3ce6e req-b7cc43d0-e3f9-430f-a623-04611ad0be88 service nova] Lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-03828105-07e0-41e9-951e-e377c6a3ce6e req-b7cc43d0-e3f9-430f-a623-04611ad0be88 service nova] Lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG nova.compute.manager [req-03828105-07e0-41e9-951e-e377c6a3ce6e req-b7cc43d0-e3f9-430f-a623-04611ad0be88 service nova] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] No waiting events found dispatching network-vif-unplugged-ae56b484-8712-4d95-aa9f-686b40d2619f {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG nova.compute.manager [req-03828105-07e0-41e9-951e-e377c6a3ce6e req-b7cc43d0-e3f9-430f-a623-04611ad0be88 service nova] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Received event network-vif-unplugged-ae56b484-8712-4d95-aa9f-686b40d2619f for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG nova.compute.manager [req-3b4f86bc-f6a1-42e1-91a2-e8f9348db166 req-83fafd71-0768-4f9e-a045-d81bbe302829 service nova] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Received event network-changed-a92f7043-98a8-4f4e-be46-45fc5cc4778d {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG nova.compute.manager [req-3b4f86bc-f6a1-42e1-91a2-e8f9348db166 req-83fafd71-0768-4f9e-a045-d81bbe302829 service nova] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Refreshing instance network info cache due to event network-changed-a92f7043-98a8-4f4e-be46-45fc5cc4778d. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-3b4f86bc-f6a1-42e1-91a2-e8f9348db166 req-83fafd71-0768-4f9e-a045-d81bbe302829 service nova] Acquiring lock "refresh_cache-a2482d35-2159-4605-b7af-da232886b8d3" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-3b4f86bc-f6a1-42e1-91a2-e8f9348db166 req-83fafd71-0768-4f9e-a045-d81bbe302829 service nova] Acquired lock "refresh_cache-a2482d35-2159-4605-b7af-da232886b8d3" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG nova.network.neutron [req-3b4f86bc-f6a1-42e1-91a2-e8f9348db166 req-83fafd71-0768-4f9e-a045-d81bbe302829 service nova] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Refreshing network info cache for port a92f7043-98a8-4f4e-be46-45fc5cc4778d {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Acquiring lock "a2482d35-2159-4605-b7af-da232886b8d3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "a2482d35-2159-4605-b7af-da232886b8d3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG nova.objects.instance [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lazy-loading 'flavor' on Instance uuid a2482d35-2159-4605-b7af-da232886b8d3 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:35:58 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Ignoring supplied device name: /dev/vdb
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "a2482d35-2159-4605-b7af-da232886b8d3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:35:58 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Instance destroyed successfully.
Dec 05 15:35:58 user nova-compute[75080]: DEBUG nova.objects.instance [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lazy-loading 'resources' on Instance uuid 308f6ec7-d5c1-46bf-95a4-036e1c192f7f {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:29:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-77885476',display_name='tempest-ServerActionsTestOtherA-server-77885476',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-77885476',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIP5nbHwDP3MaLimasQ81bdHfaI0CFiTpw2YpAxQTZDkv+5y7AL53TfAVsSe07r4BvGkQeGQdB4lyczKq+WcllL3mLq5dj12AlRuMlnnGy3kUrnJXEIK2cec4EX/PelNSA==',key_name='tempest-keypair-1219993291',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:31:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50f49255d5b74f448dc941027afbf84a',ramdisk_id='',reservation_id='r-ui3j1gwe',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-393209338',owner_user_name='tempest-ServerActionsTestOtherA-393209338-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:33:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e99cb2f1c4541fd9a656e038f4afac3',uuid=308f6ec7-d5c1-46bf-95a4-036e1c192f7f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae56b484-8712-4d95-aa9f-686b40d2619f", "address": "fa:16:3e:28:be:b7", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae56b484-87", "ovs_interfaceid": "ae56b484-8712-4d95-aa9f-686b40d2619f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Converting VIF {"id": "ae56b484-8712-4d95-aa9f-686b40d2619f", "address": "fa:16:3e:28:be:b7", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae56b484-87", "ovs_interfaceid": "ae56b484-8712-4d95-aa9f-686b40d2619f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:be:b7,bridge_name='br-int',has_traffic_filtering=True,id=ae56b484-8712-4d95-aa9f-686b40d2619f,network=Network(efba4a7e-3a56-41d2-8af7-4c064ba641fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae56b484-87') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG os_vif [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:be:b7,bridge_name='br-int',has_traffic_filtering=True,id=ae56b484-8712-4d95-aa9f-686b40d2619f,network=Network(efba4a7e-3a56-41d2-8af7-4c064ba641fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae56b484-87') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae56b484-87, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=246b2f40-92e5-496a-a1b5-969440c806a6) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG nova.network.neutron [req-3b4f86bc-f6a1-42e1-91a2-e8f9348db166 req-83fafd71-0768-4f9e-a045-d81bbe302829 service nova] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Updated VIF entry in instance network info cache for port a92f7043-98a8-4f4e-be46-45fc5cc4778d. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG nova.network.neutron [req-3b4f86bc-f6a1-42e1-91a2-e8f9348db166 req-83fafd71-0768-4f9e-a045-d81bbe302829 service nova] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Updating instance_info_cache with network_info: [{"id": "a92f7043-98a8-4f4e-be46-45fc5cc4778d", "address": "fa:16:3e:11:21:2b", "network": {"id": "eb187ccd-700a-49df-881f-c61d4b90e612", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053782949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e8a1b1f1ed346949ac0f633ae7e530b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa92f7043-98", "ovs_interfaceid": "a92f7043-98a8-4f4e-be46-45fc5cc4778d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:35:58 user nova-compute[75080]: INFO os_vif [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:be:b7,bridge_name='br-int',has_traffic_filtering=True,id=ae56b484-8712-4d95-aa9f-686b40d2619f,network=Network(efba4a7e-3a56-41d2-8af7-4c064ba641fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae56b484-87')
Dec 05 15:35:58 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qOpctbNu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:35:58 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:35:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Acquiring lock "a2482d35-2159-4605-b7af-da232886b8d3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "a2482d35-2159-4605-b7af-da232886b8d3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:35:58 user nova-compute[75080]: INFO nova.compute.manager [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Attaching volume 7971cee5-0385-4740-b5df-bc2eadd67b25 to /dev/vdb
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-3b4f86bc-f6a1-42e1-91a2-e8f9348db166 req-83fafd71-0768-4f9e-a045-d81bbe302829 service nova] Releasing lock "refresh_cache-a2482d35-2159-4605-b7af-da232886b8d3" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1c35d7-98a5-4f6a-b8af-f508a063b1d9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:35:58 user nova-compute[75080]: No targets found.
Dec 05 15:35:58 user nova-compute[75080]: iSNS:
Dec 05 15:35:58 user nova-compute[75080]: No targets found.
Dec 05 15:35:58 user nova-compute[75080]: STATIC:
Dec 05 15:35:58 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5
Dec 05 15:35:58 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:35:58 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:35:58 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399
Dec 05 15:35:58 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:35:58 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:35:58 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14
Dec 05 15:35:58 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:35:58 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:35:58 user nova-compute[75080]: FIRMWARE:
Dec 05 15:35:58 user nova-compute[75080]: No targets found.
Dec 05 15:35:58 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:35:58 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:35:58 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda26d15-4944-4c3c-b41d-e9392d1f6e8b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fbffbf-1a6e-4fd2-beee-1acd247cad74]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:35:58 user nova-compute[75080]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:35:58 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:35:58 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:35:58 user nova-compute[75080]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 (non-flash)
Dec 05 15:35:58 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:35:58 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f66384a92d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5'): ({'sdc'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Removing single pathed devices sdc {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG os_brick.utils [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d33b56f-45e2-43c7-b6f9-7706e1912de6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3d9b81-007d-4cf3-89a9-93ea5b214385]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Flushing IO for device /dev/sdc {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.033s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8465fae3-6b43-4f19-92ee-4c07988006a8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6d95dd-31b1-4de8-a370-e016440c433b]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b156a22-911e-41a2-95ed-c504a0854ebd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[19902f40-90cc-4148-a080-2d62f4b93111]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[294cbe9f-6620-4f4d-afe9-90455437fb4b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c987da2e-16a9-4e3e-8e61-418cac034231]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] SCSI volumes sdc have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:35:58 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58617a0-fe2c-4336-b13e-dadbd538f1ba]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG os_brick.utils [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Updating existing volume attachment record: 78f807f2-624b-4bba-99e0-0b533eb8b678 {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a14a51-12af-438c-b511-adaaaa0f42ae]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a0784f-072b-4bb4-b686-b904c4287c3d]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5, portal: 172.16.0.220,3260]
Dec 05 15:35:58 user nova-compute[75080]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5, portal: 172.16.0.220,3260] successful.
Dec 05 15:35:58 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:35:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:35:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48df39ad-d50b-473c-9675-9c68d4cd1dd5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:35:59 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[77060c3b-3f47-49c0-b1f8-bfec826a58e0]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:35:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:35:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:35:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] <== disconnect_volume: return (360ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:35:59 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:35:59 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Deleting instance files /opt/stack/data/nova/instances/308f6ec7-d5c1-46bf-95a4-036e1c192f7f_del
Dec 05 15:35:59 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Deletion of /opt/stack/data/nova/instances/308f6ec7-d5c1-46bf-95a4-036e1c192f7f_del complete
Dec 05 15:35:59 user nova-compute[75080]: INFO nova.compute.manager [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Took 1.24 seconds to destroy the instance on the hypervisor.
Dec 05 15:35:59 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:35:59 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:35:59 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:35:59 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:35:59 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Took 0.75 seconds to deallocate network for instance.
Dec 05 15:35:59 user nova-compute[75080]: DEBUG nova.compute.manager [req-5487af47-8398-4b0f-8db6-b1a4c3cf4121 req-b6b16c01-babc-4564-9756-e5dc65bab1dc service nova] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Received event network-vif-deleted-ae56b484-8712-4d95-aa9f-686b40d2619f {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:36:00 user nova-compute[75080]: DEBUG nova.compute.manager [req-6e8816a9-d6f5-4c36-bf9f-1a177250a151 req-245f19b9-73ff-405a-ad93-52cd9b996f9a service nova] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Received event network-vif-plugged-ae56b484-8712-4d95-aa9f-686b40d2619f {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:36:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-6e8816a9-d6f5-4c36-bf9f-1a177250a151 req-245f19b9-73ff-405a-ad93-52cd9b996f9a service nova] Acquiring lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:36:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-6e8816a9-d6f5-4c36-bf9f-1a177250a151 req-245f19b9-73ff-405a-ad93-52cd9b996f9a service nova] Lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:36:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-6e8816a9-d6f5-4c36-bf9f-1a177250a151 req-245f19b9-73ff-405a-ad93-52cd9b996f9a service nova] Lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:36:00 user nova-compute[75080]: DEBUG nova.compute.manager [req-6e8816a9-d6f5-4c36-bf9f-1a177250a151 req-245f19b9-73ff-405a-ad93-52cd9b996f9a service nova] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] No waiting events found dispatching network-vif-plugged-ae56b484-8712-4d95-aa9f-686b40d2619f {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:36:00 user nova-compute[75080]: WARNING nova.compute.manager [req-6e8816a9-d6f5-4c36-bf9f-1a177250a151 req-245f19b9-73ff-405a-ad93-52cd9b996f9a service nova] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Received unexpected event network-vif-plugged-ae56b484-8712-4d95-aa9f-686b40d2619f for instance with vm_state active and task_state deleting.
Dec 05 15:36:00 user nova-compute[75080]: INFO nova.compute.manager [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Took 0.82 seconds to detach 1 volumes for instance.
Dec 05 15:36:00 user nova-compute[75080]: DEBUG nova.compute.manager [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: 308f6ec7-d5c1-46bf-95a4-036e1c192f7f] Deleting volume: 48df39ad-d50b-473c-9675-9c68d4cd1dd5 {{(pid=75080) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 05 15:36:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:36:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:36:01 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:36:01 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:36:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:36:01 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Deleted allocations for instance 308f6ec7-d5c1-46bf-95a4-036e1c192f7f
Dec 05 15:36:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-93197dd3-2998-4a86-8114-cc3b5f5372f4 tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "308f6ec7-d5c1-46bf-95a4-036e1c192f7f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.398s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:36:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:36:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dmUthAzY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:36:08 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:36:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:36:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:36:08 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:36:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:36:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:36:08 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:36:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25 -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[52eebeda-9356-4c6d-8a0e-beb45ab28a9b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:36:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:36:08 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:36:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25 -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0e92cc-abd8-490c-8791-4b3951881348]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:36:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25] added
Dec 05 15:36:08 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:36:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:08 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[282d0ad5-ad51-4466-b8d9-8b4316633f46]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:36:08 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:36:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:09 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7386730d-f476-47f8-ade1-46fa0314a09e]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:36:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:36:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dmUthAzY {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dmUthAzY" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:09 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc606ef-af1a-459a-a5cd-c9862a2f862d]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:36:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dmUthAzY'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:36:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:09 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c24eee-27ad-42f8-95d9-ec3f04a1e6b3]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:36:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:36:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:09 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49884d6-45ed-4598-a890-18079b403963]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:36:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:36:09 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:36:09 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:36:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:36:09 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:36:09 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:36:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25 -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:09 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ba931a-17bf-4ed8-bbb2-a92ae981d0e0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:36:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25, portal: 172.16.0.220,3260]
Dec 05 15:36:09 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25, portal: 172.16.0.220,3260] successful.
Dec 05 15:36:09 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:36:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:09 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5725d009-c6d5-4907-beff-c6a2b5ae1e62]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:36:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:36:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:09 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb162853-29af-48f7-87f6-94318208087a]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:36:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:36:09 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:36:09 user nova-compute[75080]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25 (non-flash)
Dec 05 15:36:09 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:36:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:36:09 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:36:09 user nova-compute[75080]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25 (non-flash)
Dec 05 15:36:09 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:36:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:36:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:36:09 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:36:09 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:36:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:09 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97e8080-57a8-4251-b754-ae61d03d3395]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:36:09 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:36:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dmUthAzY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:36:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:36:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23565376636343630', 'path': '/dev/sdc'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:36:10 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565376636343630', 'path': '/dev/sdc'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:36:10 user nova-compute[75080]: DEBUG nova.objects.instance [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lazy-loading 'flavor' on Instance uuid a2482d35-2159-4605-b7af-da232886b8d3 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:36:10 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 15:36:10 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:36:10 user nova-compute[75080]:   <source dev="/dev/sdc"/>
Dec 05 15:36:10 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:36:10 user nova-compute[75080]:   <serial>7971cee5-0385-4740-b5df-bc2eadd67b25</serial>
Dec 05 15:36:10 user nova-compute[75080]: </disk>
Dec 05 15:36:10 user nova-compute[75080]:  {{(pid=75080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 15:36:10 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:36:10 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:36:10 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] No VIF found with MAC fa:16:3e:11:21:2b, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:36:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d32ac267-aadc-48a2-bb40-ac4301a404ad tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "a2482d35-2159-4605-b7af-da232886b8d3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.216s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:36:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:36:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:36:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5a3ccb0b-8b5b-4f50-8548-84dbe0a2c891 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Acquiring lock "a2482d35-2159-4605-b7af-da232886b8d3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:36:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5a3ccb0b-8b5b-4f50-8548-84dbe0a2c891 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "a2482d35-2159-4605-b7af-da232886b8d3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:36:37 user nova-compute[75080]: INFO nova.compute.manager [None req-5a3ccb0b-8b5b-4f50-8548-84dbe0a2c891 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Detaching volume 7971cee5-0385-4740-b5df-bc2eadd67b25
Dec 05 15:36:37 user nova-compute[75080]: INFO nova.virt.block_device [None req-5a3ccb0b-8b5b-4f50-8548-84dbe0a2c891 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Attempting to driver detach volume 7971cee5-0385-4740-b5df-bc2eadd67b25 from mountpoint /dev/vdb
Dec 05 15:36:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5a3ccb0b-8b5b-4f50-8548-84dbe0a2c891 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Attempting to detach device vdb from instance a2482d35-2159-4605-b7af-da232886b8d3 from the persistent domain config. {{(pid=75080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 15:36:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-5a3ccb0b-8b5b-4f50-8548-84dbe0a2c891 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:36:37 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:36:37 user nova-compute[75080]:   <source dev="/dev/sdc"/>
Dec 05 15:36:37 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:36:37 user nova-compute[75080]:   <serial>7971cee5-0385-4740-b5df-bc2eadd67b25</serial>
Dec 05 15:36:37 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 15:36:37 user nova-compute[75080]: </disk>
Dec 05 15:36:37 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:36:37 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-5a3ccb0b-8b5b-4f50-8548-84dbe0a2c891 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Successfully detached device vdb from instance a2482d35-2159-4605-b7af-da232886b8d3 from the persistent domain config.
Dec 05 15:36:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5a3ccb0b-8b5b-4f50-8548-84dbe0a2c891 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a2482d35-2159-4605-b7af-da232886b8d3 from the live domain config. {{(pid=75080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 15:36:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-5a3ccb0b-8b5b-4f50-8548-84dbe0a2c891 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:36:37 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:36:37 user nova-compute[75080]:   <source dev="/dev/sdc"/>
Dec 05 15:36:37 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:36:37 user nova-compute[75080]:   <serial>7971cee5-0385-4740-b5df-bc2eadd67b25</serial>
Dec 05 15:36:37 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 15:36:37 user nova-compute[75080]: </disk>
Dec 05 15:36:37 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:36:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Acquiring lock "a2482d35-2159-4605-b7af-da232886b8d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:36:38 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5a3ccb0b-8b5b-4f50-8548-84dbe0a2c891 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a2482d35-2159-4605-b7af-da232886b8d3 {{(pid=75080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 15:36:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquiring lock "1e352b3b-ee04-42f6-af53-973c3154a342" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:36:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "1e352b3b-ee04-42f6-af53-973c3154a342" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:36:38 user nova-compute[75080]: DEBUG nova.compute.manager [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:36:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:36:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:36:38 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:36:38 user nova-compute[75080]: INFO nova.compute.claims [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Claim successful on node user
Dec 05 15:36:38 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:36:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:38 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:36:38 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:36:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.416s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:36:38 user nova-compute[75080]: DEBUG nova.compute.manager [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:36:38 user nova-compute[75080]: DEBUG nova.compute.manager [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:36:38 user nova-compute[75080]: DEBUG nova.network.neutron [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:36:38 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:36:38 user nova-compute[75080]: DEBUG nova.compute.manager [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:36:38 user nova-compute[75080]: DEBUG nova.policy [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e0cb687b9ede4bb8ac3e192766fa4f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e67b7f2574eb38f3395452b647de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:36:39 user nova-compute[75080]: DEBUG nova.compute.manager [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:36:39 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:36:39 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Creating image(s)
Dec 05 15:36:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:36:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "/opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:36:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "/opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:36:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquiring lock "0fdcd1adbc55311e43e8b7a1fda6100cfedd56d3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:36:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "0fdcd1adbc55311e43e8b7a1fda6100cfedd56d3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:36:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fdcd1adbc55311e43e8b7a1fda6100cfedd56d3.part --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:39 user nova-compute[75080]: DEBUG nova.network.neutron [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Successfully created port: b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540 {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:36:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fdcd1adbc55311e43e8b7a1fda6100cfedd56d3.part --force-share --output=json" returned: 0 in 0.186s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:39 user nova-compute[75080]: DEBUG nova.virt.images [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] 83e7a794-d2df-4acd-be99-9f30b564a2d3 was qcow2, converting to raw {{(pid=75080) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 05 15:36:39 user nova-compute[75080]: DEBUG nova.privsep.utils [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75080) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 15:36:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0fdcd1adbc55311e43e8b7a1fda6100cfedd56d3.part /opt/stack/data/nova/instances/_base/0fdcd1adbc55311e43e8b7a1fda6100cfedd56d3.converted {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0fdcd1adbc55311e43e8b7a1fda6100cfedd56d3.part /opt/stack/data/nova/instances/_base/0fdcd1adbc55311e43e8b7a1fda6100cfedd56d3.converted" returned: 0 in 0.457s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fdcd1adbc55311e43e8b7a1fda6100cfedd56d3.converted --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fdcd1adbc55311e43e8b7a1fda6100cfedd56d3.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "0fdcd1adbc55311e43e8b7a1fda6100cfedd56d3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.287s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:36:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fdcd1adbc55311e43e8b7a1fda6100cfedd56d3 --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:40 user nova-compute[75080]: DEBUG nova.network.neutron [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Successfully updated port: b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540 {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:36:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquiring lock "refresh_cache-1e352b3b-ee04-42f6-af53-973c3154a342" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:36:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquired lock "refresh_cache-1e352b3b-ee04-42f6-af53-973c3154a342" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:36:40 user nova-compute[75080]: DEBUG nova.network.neutron [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:36:40 user nova-compute[75080]: DEBUG nova.compute.manager [req-dc54030b-e0df-4c53-b607-fe34d6aa9879 req-86c0442f-d86b-4c2a-b3f1-d6b221e397f2 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Received event network-changed-b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:36:40 user nova-compute[75080]: DEBUG nova.compute.manager [req-dc54030b-e0df-4c53-b607-fe34d6aa9879 req-86c0442f-d86b-4c2a-b3f1-d6b221e397f2 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Refreshing instance network info cache due to event network-changed-b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:36:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-dc54030b-e0df-4c53-b607-fe34d6aa9879 req-86c0442f-d86b-4c2a-b3f1-d6b221e397f2 service nova] Acquiring lock "refresh_cache-1e352b3b-ee04-42f6-af53-973c3154a342" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:36:40 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:36:40 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:36:40 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:36:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fdcd1adbc55311e43e8b7a1fda6100cfedd56d3 --force-share --output=json" returned: 0 in 0.173s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquiring lock "0fdcd1adbc55311e43e8b7a1fda6100cfedd56d3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:36:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "0fdcd1adbc55311e43e8b7a1fda6100cfedd56d3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:36:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fdcd1adbc55311e43e8b7a1fda6100cfedd56d3 --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fdcd1adbc55311e43e8b7a1fda6100cfedd56d3 --force-share --output=json" returned: 0 in 0.173s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fdcd1adbc55311e43e8b7a1fda6100cfedd56d3,backing_fmt=raw /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fdcd1adbc55311e43e8b7a1fda6100cfedd56d3,backing_fmt=raw /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk 1073741824" returned: 0 in 0.055s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "0fdcd1adbc55311e43e8b7a1fda6100cfedd56d3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:36:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fdcd1adbc55311e43e8b7a1fda6100cfedd56d3 --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:40 user nova-compute[75080]: DEBUG nova.network.neutron [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:36:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fdcd1adbc55311e43e8b7a1fda6100cfedd56d3 --force-share --output=json" returned: 0 in 0.185s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:40 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 15:36:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG nova.network.neutron [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Updating instance_info_cache with network_info: [{"id": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "address": "fa:16:3e:47:d3:7c", "network": {"id": "1151f7c9-f853-4f06-93d7-74536b8b12ac", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420489370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549e67b7f2574eb38f3395452b647de7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1a68f60-ce", "ovs_interfaceid": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Releasing lock "refresh_cache-1e352b3b-ee04-42f6-af53-973c3154a342" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG nova.compute.manager [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Instance network_info: |[{"id": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "address": "fa:16:3e:47:d3:7c", "network": {"id": "1151f7c9-f853-4f06-93d7-74536b8b12ac", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420489370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549e67b7f2574eb38f3395452b647de7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1a68f60-ce", "ovs_interfaceid": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-dc54030b-e0df-4c53-b607-fe34d6aa9879 req-86c0442f-d86b-4c2a-b3f1-d6b221e397f2 service nova] Acquired lock "refresh_cache-1e352b3b-ee04-42f6-af53-973c3154a342" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG nova.network.neutron [req-dc54030b-e0df-4c53-b607-fe34d6aa9879 req-86c0442f-d86b-4c2a-b3f1-d6b221e397f2 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Refreshing network info cache for port b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Cannot resize image /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Ensure instance console log exists: /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Start _get_guest_xml network_info=[{"id": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "address": "fa:16:3e:47:d3:7c", "network": {"id": "1151f7c9-f853-4f06-93d7-74536b8b12ac", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420489370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549e67b7f2574eb38f3395452b647de7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1a68f60-ce", "ovs_interfaceid": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:36:36Z,direct_url=<?>,disk_format='qcow2',id=83e7a794-d2df-4acd-be99-9f30b564a2d3,min_disk=0,min_ram=0,name='tempest-scenario-img--15704254',owner='549e67b7f2574eb38f3395452b647de7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:36:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '83e7a794-d2df-4acd-be99-9f30b564a2d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:36:41 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:36:41 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:36:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:36:36Z,direct_url=<?>,disk_format='qcow2',id=83e7a794-d2df-4acd-be99-9f30b564a2d3,min_disk=0,min_ram=0,name='tempest-scenario-img--15704254',owner='549e67b7f2574eb38f3395452b647de7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:36:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:36:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1577552572',display_name='tempest-TestMinimumBasicScenario-server-1577552572',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1577552572',id=37,image_ref='83e7a794-d2df-4acd-be99-9f30b564a2d3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBVo56f6MpZ3G8aHK/NCskAJXqmivK9NR9tXYO7XFZF0y+subtUdlQz10O+5bsDv2J2MCK+m8HVQ7rQyVrJn+Sh0HIgj6JlsELedJ7Cd0brl0Jl9FO+4EMlr97RezQYIQ==',key_name='tempest-TestMinimumBasicScenario-1082211644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='549e67b7f2574eb38f3395452b647de7',ramdisk_id='',reservation_id='r-p7hcs3hz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e7a794-d2df-4acd-be99-9f30b564a2d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1307764000',owner_user_name='tempest-TestMinimumBasicScenario-1307764000-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:36:39Z,user_data=None,user_id='e0cb687b9ede4bb8ac3e192766fa4f21',uuid=1e352b3b-ee04-42f6-af53-973c3154a342,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "address": "fa:16:3e:47:d3:7c", "network": {"id": "1151f7c9-f853-4f06-93d7-74536b8b12ac", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420489370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549e67b7f2574eb38f3395452b647de7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1a68f60-ce", "ovs_interfaceid": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Converting VIF {"id": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "address": "fa:16:3e:47:d3:7c", "network": {"id": "1151f7c9-f853-4f06-93d7-74536b8b12ac", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420489370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549e67b7f2574eb38f3395452b647de7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1a68f60-ce", "ovs_interfaceid": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:d3:7c,bridge_name='br-int',has_traffic_filtering=True,id=b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540,network=Network(1151f7c9-f853-4f06-93d7-74536b8b12ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1a68f60-ce') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG nova.objects.instance [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e352b3b-ee04-42f6-af53-973c3154a342 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:36:41 user nova-compute[75080]:   <uuid>1e352b3b-ee04-42f6-af53-973c3154a342</uuid>
Dec 05 15:36:41 user nova-compute[75080]:   <name>instance-00000025</name>
Dec 05 15:36:41 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:36:41 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:36:41 user nova-compute[75080]:   <metadata>
Dec 05 15:36:41 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:36:41 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:36:41 user nova-compute[75080]:       <nova:name>tempest-TestMinimumBasicScenario-server-1577552572</nova:name>
Dec 05 15:36:41 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:36:41</nova:creationTime>
Dec 05 15:36:41 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:36:41 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:36:41 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:36:41 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:36:41 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:36:41 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:36:41 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:36:41 user nova-compute[75080]:       <nova:owner>
Dec 05 15:36:41 user nova-compute[75080]:         <nova:user uuid="e0cb687b9ede4bb8ac3e192766fa4f21">tempest-TestMinimumBasicScenario-1307764000-project-member</nova:user>
Dec 05 15:36:41 user nova-compute[75080]:         <nova:project uuid="549e67b7f2574eb38f3395452b647de7">tempest-TestMinimumBasicScenario-1307764000</nova:project>
Dec 05 15:36:41 user nova-compute[75080]:       </nova:owner>
Dec 05 15:36:41 user nova-compute[75080]:       <nova:root type="image" uuid="83e7a794-d2df-4acd-be99-9f30b564a2d3"/>
Dec 05 15:36:41 user nova-compute[75080]:       <nova:ports>
Dec 05 15:36:41 user nova-compute[75080]:         <nova:port uuid="b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540">
Dec 05 15:36:41 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 05 15:36:41 user nova-compute[75080]:         </nova:port>
Dec 05 15:36:41 user nova-compute[75080]:       </nova:ports>
Dec 05 15:36:41 user nova-compute[75080]:     </nova:instance>
Dec 05 15:36:41 user nova-compute[75080]:   </metadata>
Dec 05 15:36:41 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:36:41 user nova-compute[75080]:     <system>
Dec 05 15:36:41 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:36:41 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:36:41 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:36:41 user nova-compute[75080]:       <entry name="serial">1e352b3b-ee04-42f6-af53-973c3154a342</entry>
Dec 05 15:36:41 user nova-compute[75080]:       <entry name="uuid">1e352b3b-ee04-42f6-af53-973c3154a342</entry>
Dec 05 15:36:41 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:36:41 user nova-compute[75080]:     </system>
Dec 05 15:36:41 user nova-compute[75080]:   </sysinfo>
Dec 05 15:36:41 user nova-compute[75080]:   <os>
Dec 05 15:36:41 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:36:41 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:36:41 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:36:41 user nova-compute[75080]:   </os>
Dec 05 15:36:41 user nova-compute[75080]:   <features>
Dec 05 15:36:41 user nova-compute[75080]:     <acpi/>
Dec 05 15:36:41 user nova-compute[75080]:     <apic/>
Dec 05 15:36:41 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:36:41 user nova-compute[75080]:   </features>
Dec 05 15:36:41 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:36:41 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:36:41 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:36:41 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:36:41 user nova-compute[75080]:   </clock>
Dec 05 15:36:41 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:36:41 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:36:41 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:36:41 user nova-compute[75080]:   </cpu>
Dec 05 15:36:41 user nova-compute[75080]:   <devices>
Dec 05 15:36:41 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:36:41 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:36:41 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk"/>
Dec 05 15:36:41 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:36:41 user nova-compute[75080]:     </disk>
Dec 05 15:36:41 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:36:41 user nova-compute[75080]:       <mac address="fa:16:3e:47:d3:7c"/>
Dec 05 15:36:41 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:36:41 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:36:41 user nova-compute[75080]:       <target dev="tapb1a68f60-ce"/>
Dec 05 15:36:41 user nova-compute[75080]:     </interface>
Dec 05 15:36:41 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:36:41 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/console.log" append="off"/>
Dec 05 15:36:41 user nova-compute[75080]:     </serial>
Dec 05 15:36:41 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:36:41 user nova-compute[75080]:     <video>
Dec 05 15:36:41 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:36:41 user nova-compute[75080]:     </video>
Dec 05 15:36:41 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:36:41 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:36:41 user nova-compute[75080]:     </rng>
Dec 05 15:36:41 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:36:41 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:36:41 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:36:41 user nova-compute[75080]:     </memballoon>
Dec 05 15:36:41 user nova-compute[75080]:   </devices>
Dec 05 15:36:41 user nova-compute[75080]: </domain>
Dec 05 15:36:41 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:36:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1577552572',display_name='tempest-TestMinimumBasicScenario-server-1577552572',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1577552572',id=37,image_ref='83e7a794-d2df-4acd-be99-9f30b564a2d3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBVo56f6MpZ3G8aHK/NCskAJXqmivK9NR9tXYO7XFZF0y+subtUdlQz10O+5bsDv2J2MCK+m8HVQ7rQyVrJn+Sh0HIgj6JlsELedJ7Cd0brl0Jl9FO+4EMlr97RezQYIQ==',key_name='tempest-TestMinimumBasicScenario-1082211644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='549e67b7f2574eb38f3395452b647de7',ramdisk_id='',reservation_id='r-p7hcs3hz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e7a794-d2df-4acd-be99-9f30b564a2d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1307764000',owner_user_name='tempest-TestMinimumBasicScenario-1307764000-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:36:39Z,user_data=None,user_id='e0cb687b9ede4bb8ac3e192766fa4f21',uuid=1e352b3b-ee04-42f6-af53-973c3154a342,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "address": "fa:16:3e:47:d3:7c", "network": {"id": "1151f7c9-f853-4f06-93d7-74536b8b12ac", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420489370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549e67b7f2574eb38f3395452b647de7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1a68f60-ce", "ovs_interfaceid": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Converting VIF {"id": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "address": "fa:16:3e:47:d3:7c", "network": {"id": "1151f7c9-f853-4f06-93d7-74536b8b12ac", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420489370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549e67b7f2574eb38f3395452b647de7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1a68f60-ce", "ovs_interfaceid": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:d3:7c,bridge_name='br-int',has_traffic_filtering=True,id=b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540,network=Network(1151f7c9-f853-4f06-93d7-74536b8b12ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1a68f60-ce') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG os_vif [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:d3:7c,bridge_name='br-int',has_traffic_filtering=True,id=b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540,network=Network(1151f7c9-f853-4f06-93d7-74536b8b12ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1a68f60-ce') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '352ea435-74f8-546d-83de-733b41b336cc', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1a68f60-ce, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb1a68f60-ce, col_values=(('qos', UUID('59b2e7a6-6243-411b-8e46-115616bc0a3b')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb1a68f60-ce, col_values=(('external_ids', {'iface-id': 'b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:d3:7c', 'vm-uuid': '1e352b3b-ee04-42f6-af53-973c3154a342'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:41 user nova-compute[75080]: INFO os_vif [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:d3:7c,bridge_name='br-int',has_traffic_filtering=True,id=b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540,network=Network(1151f7c9-f853-4f06-93d7-74536b8b12ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1a68f60-ce')
Dec 05 15:36:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] No VIF found with MAC fa:16:3e:47:d3:7c, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG nova.network.neutron [req-dc54030b-e0df-4c53-b607-fe34d6aa9879 req-86c0442f-d86b-4c2a-b3f1-d6b221e397f2 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Updated VIF entry in instance network info cache for port b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG nova.network.neutron [req-dc54030b-e0df-4c53-b607-fe34d6aa9879 req-86c0442f-d86b-4c2a-b3f1-d6b221e397f2 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Updating instance_info_cache with network_info: [{"id": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "address": "fa:16:3e:47:d3:7c", "network": {"id": "1151f7c9-f853-4f06-93d7-74536b8b12ac", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420489370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549e67b7f2574eb38f3395452b647de7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1a68f60-ce", "ovs_interfaceid": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:36:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-dc54030b-e0df-4c53-b607-fe34d6aa9879 req-86c0442f-d86b-4c2a-b3f1-d6b221e397f2 service nova] Releasing lock "refresh_cache-1e352b3b-ee04-42f6-af53-973c3154a342" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:36:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:42 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:36:42 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:36:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-ab882db7-e6d7-44ca-9ea4-ae2fa68f7929" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:36:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-ab882db7-e6d7-44ca-9ea4-ae2fa68f7929" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:36:42 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 15:36:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:42 user nova-compute[75080]: DEBUG nova.objects.instance [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lazy-loading 'flavor' on Instance uuid 011d3446-577a-4f5c-b8f0-ef04940cad17 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:36:42 user nova-compute[75080]: DEBUG nova.compute.manager [req-301d620b-0a49-4234-af12-1595a89da34f req-f307bbe9-3f73-4c31-8792-c7291b06feb0 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Received event network-vif-plugged-b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:36:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-301d620b-0a49-4234-af12-1595a89da34f req-f307bbe9-3f73-4c31-8792-c7291b06feb0 service nova] Acquiring lock "1e352b3b-ee04-42f6-af53-973c3154a342-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:36:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-301d620b-0a49-4234-af12-1595a89da34f req-f307bbe9-3f73-4c31-8792-c7291b06feb0 service nova] Lock "1e352b3b-ee04-42f6-af53-973c3154a342-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:36:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-301d620b-0a49-4234-af12-1595a89da34f req-f307bbe9-3f73-4c31-8792-c7291b06feb0 service nova] Lock "1e352b3b-ee04-42f6-af53-973c3154a342-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:36:42 user nova-compute[75080]: DEBUG nova.compute.manager [req-301d620b-0a49-4234-af12-1595a89da34f req-f307bbe9-3f73-4c31-8792-c7291b06feb0 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] No waiting events found dispatching network-vif-plugged-b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:36:42 user nova-compute[75080]: WARNING nova.compute.manager [req-301d620b-0a49-4234-af12-1595a89da34f req-f307bbe9-3f73-4c31-8792-c7291b06feb0 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Received unexpected event network-vif-plugged-b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540 for instance with vm_state building and task_state spawning.
Dec 05 15:36:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "refresh_cache-011d3446-577a-4f5c-b8f0-ef04940cad17" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:36:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquired lock "refresh_cache-011d3446-577a-4f5c-b8f0-ef04940cad17" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:36:42 user nova-compute[75080]: DEBUG nova.network.neutron [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:36:42 user nova-compute[75080]: DEBUG nova.objects.instance [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lazy-loading 'info_cache' on Instance uuid 011d3446-577a-4f5c-b8f0-ef04940cad17 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:36:42 user nova-compute[75080]: DEBUG nova.objects.base [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Object Instance<011d3446-577a-4f5c-b8f0-ef04940cad17> lazy-loaded attributes: flavor,info_cache {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Updating instance_info_cache with network_info: [{"id": "af017697-07fb-4000-87d4-87f84dbd53bc", "address": "fa:16:3e:48:4c:fd", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf017697-07", "ovs_interfaceid": "af017697-07fb-4000-87d4-87f84dbd53bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-ab882db7-e6d7-44ca-9ea4-ae2fa68f7929" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG nova.network.neutron [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Updating instance_info_cache with network_info: [{"id": "dfee0a0e-5241-4d51-879d-7667bb06344b", "address": "fa:16:3e:be:d6:bd", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfee0a0e-52", "ovs_interfaceid": "dfee0a0e-5241-4d51-879d-7667bb06344b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Releasing lock "refresh_cache-011d3446-577a-4f5c-b8f0-ef04940cad17" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:36:43 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Instance destroyed successfully.
Dec 05 15:36:43 user nova-compute[75080]: DEBUG nova.objects.instance [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lazy-loading 'resources' on Instance uuid 011d3446-577a-4f5c-b8f0-ef04940cad17 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG nova.objects.base [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Object Instance<011d3446-577a-4f5c-b8f0-ef04940cad17> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:28:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-215552341',display_name='tempest-AttachVolumeTestJSON-server-215552341',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-215552341',id=28,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNR5WqP/N7bn4T+SXNEWvIjtaw5+s7Hk+R+FM8SRLh86FpF209SN9UyEjy0e1+2DKmJSUEmh664j9n8POCm+HUQ9EtbpXmMRPj40zHqJTQgREs+C9f2zqAuxq3d0+o2xbw==',key_name='tempest-keypair-1745876029',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:28:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a01b18b2a93b457c8e160447d44a673e',ramdisk_id='',reservation_id='r-oe6cj9ox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1911411330',owner_user_name='tempest-AttachVolumeTestJSON-1911411330-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:34:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a02caebbfe541209b87adcbf848ede6',uuid=011d3446-577a-4f5c-b8f0-ef04940cad17,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "dfee0a0e-5241-4d51-879d-7667bb06344b", "address": "fa:16:3e:be:d6:bd", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfee0a0e-52", "ovs_interfaceid": "dfee0a0e-5241-4d51-879d-7667bb06344b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Converting VIF {"id": "dfee0a0e-5241-4d51-879d-7667bb06344b", "address": "fa:16:3e:be:d6:bd", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfee0a0e-52", "ovs_interfaceid": "dfee0a0e-5241-4d51-879d-7667bb06344b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:d6:bd,bridge_name='br-int',has_traffic_filtering=True,id=dfee0a0e-5241-4d51-879d-7667bb06344b,network=Network(3037e443-f4eb-446e-8a80-53f409b02ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfee0a0e-52') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG os_vif [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:d6:bd,bridge_name='br-int',has_traffic_filtering=True,id=dfee0a0e-5241-4d51-879d-7667bb06344b,network=Network(3037e443-f4eb-446e-8a80-53f409b02ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfee0a0e-52') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfee0a0e-52, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38978b54-719c-454b-b260-5f2173ba4f50) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:43 user nova-compute[75080]: INFO os_vif [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:d6:bd,bridge_name='br-int',has_traffic_filtering=True,id=dfee0a0e-5241-4d51-879d-7667bb06344b,network=Network(3037e443-f4eb-446e-8a80-53f409b02ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfee0a0e-52')
Dec 05 15:36:43 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Start _get_guest_xml network_info=[{"id": "dfee0a0e-5241-4d51-879d-7667bb06344b", "address": "fa:16:3e:be:d6:bd", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfee0a0e-52", "ovs_interfaceid": "dfee0a0e-5241-4d51-879d-7667bb06344b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG nova.objects.instance [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lazy-loading 'numa_topology' on Instance uuid 011d3446-577a-4f5c-b8f0-ef04940cad17 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG nova.objects.base [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Object Instance<011d3446-577a-4f5c-b8f0-ef04940cad17> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:36:43 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:36:43 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:36:43 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG nova.objects.instance [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lazy-loading 'vcpu_model' on Instance uuid 011d3446-577a-4f5c-b8f0-ef04940cad17 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG nova.objects.base [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Object Instance<011d3446-577a-4f5c-b8f0-ef04940cad17> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:28:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-215552341',display_name='tempest-AttachVolumeTestJSON-server-215552341',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-215552341',id=28,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNR5WqP/N7bn4T+SXNEWvIjtaw5+s7Hk+R+FM8SRLh86FpF209SN9UyEjy0e1+2DKmJSUEmh664j9n8POCm+HUQ9EtbpXmMRPj40zHqJTQgREs+C9f2zqAuxq3d0+o2xbw==',key_name='tempest-keypair-1745876029',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:28:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a01b18b2a93b457c8e160447d44a673e',ramdisk_id='',reservation_id='r-oe6cj9ox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1911411330',owner_user_name='tempest-AttachVolumeTestJSON-1911411330-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:34:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a02caebbfe541209b87adcbf848ede6',uuid=011d3446-577a-4f5c-b8f0-ef04940cad17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "dfee0a0e-5241-4d51-879d-7667bb06344b", "address": "fa:16:3e:be:d6:bd", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfee0a0e-52", "ovs_interfaceid": "dfee0a0e-5241-4d51-879d-7667bb06344b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Converting VIF {"id": "dfee0a0e-5241-4d51-879d-7667bb06344b", "address": "fa:16:3e:be:d6:bd", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfee0a0e-52", "ovs_interfaceid": "dfee0a0e-5241-4d51-879d-7667bb06344b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:d6:bd,bridge_name='br-int',has_traffic_filtering=True,id=dfee0a0e-5241-4d51-879d-7667bb06344b,network=Network(3037e443-f4eb-446e-8a80-53f409b02ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfee0a0e-52') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG nova.objects.instance [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lazy-loading 'pci_devices' on Instance uuid 011d3446-577a-4f5c-b8f0-ef04940cad17 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG nova.objects.base [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Object Instance<011d3446-577a-4f5c-b8f0-ef04940cad17> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:36:43 user nova-compute[75080]:   <uuid>011d3446-577a-4f5c-b8f0-ef04940cad17</uuid>
Dec 05 15:36:43 user nova-compute[75080]:   <name>instance-0000001c</name>
Dec 05 15:36:43 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:36:43 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:36:43 user nova-compute[75080]:   <metadata>
Dec 05 15:36:43 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:36:43 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:36:43 user nova-compute[75080]:       <nova:name>tempest-AttachVolumeTestJSON-server-215552341</nova:name>
Dec 05 15:36:43 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:36:43</nova:creationTime>
Dec 05 15:36:43 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:36:43 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:36:43 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:36:43 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:36:43 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:36:43 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:36:43 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:36:43 user nova-compute[75080]:       <nova:owner>
Dec 05 15:36:43 user nova-compute[75080]:         <nova:user uuid="7a02caebbfe541209b87adcbf848ede6">tempest-AttachVolumeTestJSON-1911411330-project-member</nova:user>
Dec 05 15:36:43 user nova-compute[75080]:         <nova:project uuid="a01b18b2a93b457c8e160447d44a673e">tempest-AttachVolumeTestJSON-1911411330</nova:project>
Dec 05 15:36:43 user nova-compute[75080]:       </nova:owner>
Dec 05 15:36:43 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:36:43 user nova-compute[75080]:       <nova:ports>
Dec 05 15:36:43 user nova-compute[75080]:         <nova:port uuid="dfee0a0e-5241-4d51-879d-7667bb06344b">
Dec 05 15:36:43 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 05 15:36:43 user nova-compute[75080]:         </nova:port>
Dec 05 15:36:43 user nova-compute[75080]:       </nova:ports>
Dec 05 15:36:43 user nova-compute[75080]:     </nova:instance>
Dec 05 15:36:43 user nova-compute[75080]:   </metadata>
Dec 05 15:36:43 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:36:43 user nova-compute[75080]:     <system>
Dec 05 15:36:43 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:36:43 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:36:43 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:36:43 user nova-compute[75080]:       <entry name="serial">011d3446-577a-4f5c-b8f0-ef04940cad17</entry>
Dec 05 15:36:43 user nova-compute[75080]:       <entry name="uuid">011d3446-577a-4f5c-b8f0-ef04940cad17</entry>
Dec 05 15:36:43 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:36:43 user nova-compute[75080]:     </system>
Dec 05 15:36:43 user nova-compute[75080]:   </sysinfo>
Dec 05 15:36:43 user nova-compute[75080]:   <os>
Dec 05 15:36:43 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:36:43 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:36:43 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:36:43 user nova-compute[75080]:   </os>
Dec 05 15:36:43 user nova-compute[75080]:   <features>
Dec 05 15:36:43 user nova-compute[75080]:     <acpi/>
Dec 05 15:36:43 user nova-compute[75080]:     <apic/>
Dec 05 15:36:43 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:36:43 user nova-compute[75080]:   </features>
Dec 05 15:36:43 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:36:43 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:36:43 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:36:43 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:36:43 user nova-compute[75080]:   </clock>
Dec 05 15:36:43 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:36:43 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:36:43 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:36:43 user nova-compute[75080]:   </cpu>
Dec 05 15:36:43 user nova-compute[75080]:   <devices>
Dec 05 15:36:43 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:36:43 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:36:43 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk"/>
Dec 05 15:36:43 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:36:43 user nova-compute[75080]:     </disk>
Dec 05 15:36:43 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:36:43 user nova-compute[75080]:       <mac address="fa:16:3e:be:d6:bd"/>
Dec 05 15:36:43 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:36:43 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:36:43 user nova-compute[75080]:       <target dev="tapdfee0a0e-52"/>
Dec 05 15:36:43 user nova-compute[75080]:     </interface>
Dec 05 15:36:43 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:36:43 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/console.log" append="off"/>
Dec 05 15:36:43 user nova-compute[75080]:     </serial>
Dec 05 15:36:43 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:36:43 user nova-compute[75080]:     <video>
Dec 05 15:36:43 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:36:43 user nova-compute[75080]:     </video>
Dec 05 15:36:43 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:36:43 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:36:43 user nova-compute[75080]:     </rng>
Dec 05 15:36:43 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:36:43 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:36:43 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:36:43 user nova-compute[75080]:     </memballoon>
Dec 05 15:36:43 user nova-compute[75080]:   </devices>
Dec 05 15:36:43 user nova-compute[75080]: </domain>
Dec 05 15:36:43 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG nova.objects.instance [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lazy-loading 'trusted_certs' on Instance uuid 011d3446-577a-4f5c-b8f0-ef04940cad17 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG nova.objects.base [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Object Instance<011d3446-577a-4f5c-b8f0-ef04940cad17> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.169s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Checking if we can resize image /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Cannot resize image /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG nova.objects.instance [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lazy-loading 'migration_context' on Instance uuid 011d3446-577a-4f5c-b8f0-ef04940cad17 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG nova.objects.base [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Object Instance<011d3446-577a-4f5c-b8f0-ef04940cad17> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:28:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-215552341',display_name='tempest-AttachVolumeTestJSON-server-215552341',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-215552341',id=28,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNR5WqP/N7bn4T+SXNEWvIjtaw5+s7Hk+R+FM8SRLh86FpF209SN9UyEjy0e1+2DKmJSUEmh664j9n8POCm+HUQ9EtbpXmMRPj40zHqJTQgREs+C9f2zqAuxq3d0+o2xbw==',key_name='tempest-keypair-1745876029',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:28:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='a01b18b2a93b457c8e160447d44a673e',ramdisk_id='',reservation_id='r-oe6cj9ox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1911411330',owner_user_name='tempest-AttachVolumeTestJSON-1911411330-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:34:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a02caebbfe541209b87adcbf848ede6',uuid=011d3446-577a-4f5c-b8f0-ef04940cad17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "dfee0a0e-5241-4d51-879d-7667bb06344b", "address": "fa:16:3e:be:d6:bd", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfee0a0e-52", "ovs_interfaceid": "dfee0a0e-5241-4d51-879d-7667bb06344b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Converting VIF {"id": "dfee0a0e-5241-4d51-879d-7667bb06344b", "address": "fa:16:3e:be:d6:bd", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfee0a0e-52", "ovs_interfaceid": "dfee0a0e-5241-4d51-879d-7667bb06344b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:d6:bd,bridge_name='br-int',has_traffic_filtering=True,id=dfee0a0e-5241-4d51-879d-7667bb06344b,network=Network(3037e443-f4eb-446e-8a80-53f409b02ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfee0a0e-52') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG os_vif [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:d6:bd,bridge_name='br-int',has_traffic_filtering=True,id=dfee0a0e-5241-4d51-879d-7667bb06344b,network=Network(3037e443-f4eb-446e-8a80-53f409b02ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfee0a0e-52') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c37e27ee-77ec-598d-b20d-199d1e8f87a2', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG nova.compute.manager [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfee0a0e-52, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdfee0a0e-52, col_values=(('qos', UUID('43300376-85ea-48a5-ba4a-3bce8bc0b9e8')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdfee0a0e-52, col_values=(('external_ids', {'iface-id': 'dfee0a0e-5241-4d51-879d-7667bb06344b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:d6:bd', 'vm-uuid': '011d3446-577a-4f5c-b8f0-ef04940cad17'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:44 user nova-compute[75080]: INFO os_vif [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:d6:bd,bridge_name='br-int',has_traffic_filtering=True,id=dfee0a0e-5241-4d51-879d-7667bb06344b,network=Network(3037e443-f4eb-446e-8a80-53f409b02ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfee0a0e-52')
Dec 05 15:36:44 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Instance spawned successfully.
Dec 05 15:36:44 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG nova.compute.manager [req-52f7c06c-4111-4d04-ac8d-f2b0b4f1f42b req-767bf3d9-f81f-4220-be06-630636e9c4c6 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Received event network-vif-plugged-b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-52f7c06c-4111-4d04-ac8d-f2b0b4f1f42b req-767bf3d9-f81f-4220-be06-630636e9c4c6 service nova] Acquiring lock "1e352b3b-ee04-42f6-af53-973c3154a342-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-52f7c06c-4111-4d04-ac8d-f2b0b4f1f42b req-767bf3d9-f81f-4220-be06-630636e9c4c6 service nova] Lock "1e352b3b-ee04-42f6-af53-973c3154a342-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-52f7c06c-4111-4d04-ac8d-f2b0b4f1f42b req-767bf3d9-f81f-4220-be06-630636e9c4c6 service nova] Lock "1e352b3b-ee04-42f6-af53-973c3154a342-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG nova.compute.manager [req-52f7c06c-4111-4d04-ac8d-f2b0b4f1f42b req-767bf3d9-f81f-4220-be06-630636e9c4c6 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] No waiting events found dispatching network-vif-plugged-b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:36:44 user nova-compute[75080]: WARNING nova.compute.manager [req-52f7c06c-4111-4d04-ac8d-f2b0b4f1f42b req-767bf3d9-f81f-4220-be06-630636e9c4c6 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Received unexpected event network-vif-plugged-b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540 for instance with vm_state building and task_state spawning.
Dec 05 15:36:44 user nova-compute[75080]: INFO nova.compute.manager [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Took 5.90 seconds to spawn the instance on the hypervisor.
Dec 05 15:36:44 user nova-compute[75080]: DEBUG nova.compute.manager [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:45 user nova-compute[75080]: INFO nova.compute.manager [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Took 6.66 seconds to build instance.
Dec 05 15:36:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a03a7539-816a-406d-a8e3-ef02d337b691 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "1e352b3b-ee04-42f6-af53-973c3154a342" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.766s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:36:45 user nova-compute[75080]: DEBUG nova.compute.manager [req-6671d314-9917-4b74-ae4f-6bbac2d24190 req-24314316-767f-427a-b3e5-189103b0e12f service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Received event network-changed-4fcca870-3cc7-4338-b912-84e32dc7d4c0 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:36:45 user nova-compute[75080]: DEBUG nova.compute.manager [req-6671d314-9917-4b74-ae4f-6bbac2d24190 req-24314316-767f-427a-b3e5-189103b0e12f service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Refreshing instance network info cache due to event network-changed-4fcca870-3cc7-4338-b912-84e32dc7d4c0. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:36:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-6671d314-9917-4b74-ae4f-6bbac2d24190 req-24314316-767f-427a-b3e5-189103b0e12f service nova] Acquiring lock "refresh_cache-b5a4b977-1e76-45c7-bf97-b4db5fb615e2" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:36:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-6671d314-9917-4b74-ae4f-6bbac2d24190 req-24314316-767f-427a-b3e5-189103b0e12f service nova] Acquired lock "refresh_cache-b5a4b977-1e76-45c7-bf97-b4db5fb615e2" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:36:45 user nova-compute[75080]: DEBUG nova.network.neutron [req-6671d314-9917-4b74-ae4f-6bbac2d24190 req-24314316-767f-427a-b3e5-189103b0e12f service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Refreshing network info cache for port 4fcca870-3cc7-4338-b912-84e32dc7d4c0 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:36:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:45 user nova-compute[75080]: DEBUG nova.network.neutron [req-6671d314-9917-4b74-ae4f-6bbac2d24190 req-24314316-767f-427a-b3e5-189103b0e12f service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Updated VIF entry in instance network info cache for port 4fcca870-3cc7-4338-b912-84e32dc7d4c0. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:36:45 user nova-compute[75080]: DEBUG nova.network.neutron [req-6671d314-9917-4b74-ae4f-6bbac2d24190 req-24314316-767f-427a-b3e5-189103b0e12f service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Updating instance_info_cache with network_info: [{"id": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "address": "fa:16:3e:c3:a0:3b", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fcca870-3c", "ovs_interfaceid": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:36:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-6671d314-9917-4b74-ae4f-6bbac2d24190 req-24314316-767f-427a-b3e5-189103b0e12f service nova] Releasing lock "refresh_cache-b5a4b977-1e76-45c7-bf97-b4db5fb615e2" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:36:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:47 user nova-compute[75080]: DEBUG nova.compute.manager [req-4b5f9d57-f93b-4a40-a4f6-7a711eca40c2 req-29abf6ff-9e6f-498a-ad10-14c1297a5e0f service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Received event network-vif-plugged-dfee0a0e-5241-4d51-879d-7667bb06344b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:36:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4b5f9d57-f93b-4a40-a4f6-7a711eca40c2 req-29abf6ff-9e6f-498a-ad10-14c1297a5e0f service nova] Acquiring lock "011d3446-577a-4f5c-b8f0-ef04940cad17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:36:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4b5f9d57-f93b-4a40-a4f6-7a711eca40c2 req-29abf6ff-9e6f-498a-ad10-14c1297a5e0f service nova] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:36:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4b5f9d57-f93b-4a40-a4f6-7a711eca40c2 req-29abf6ff-9e6f-498a-ad10-14c1297a5e0f service nova] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:36:47 user nova-compute[75080]: DEBUG nova.compute.manager [req-4b5f9d57-f93b-4a40-a4f6-7a711eca40c2 req-29abf6ff-9e6f-498a-ad10-14c1297a5e0f service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] No waiting events found dispatching network-vif-plugged-dfee0a0e-5241-4d51-879d-7667bb06344b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:36:47 user nova-compute[75080]: WARNING nova.compute.manager [req-4b5f9d57-f93b-4a40-a4f6-7a711eca40c2 req-29abf6ff-9e6f-498a-ad10-14c1297a5e0f service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Received unexpected event network-vif-plugged-dfee0a0e-5241-4d51-879d-7667bb06344b for instance with vm_state stopped and task_state powering-on.
Dec 05 15:36:47 user nova-compute[75080]: DEBUG nova.compute.manager [req-4b5f9d57-f93b-4a40-a4f6-7a711eca40c2 req-29abf6ff-9e6f-498a-ad10-14c1297a5e0f service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Received event network-vif-plugged-dfee0a0e-5241-4d51-879d-7667bb06344b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:36:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4b5f9d57-f93b-4a40-a4f6-7a711eca40c2 req-29abf6ff-9e6f-498a-ad10-14c1297a5e0f service nova] Acquiring lock "011d3446-577a-4f5c-b8f0-ef04940cad17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:36:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4b5f9d57-f93b-4a40-a4f6-7a711eca40c2 req-29abf6ff-9e6f-498a-ad10-14c1297a5e0f service nova] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:36:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4b5f9d57-f93b-4a40-a4f6-7a711eca40c2 req-29abf6ff-9e6f-498a-ad10-14c1297a5e0f service nova] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:36:47 user nova-compute[75080]: DEBUG nova.compute.manager [req-4b5f9d57-f93b-4a40-a4f6-7a711eca40c2 req-29abf6ff-9e6f-498a-ad10-14c1297a5e0f service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] No waiting events found dispatching network-vif-plugged-dfee0a0e-5241-4d51-879d-7667bb06344b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:36:47 user nova-compute[75080]: WARNING nova.compute.manager [req-4b5f9d57-f93b-4a40-a4f6-7a711eca40c2 req-29abf6ff-9e6f-498a-ad10-14c1297a5e0f service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Received unexpected event network-vif-plugged-dfee0a0e-5241-4d51-879d-7667bb06344b for instance with vm_state stopped and task_state powering-on.
Dec 05 15:36:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json" returned: 0 in 0.413s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2482d35-2159-4605-b7af-da232886b8d3/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2482d35-2159-4605-b7af-da232886b8d3/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2482d35-2159-4605-b7af-da232886b8d3/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2482d35-2159-4605-b7af-da232886b8d3/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:47 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:36:49 user nova-compute[75080]: DEBUG nova.compute.manager [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:36:49 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:36:49 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:36:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=8184MB free_disk=24.914947509765625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:36:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:36:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:36:49 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Instance rebooted successfully.
Dec 05 15:36:49 user nova-compute[75080]: DEBUG nova.compute.manager [None req-d6fbac54-c2eb-4c61-a4f6-2ad3a39ea048 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:36:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance eedd1529-4feb-4f85-8625-0c20d8e0359d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:36:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 07b025ff-4a9d-48a2-b950-b8f2d165f33c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:36:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance ab882db7-e6d7-44ca-9ea4-ae2fa68f7929 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:36:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 011d3446-577a-4f5c-b8f0-ef04940cad17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:36:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance b47129e8-c02b-4107-af4f-329173dd453f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:36:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance a2482d35-2159-4605-b7af-da232886b8d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:36:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance b5a4b977-1e76-45c7-bf97-b4db5fb615e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:36:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance e0331194-6106-4621-ab60-94bcf681222e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:36:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 1e352b3b-ee04-42f6-af53-973c3154a342 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:36:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:36:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:36:49 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:36:49 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:36:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:36:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.631s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:36:50 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:36:50 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:36:50 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:36:50 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:36:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6021c75e-e432-45da-8523-fd4b0e176ada tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "b5a4b977-1e76-45c7-bf97-b4db5fb615e2" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:36:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6021c75e-e432-45da-8523-fd4b0e176ada tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "b5a4b977-1e76-45c7-bf97-b4db5fb615e2" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:36:50 user nova-compute[75080]: INFO nova.compute.manager [None req-6021c75e-e432-45da-8523-fd4b0e176ada tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Shelving
Dec 05 15:36:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:50 user nova-compute[75080]: DEBUG nova.compute.manager [req-4bb078e7-5d54-4810-8e78-108d4b7fbd9e req-c1247142-2b9d-49b3-b8e2-0bdd8b43210d service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Received event network-vif-unplugged-4fcca870-3cc7-4338-b912-84e32dc7d4c0 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:36:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4bb078e7-5d54-4810-8e78-108d4b7fbd9e req-c1247142-2b9d-49b3-b8e2-0bdd8b43210d service nova] Acquiring lock "b5a4b977-1e76-45c7-bf97-b4db5fb615e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:36:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4bb078e7-5d54-4810-8e78-108d4b7fbd9e req-c1247142-2b9d-49b3-b8e2-0bdd8b43210d service nova] Lock "b5a4b977-1e76-45c7-bf97-b4db5fb615e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:36:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4bb078e7-5d54-4810-8e78-108d4b7fbd9e req-c1247142-2b9d-49b3-b8e2-0bdd8b43210d service nova] Lock "b5a4b977-1e76-45c7-bf97-b4db5fb615e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:36:50 user nova-compute[75080]: DEBUG nova.compute.manager [req-4bb078e7-5d54-4810-8e78-108d4b7fbd9e req-c1247142-2b9d-49b3-b8e2-0bdd8b43210d service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] No waiting events found dispatching network-vif-unplugged-4fcca870-3cc7-4338-b912-84e32dc7d4c0 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:36:50 user nova-compute[75080]: WARNING nova.compute.manager [req-4bb078e7-5d54-4810-8e78-108d4b7fbd9e req-c1247142-2b9d-49b3-b8e2-0bdd8b43210d service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Received unexpected event network-vif-unplugged-4fcca870-3cc7-4338-b912-84e32dc7d4c0 for instance with vm_state active and task_state shelving.
Dec 05 15:36:51 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Instance destroyed successfully.
Dec 05 15:36:51 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-6021c75e-e432-45da-8523-fd4b0e176ada tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Beginning cold snapshot process
Dec 05 15:36:51 user nova-compute[75080]: DEBUG nova.privsep.utils [None req-6021c75e-e432-45da-8523-fd4b0e176ada tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75080) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 15:36:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-6021c75e-e432-45da-8523-fd4b0e176ada tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2/disk /opt/stack/data/nova/instances/snapshots/tmpsycqxtrx/738fb907f51546f3bd566dd872c3f6e4 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-6021c75e-e432-45da-8523-fd4b0e176ada tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2/disk /opt/stack/data/nova/instances/snapshots/tmpsycqxtrx/738fb907f51546f3bd566dd872c3f6e4" returned: 0 in 0.962s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:52 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-6021c75e-e432-45da-8523-fd4b0e176ada tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Snapshot extracted, beginning image upload
Dec 05 15:36:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:52 user nova-compute[75080]: DEBUG nova.compute.manager [req-bb6286fe-1d8c-4cbe-830c-a377e504b2b3 req-5c57130d-4f40-4b3c-b189-09ad1e12a72b service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Received event network-vif-plugged-4fcca870-3cc7-4338-b912-84e32dc7d4c0 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:36:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-bb6286fe-1d8c-4cbe-830c-a377e504b2b3 req-5c57130d-4f40-4b3c-b189-09ad1e12a72b service nova] Acquiring lock "b5a4b977-1e76-45c7-bf97-b4db5fb615e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:36:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-bb6286fe-1d8c-4cbe-830c-a377e504b2b3 req-5c57130d-4f40-4b3c-b189-09ad1e12a72b service nova] Lock "b5a4b977-1e76-45c7-bf97-b4db5fb615e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:36:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-bb6286fe-1d8c-4cbe-830c-a377e504b2b3 req-5c57130d-4f40-4b3c-b189-09ad1e12a72b service nova] Lock "b5a4b977-1e76-45c7-bf97-b4db5fb615e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:36:52 user nova-compute[75080]: DEBUG nova.compute.manager [req-bb6286fe-1d8c-4cbe-830c-a377e504b2b3 req-5c57130d-4f40-4b3c-b189-09ad1e12a72b service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] No waiting events found dispatching network-vif-plugged-4fcca870-3cc7-4338-b912-84e32dc7d4c0 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:36:52 user nova-compute[75080]: WARNING nova.compute.manager [req-bb6286fe-1d8c-4cbe-830c-a377e504b2b3 req-5c57130d-4f40-4b3c-b189-09ad1e12a72b service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Received unexpected event network-vif-plugged-4fcca870-3cc7-4338-b912-84e32dc7d4c0 for instance with vm_state active and task_state shelving_image_uploading.
Dec 05 15:36:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-60b4b57d-6b07-4f36-ade8-195f46e0019e tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "eedd1529-4feb-4f85-8625-0c20d8e0359d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:36:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-60b4b57d-6b07-4f36-ade8-195f46e0019e tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "eedd1529-4feb-4f85-8625-0c20d8e0359d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:36:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-60b4b57d-6b07-4f36-ade8-195f46e0019e tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "eedd1529-4feb-4f85-8625-0c20d8e0359d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:36:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-60b4b57d-6b07-4f36-ade8-195f46e0019e tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "eedd1529-4feb-4f85-8625-0c20d8e0359d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:36:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-60b4b57d-6b07-4f36-ade8-195f46e0019e tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "eedd1529-4feb-4f85-8625-0c20d8e0359d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:36:54 user nova-compute[75080]: INFO nova.compute.manager [None req-60b4b57d-6b07-4f36-ade8-195f46e0019e tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Terminating instance
Dec 05 15:36:54 user nova-compute[75080]: DEBUG nova.compute.manager [None req-60b4b57d-6b07-4f36-ade8-195f46e0019e tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:36:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:54 user nova-compute[75080]: DEBUG nova.compute.manager [req-f57225f1-42b3-4680-9947-54356bedfcb1 req-8a19ff7d-bb3f-481c-a797-23a035d79b97 service nova] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Received event network-vif-unplugged-f0094ba7-45c2-445b-bd35-d5c7aedd68bd {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:36:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f57225f1-42b3-4680-9947-54356bedfcb1 req-8a19ff7d-bb3f-481c-a797-23a035d79b97 service nova] Acquiring lock "eedd1529-4feb-4f85-8625-0c20d8e0359d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:36:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f57225f1-42b3-4680-9947-54356bedfcb1 req-8a19ff7d-bb3f-481c-a797-23a035d79b97 service nova] Lock "eedd1529-4feb-4f85-8625-0c20d8e0359d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:36:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f57225f1-42b3-4680-9947-54356bedfcb1 req-8a19ff7d-bb3f-481c-a797-23a035d79b97 service nova] Lock "eedd1529-4feb-4f85-8625-0c20d8e0359d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:36:54 user nova-compute[75080]: DEBUG nova.compute.manager [req-f57225f1-42b3-4680-9947-54356bedfcb1 req-8a19ff7d-bb3f-481c-a797-23a035d79b97 service nova] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] No waiting events found dispatching network-vif-unplugged-f0094ba7-45c2-445b-bd35-d5c7aedd68bd {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:36:54 user nova-compute[75080]: DEBUG nova.compute.manager [req-f57225f1-42b3-4680-9947-54356bedfcb1 req-8a19ff7d-bb3f-481c-a797-23a035d79b97 service nova] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Received event network-vif-unplugged-f0094ba7-45c2-445b-bd35-d5c7aedd68bd for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:36:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:54 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Instance destroyed successfully.
Dec 05 15:36:54 user nova-compute[75080]: DEBUG nova.objects.instance [None req-60b4b57d-6b07-4f36-ade8-195f46e0019e tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lazy-loading 'resources' on Instance uuid eedd1529-4feb-4f85-8625-0c20d8e0359d {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:36:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:54 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-60b4b57d-6b07-4f36-ade8-195f46e0019e tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2054899921',display_name='tempest-ServerActionsTestOtherA-server-2054899921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2054899921',id=2,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIP5nbHwDP3MaLimasQ81bdHfaI0CFiTpw2YpAxQTZDkv+5y7AL53TfAVsSe07r4BvGkQeGQdB4lyczKq+WcllL3mLq5dj12AlRuMlnnGy3kUrnJXEIK2cec4EX/PelNSA==',key_name='tempest-keypair-1219993291',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:17:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50f49255d5b74f448dc941027afbf84a',ramdisk_id='',reservation_id='r-0o6z2oq7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-393209338',owner_user_name='tempest-ServerActionsTestOtherA-393209338-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:17:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e99cb2f1c4541fd9a656e038f4afac3',uuid=eedd1529-4feb-4f85-8625-0c20d8e0359d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0094ba7-45c2-445b-bd35-d5c7aedd68bd", "address": "fa:16:3e:f9:84:93", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0094ba7-45", "ovs_interfaceid": "f0094ba7-45c2-445b-bd35-d5c7aedd68bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:36:54 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-60b4b57d-6b07-4f36-ade8-195f46e0019e tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Converting VIF {"id": "f0094ba7-45c2-445b-bd35-d5c7aedd68bd", "address": "fa:16:3e:f9:84:93", "network": {"id": "efba4a7e-3a56-41d2-8af7-4c064ba641fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-313144289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f49255d5b74f448dc941027afbf84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0094ba7-45", "ovs_interfaceid": "f0094ba7-45c2-445b-bd35-d5c7aedd68bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:36:54 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-60b4b57d-6b07-4f36-ade8-195f46e0019e tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:84:93,bridge_name='br-int',has_traffic_filtering=True,id=f0094ba7-45c2-445b-bd35-d5c7aedd68bd,network=Network(efba4a7e-3a56-41d2-8af7-4c064ba641fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0094ba7-45') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:36:54 user nova-compute[75080]: DEBUG os_vif [None req-60b4b57d-6b07-4f36-ade8-195f46e0019e tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:84:93,bridge_name='br-int',has_traffic_filtering=True,id=f0094ba7-45c2-445b-bd35-d5c7aedd68bd,network=Network(efba4a7e-3a56-41d2-8af7-4c064ba641fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0094ba7-45') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:36:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0094ba7-45, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:36:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:36:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b12f7cb-c461-4356-881e-6d046c336650) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:36:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:36:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:55 user nova-compute[75080]: INFO os_vif [None req-60b4b57d-6b07-4f36-ade8-195f46e0019e tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:84:93,bridge_name='br-int',has_traffic_filtering=True,id=f0094ba7-45c2-445b-bd35-d5c7aedd68bd,network=Network(efba4a7e-3a56-41d2-8af7-4c064ba641fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0094ba7-45')
Dec 05 15:36:55 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-60b4b57d-6b07-4f36-ade8-195f46e0019e tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Deleting instance files /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d_del
Dec 05 15:36:55 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-60b4b57d-6b07-4f36-ade8-195f46e0019e tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Deletion of /opt/stack/data/nova/instances/eedd1529-4feb-4f85-8625-0c20d8e0359d_del complete
Dec 05 15:36:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:55 user nova-compute[75080]: INFO nova.compute.manager [None req-60b4b57d-6b07-4f36-ade8-195f46e0019e tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Took 1.01 seconds to destroy the instance on the hypervisor.
Dec 05 15:36:55 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-60b4b57d-6b07-4f36-ade8-195f46e0019e tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:36:55 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:36:55 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:36:55 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-6021c75e-e432-45da-8523-fd4b0e176ada tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Snapshot image upload complete
Dec 05 15:36:55 user nova-compute[75080]: DEBUG nova.compute.manager [None req-6021c75e-e432-45da-8523-fd4b0e176ada tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:36:55 user nova-compute[75080]: INFO nova.compute.manager [None req-6021c75e-e432-45da-8523-fd4b0e176ada tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Shelve offloading
Dec 05 15:36:55 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Instance destroyed successfully.
Dec 05 15:36:55 user nova-compute[75080]: DEBUG nova.compute.manager [None req-6021c75e-e432-45da-8523-fd4b0e176ada tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:36:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6021c75e-e432-45da-8523-fd4b0e176ada tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "refresh_cache-b5a4b977-1e76-45c7-bf97-b4db5fb615e2" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:36:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6021c75e-e432-45da-8523-fd4b0e176ada tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquired lock "refresh_cache-b5a4b977-1e76-45c7-bf97-b4db5fb615e2" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:36:55 user nova-compute[75080]: DEBUG nova.network.neutron [None req-6021c75e-e432-45da-8523-fd4b0e176ada tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:36:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:55 user nova-compute[75080]: DEBUG nova.network.neutron [None req-6021c75e-e432-45da-8523-fd4b0e176ada tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Updating instance_info_cache with network_info: [{"id": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "address": "fa:16:3e:c3:a0:3b", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fcca870-3c", "ovs_interfaceid": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:36:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6021c75e-e432-45da-8523-fd4b0e176ada tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Releasing lock "refresh_cache-b5a4b977-1e76-45c7-bf97-b4db5fb615e2" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:36:56 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Took 1.02 seconds to deallocate network for instance.
Dec 05 15:36:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-60b4b57d-6b07-4f36-ade8-195f46e0019e tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-60b4b57d-6b07-4f36-ade8-195f46e0019e tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-60b4b57d-6b07-4f36-ade8-195f46e0019e tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:36:56 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Instance destroyed successfully.
Dec 05 15:36:56 user nova-compute[75080]: DEBUG nova.objects.instance [None req-6021c75e-e432-45da-8523-fd4b0e176ada tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lazy-loading 'resources' on Instance uuid b5a4b977-1e76-45c7-bf97-b4db5fb615e2 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-60b4b57d-6b07-4f36-ade8-195f46e0019e tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-6021c75e-e432-45da-8523-fd4b0e176ada tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:34:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-951113717',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-951113717',id=35,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKBO63DOhU+xhQzfzScYvd8cH7epBciaesPrZyAVqXwpkpGKTiFjE9AiOmbkLAgktbf3ya7OlNM2u5P2yMCu6Vc9LOTQMY57W9Z9bmYvYbSt+s8cBaUKdRs9xFP2gX0YQ==',key_name='tempest-keypair-331505788',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:35:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6350b8a7b0ce4af7b83a280c0c1ec3e6',ramdisk_id='',reservation_id='r-goq5cviw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-132988477',owner_user_name='tempest-AttachVolumeShelveTestJSON-132988477-project-member',shelved_at='2023-12-05T15:36:55.320477',shelved_host='user',shelved_image_id='329c8153-7c86-428d-b8f3-e65df9c45c7c'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:36:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72a1c29faca44a4095dbda09561e5a91',uuid=b5a4b977-1e76-45c7-bf97-b4db5fb615e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "address": "fa:16:3e:c3:a0:3b", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fcca870-3c", "ovs_interfaceid": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-6021c75e-e432-45da-8523-fd4b0e176ada tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Converting VIF {"id": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "address": "fa:16:3e:c3:a0:3b", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fcca870-3c", "ovs_interfaceid": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-6021c75e-e432-45da-8523-fd4b0e176ada tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a0:3b,bridge_name='br-int',has_traffic_filtering=True,id=4fcca870-3cc7-4338-b912-84e32dc7d4c0,network=Network(b94a6985-25b3-480e-b79f-b753c8b23fa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fcca870-3c') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG os_vif [None req-6021c75e-e432-45da-8523-fd4b0e176ada tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a0:3b,bridge_name='br-int',has_traffic_filtering=True,id=4fcca870-3cc7-4338-b912-84e32dc7d4c0,network=Network(b94a6985-25b3-480e-b79f-b753c8b23fa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fcca870-3c') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4fcca870-3c, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=914f3717-8d7e-4585-8914-88c76b9d7d48) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-60b4b57d-6b07-4f36-ade8-195f46e0019e tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG nova.compute.manager [req-56b9fa47-01bf-4c7d-a544-8be449a42d1b req-ab9e0b4e-a8b6-448f-9f64-c375da3906e7 service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Received event network-changed-4fcca870-3cc7-4338-b912-84e32dc7d4c0 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG nova.compute.manager [req-56b9fa47-01bf-4c7d-a544-8be449a42d1b req-ab9e0b4e-a8b6-448f-9f64-c375da3906e7 service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Refreshing instance network info cache due to event network-changed-4fcca870-3cc7-4338-b912-84e32dc7d4c0. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-56b9fa47-01bf-4c7d-a544-8be449a42d1b req-ab9e0b4e-a8b6-448f-9f64-c375da3906e7 service nova] Acquiring lock "refresh_cache-b5a4b977-1e76-45c7-bf97-b4db5fb615e2" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-56b9fa47-01bf-4c7d-a544-8be449a42d1b req-ab9e0b4e-a8b6-448f-9f64-c375da3906e7 service nova] Acquired lock "refresh_cache-b5a4b977-1e76-45c7-bf97-b4db5fb615e2" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG nova.network.neutron [req-56b9fa47-01bf-4c7d-a544-8be449a42d1b req-ab9e0b4e-a8b6-448f-9f64-c375da3906e7 service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Refreshing network info cache for port 4fcca870-3cc7-4338-b912-84e32dc7d4c0 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:36:56 user nova-compute[75080]: INFO os_vif [None req-6021c75e-e432-45da-8523-fd4b0e176ada tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a0:3b,bridge_name='br-int',has_traffic_filtering=True,id=4fcca870-3cc7-4338-b912-84e32dc7d4c0,network=Network(b94a6985-25b3-480e-b79f-b753c8b23fa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fcca870-3c')
Dec 05 15:36:56 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-6021c75e-e432-45da-8523-fd4b0e176ada tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Deleting instance files /opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2_del
Dec 05 15:36:56 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-6021c75e-e432-45da-8523-fd4b0e176ada tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Deletion of /opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2_del complete
Dec 05 15:36:56 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-60b4b57d-6b07-4f36-ade8-195f46e0019e tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Deleted allocations for instance eedd1529-4feb-4f85-8625-0c20d8e0359d
Dec 05 15:36:56 user nova-compute[75080]: DEBUG nova.compute.manager [req-d637136f-c0dd-432b-95ee-140c1cf09915 req-1eb0bd65-b07e-4883-a849-99f72d1ed059 service nova] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Received event network-vif-plugged-f0094ba7-45c2-445b-bd35-d5c7aedd68bd {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d637136f-c0dd-432b-95ee-140c1cf09915 req-1eb0bd65-b07e-4883-a849-99f72d1ed059 service nova] Acquiring lock "eedd1529-4feb-4f85-8625-0c20d8e0359d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d637136f-c0dd-432b-95ee-140c1cf09915 req-1eb0bd65-b07e-4883-a849-99f72d1ed059 service nova] Lock "eedd1529-4feb-4f85-8625-0c20d8e0359d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d637136f-c0dd-432b-95ee-140c1cf09915 req-1eb0bd65-b07e-4883-a849-99f72d1ed059 service nova] Lock "eedd1529-4feb-4f85-8625-0c20d8e0359d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG nova.compute.manager [req-d637136f-c0dd-432b-95ee-140c1cf09915 req-1eb0bd65-b07e-4883-a849-99f72d1ed059 service nova] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] No waiting events found dispatching network-vif-plugged-f0094ba7-45c2-445b-bd35-d5c7aedd68bd {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:36:56 user nova-compute[75080]: WARNING nova.compute.manager [req-d637136f-c0dd-432b-95ee-140c1cf09915 req-1eb0bd65-b07e-4883-a849-99f72d1ed059 service nova] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Received unexpected event network-vif-plugged-f0094ba7-45c2-445b-bd35-d5c7aedd68bd for instance with vm_state deleted and task_state None.
Dec 05 15:36:56 user nova-compute[75080]: DEBUG nova.compute.manager [req-d637136f-c0dd-432b-95ee-140c1cf09915 req-1eb0bd65-b07e-4883-a849-99f72d1ed059 service nova] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Received event network-vif-plugged-f0094ba7-45c2-445b-bd35-d5c7aedd68bd {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d637136f-c0dd-432b-95ee-140c1cf09915 req-1eb0bd65-b07e-4883-a849-99f72d1ed059 service nova] Acquiring lock "eedd1529-4feb-4f85-8625-0c20d8e0359d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d637136f-c0dd-432b-95ee-140c1cf09915 req-1eb0bd65-b07e-4883-a849-99f72d1ed059 service nova] Lock "eedd1529-4feb-4f85-8625-0c20d8e0359d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d637136f-c0dd-432b-95ee-140c1cf09915 req-1eb0bd65-b07e-4883-a849-99f72d1ed059 service nova] Lock "eedd1529-4feb-4f85-8625-0c20d8e0359d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG nova.compute.manager [req-d637136f-c0dd-432b-95ee-140c1cf09915 req-1eb0bd65-b07e-4883-a849-99f72d1ed059 service nova] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] No waiting events found dispatching network-vif-plugged-f0094ba7-45c2-445b-bd35-d5c7aedd68bd {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:36:56 user nova-compute[75080]: WARNING nova.compute.manager [req-d637136f-c0dd-432b-95ee-140c1cf09915 req-1eb0bd65-b07e-4883-a849-99f72d1ed059 service nova] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Received unexpected event network-vif-plugged-f0094ba7-45c2-445b-bd35-d5c7aedd68bd for instance with vm_state deleted and task_state None.
Dec 05 15:36:56 user nova-compute[75080]: DEBUG nova.compute.manager [req-d637136f-c0dd-432b-95ee-140c1cf09915 req-1eb0bd65-b07e-4883-a849-99f72d1ed059 service nova] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Received event network-vif-plugged-f0094ba7-45c2-445b-bd35-d5c7aedd68bd {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d637136f-c0dd-432b-95ee-140c1cf09915 req-1eb0bd65-b07e-4883-a849-99f72d1ed059 service nova] Acquiring lock "eedd1529-4feb-4f85-8625-0c20d8e0359d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d637136f-c0dd-432b-95ee-140c1cf09915 req-1eb0bd65-b07e-4883-a849-99f72d1ed059 service nova] Lock "eedd1529-4feb-4f85-8625-0c20d8e0359d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.011s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d637136f-c0dd-432b-95ee-140c1cf09915 req-1eb0bd65-b07e-4883-a849-99f72d1ed059 service nova] Lock "eedd1529-4feb-4f85-8625-0c20d8e0359d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG nova.compute.manager [req-d637136f-c0dd-432b-95ee-140c1cf09915 req-1eb0bd65-b07e-4883-a849-99f72d1ed059 service nova] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] No waiting events found dispatching network-vif-plugged-f0094ba7-45c2-445b-bd35-d5c7aedd68bd {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:36:56 user nova-compute[75080]: WARNING nova.compute.manager [req-d637136f-c0dd-432b-95ee-140c1cf09915 req-1eb0bd65-b07e-4883-a849-99f72d1ed059 service nova] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Received unexpected event network-vif-plugged-f0094ba7-45c2-445b-bd35-d5c7aedd68bd for instance with vm_state deleted and task_state None.
Dec 05 15:36:56 user nova-compute[75080]: DEBUG nova.compute.manager [req-d637136f-c0dd-432b-95ee-140c1cf09915 req-1eb0bd65-b07e-4883-a849-99f72d1ed059 service nova] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Received event network-vif-plugged-f0094ba7-45c2-445b-bd35-d5c7aedd68bd {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d637136f-c0dd-432b-95ee-140c1cf09915 req-1eb0bd65-b07e-4883-a849-99f72d1ed059 service nova] Acquiring lock "eedd1529-4feb-4f85-8625-0c20d8e0359d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d637136f-c0dd-432b-95ee-140c1cf09915 req-1eb0bd65-b07e-4883-a849-99f72d1ed059 service nova] Lock "eedd1529-4feb-4f85-8625-0c20d8e0359d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d637136f-c0dd-432b-95ee-140c1cf09915 req-1eb0bd65-b07e-4883-a849-99f72d1ed059 service nova] Lock "eedd1529-4feb-4f85-8625-0c20d8e0359d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG nova.compute.manager [req-d637136f-c0dd-432b-95ee-140c1cf09915 req-1eb0bd65-b07e-4883-a849-99f72d1ed059 service nova] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] No waiting events found dispatching network-vif-plugged-f0094ba7-45c2-445b-bd35-d5c7aedd68bd {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:36:56 user nova-compute[75080]: WARNING nova.compute.manager [req-d637136f-c0dd-432b-95ee-140c1cf09915 req-1eb0bd65-b07e-4883-a849-99f72d1ed059 service nova] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Received unexpected event network-vif-plugged-f0094ba7-45c2-445b-bd35-d5c7aedd68bd for instance with vm_state deleted and task_state None.
Dec 05 15:36:56 user nova-compute[75080]: DEBUG nova.compute.manager [req-d637136f-c0dd-432b-95ee-140c1cf09915 req-1eb0bd65-b07e-4883-a849-99f72d1ed059 service nova] [instance: eedd1529-4feb-4f85-8625-0c20d8e0359d] Received event network-vif-deleted-f0094ba7-45c2-445b-bd35-d5c7aedd68bd {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-60b4b57d-6b07-4f36-ade8-195f46e0019e tempest-ServerActionsTestOtherA-393209338 tempest-ServerActionsTestOtherA-393209338-project-member] Lock "eedd1529-4feb-4f85-8625-0c20d8e0359d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.640s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:36:56 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-6021c75e-e432-45da-8523-fd4b0e176ada tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Deleted allocations for instance b5a4b977-1e76-45c7-bf97-b4db5fb615e2
Dec 05 15:36:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6021c75e-e432-45da-8523-fd4b0e176ada tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6021c75e-e432-45da-8523-fd4b0e176ada tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG nova.objects.instance [None req-6021c75e-e432-45da-8523-fd4b0e176ada tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lazy-loading 'numa_topology' on Instance uuid b5a4b977-1e76-45c7-bf97-b4db5fb615e2 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:36:56 user nova-compute[75080]: DEBUG nova.objects.base [None req-6021c75e-e432-45da-8523-fd4b0e176ada tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Object Instance<b5a4b977-1e76-45c7-bf97-b4db5fb615e2> lazy-loaded attributes: resources,numa_topology {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:36:57 user nova-compute[75080]: DEBUG nova.network.neutron [req-56b9fa47-01bf-4c7d-a544-8be449a42d1b req-ab9e0b4e-a8b6-448f-9f64-c375da3906e7 service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Updated VIF entry in instance network info cache for port 4fcca870-3cc7-4338-b912-84e32dc7d4c0. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:36:57 user nova-compute[75080]: DEBUG nova.network.neutron [req-56b9fa47-01bf-4c7d-a544-8be449a42d1b req-ab9e0b4e-a8b6-448f-9f64-c375da3906e7 service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Updating instance_info_cache with network_info: [{"id": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "address": "fa:16:3e:c3:a0:3b", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap4fcca870-3c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:36:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-56b9fa47-01bf-4c7d-a544-8be449a42d1b req-ab9e0b4e-a8b6-448f-9f64-c375da3906e7 service nova] Releasing lock "refresh_cache-b5a4b977-1e76-45c7-bf97-b4db5fb615e2" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:36:57 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-6021c75e-e432-45da-8523-fd4b0e176ada tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:36:57 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-6021c75e-e432-45da-8523-fd4b0e176ada tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:36:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6021c75e-e432-45da-8523-fd4b0e176ada tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.419s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:36:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6021c75e-e432-45da-8523-fd4b0e176ada tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "b5a4b977-1e76-45c7-bf97-b4db5fb615e2" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.048s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:36:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:58 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-5a3ccb0b-8b5b-4f50-8548-84dbe0a2c891 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a2482d35-2159-4605-b7af-da232886b8d3 is timed out.
Dec 05 15:36:58 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-5a3ccb0b-8b5b-4f50-8548-84dbe0a2c891 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Successfully detached device vdb from instance a2482d35-2159-4605-b7af-da232886b8d3 from the live domain config.
Dec 05 15:36:58 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a3ccb0b-8b5b-4f50-8548-84dbe0a2c891 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3ccb0b-8b5b-4f50-8548-84dbe0a2c891 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dmUthAzY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:36:58 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-5a3ccb0b-8b5b-4f50-8548-84dbe0a2c891 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:36:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-5a3ccb0b-8b5b-4f50-8548-84dbe0a2c891 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-5a3ccb0b-8b5b-4f50-8548-84dbe0a2c891 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.007s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9766947-8b4f-44ae-b1fa-e2accc654429]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3ccb0b-8b5b-4f50-8548-84dbe0a2c891 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:36:58 user nova-compute[75080]: No targets found.
Dec 05 15:36:58 user nova-compute[75080]: iSNS:
Dec 05 15:36:58 user nova-compute[75080]: No targets found.
Dec 05 15:36:58 user nova-compute[75080]: STATIC:
Dec 05 15:36:58 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399
Dec 05 15:36:58 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:36:58 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:36:58 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25
Dec 05 15:36:58 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:36:58 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:36:58 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14
Dec 05 15:36:58 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:36:58 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:36:58 user nova-compute[75080]: FIRMWARE:
Dec 05 15:36:58 user nova-compute[75080]: No targets found.
Dec 05 15:36:58 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3ccb0b-8b5b-4f50-8548-84dbe0a2c891 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:36:58 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:36:58 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3ccb0b-8b5b-4f50-8548-84dbe0a2c891 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7b5288-ed19-4961-9413-4e7f40b461fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[45054312-b52a-43b6-9472-f8f528375088]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3ccb0b-8b5b-4f50-8548-84dbe0a2c891 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:36:58 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:36:58 user nova-compute[75080]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25 (non-flash)
Dec 05 15:36:58 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3ccb0b-8b5b-4f50-8548-84dbe0a2c891 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:36:58 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:36:58 user nova-compute[75080]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25 (non-flash)
Dec 05 15:36:58 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3ccb0b-8b5b-4f50-8548-84dbe0a2c891 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f665c345510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25'): ({'sdc'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-5a3ccb0b-8b5b-4f50-8548-84dbe0a2c891 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Removing single pathed devices sdc {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad435aa-2474-47dd-ad17-63078697c150]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d3480b-b1e0-480a-9767-bd999b41f46b]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-5a3ccb0b-8b5b-4f50-8548-84dbe0a2c891 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Flushing IO for device /dev/sdc {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5250d5c-e577-4bc9-9649-003ae5355345]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-5a3ccb0b-8b5b-4f50-8548-84dbe0a2c891 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b618e809-a6ef-40ab-9530-6408e84bb1fc]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-5a3ccb0b-8b5b-4f50-8548-84dbe0a2c891 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-5a3ccb0b-8b5b-4f50-8548-84dbe0a2c891 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] SCSI volumes sdc have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3ccb0b-8b5b-4f50-8548-84dbe0a2c891 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1c246a-0570-4f8f-916a-786c11203a11]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3ccb0b-8b5b-4f50-8548-84dbe0a2c891 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25 -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97d1ccc-92f5-4ef0-9473-cd121612d629]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3ccb0b-8b5b-4f50-8548-84dbe0a2c891 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25, portal: 172.16.0.220,3260]
Dec 05 15:36:58 user nova-compute[75080]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25, portal: 172.16.0.220,3260] successful.
Dec 05 15:36:58 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25 -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[59388aa7-2825-472a-a182-432d02f7aef6]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3ccb0b-8b5b-4f50-8548-84dbe0a2c891 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-5a3ccb0b-8b5b-4f50-8548-84dbe0a2c891 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3ccb0b-8b5b-4f50-8548-84dbe0a2c891 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] <== disconnect_volume: return (342ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:36:58 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a3ccb0b-8b5b-4f50-8548-84dbe0a2c891 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:36:59 user nova-compute[75080]: DEBUG nova.objects.instance [None req-5a3ccb0b-8b5b-4f50-8548-84dbe0a2c891 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lazy-loading 'flavor' on Instance uuid a2482d35-2159-4605-b7af-da232886b8d3 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:36:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5a3ccb0b-8b5b-4f50-8548-84dbe0a2c891 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "a2482d35-2159-4605-b7af-da232886b8d3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.937s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:36:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "a2482d35-2159-4605-b7af-da232886b8d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.823s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:36:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Acquiring lock "a2482d35-2159-4605-b7af-da232886b8d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:36:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "a2482d35-2159-4605-b7af-da232886b8d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:36:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "a2482d35-2159-4605-b7af-da232886b8d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:36:59 user nova-compute[75080]: INFO nova.compute.manager [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Terminating instance
Dec 05 15:36:59 user nova-compute[75080]: DEBUG nova.compute.manager [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:36:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:36:59 user nova-compute[75080]: DEBUG nova.compute.manager [req-5b08a58f-43cd-4f63-96e5-58781fdbcd85 req-c84c4c8e-bfaa-4e6e-975b-6f17298ad3a8 service nova] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Received event network-vif-unplugged-a92f7043-98a8-4f4e-be46-45fc5cc4778d {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:36:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5b08a58f-43cd-4f63-96e5-58781fdbcd85 req-c84c4c8e-bfaa-4e6e-975b-6f17298ad3a8 service nova] Acquiring lock "a2482d35-2159-4605-b7af-da232886b8d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:36:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5b08a58f-43cd-4f63-96e5-58781fdbcd85 req-c84c4c8e-bfaa-4e6e-975b-6f17298ad3a8 service nova] Lock "a2482d35-2159-4605-b7af-da232886b8d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:36:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5b08a58f-43cd-4f63-96e5-58781fdbcd85 req-c84c4c8e-bfaa-4e6e-975b-6f17298ad3a8 service nova] Lock "a2482d35-2159-4605-b7af-da232886b8d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:36:59 user nova-compute[75080]: DEBUG nova.compute.manager [req-5b08a58f-43cd-4f63-96e5-58781fdbcd85 req-c84c4c8e-bfaa-4e6e-975b-6f17298ad3a8 service nova] [instance: a2482d35-2159-4605-b7af-da232886b8d3] No waiting events found dispatching network-vif-unplugged-a92f7043-98a8-4f4e-be46-45fc5cc4778d {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:36:59 user nova-compute[75080]: DEBUG nova.compute.manager [req-5b08a58f-43cd-4f63-96e5-58781fdbcd85 req-c84c4c8e-bfaa-4e6e-975b-6f17298ad3a8 service nova] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Received event network-vif-unplugged-a92f7043-98a8-4f4e-be46-45fc5cc4778d for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:37:00 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Instance destroyed successfully.
Dec 05 15:37:00 user nova-compute[75080]: DEBUG nova.objects.instance [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lazy-loading 'resources' on Instance uuid a2482d35-2159-4605-b7af-da232886b8d3 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:37:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:34:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1324524137',display_name='tempest-VolumesSnapshotTestJSON-instance-1324524137',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1324524137',id=34,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGulSmPsFCYlCumm8tBYOY8xbuZacLyInhaBVPorBEE+fURQDCzANEOHxo2Ocla5UEfvNOeZ+dlKCTS9kMCop/2fwlokJE+RCbft7p3lVYHCNLwVZxj60pTm9KrDxNKTtw==',key_name='tempest-keypair-1151776581',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:34:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e8a1b1f1ed346949ac0f633ae7e530b',ramdisk_id='',reservation_id='r-zm90okej',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1567075546',owner_user_name='tempest-VolumesSnapshotTestJSON-1567075546-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:34:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='025ecd26509b46b8b0157d0abe16eec8',uuid=a2482d35-2159-4605-b7af-da232886b8d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a92f7043-98a8-4f4e-be46-45fc5cc4778d", "address": "fa:16:3e:11:21:2b", "network": {"id": "eb187ccd-700a-49df-881f-c61d4b90e612", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053782949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e8a1b1f1ed346949ac0f633ae7e530b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa92f7043-98", "ovs_interfaceid": "a92f7043-98a8-4f4e-be46-45fc5cc4778d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:37:00 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Converting VIF {"id": "a92f7043-98a8-4f4e-be46-45fc5cc4778d", "address": "fa:16:3e:11:21:2b", "network": {"id": "eb187ccd-700a-49df-881f-c61d4b90e612", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053782949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e8a1b1f1ed346949ac0f633ae7e530b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa92f7043-98", "ovs_interfaceid": "a92f7043-98a8-4f4e-be46-45fc5cc4778d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:37:00 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:21:2b,bridge_name='br-int',has_traffic_filtering=True,id=a92f7043-98a8-4f4e-be46-45fc5cc4778d,network=Network(eb187ccd-700a-49df-881f-c61d4b90e612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa92f7043-98') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:37:00 user nova-compute[75080]: DEBUG os_vif [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:21:2b,bridge_name='br-int',has_traffic_filtering=True,id=a92f7043-98a8-4f4e-be46-45fc5cc4778d,network=Network(eb187ccd-700a-49df-881f-c61d4b90e612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa92f7043-98') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:37:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa92f7043-98, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:37:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:37:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ecb4f5b0-e025-400d-9cb3-8cb11a9bbd47) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:37:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:00 user nova-compute[75080]: INFO os_vif [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:21:2b,bridge_name='br-int',has_traffic_filtering=True,id=a92f7043-98a8-4f4e-be46-45fc5cc4778d,network=Network(eb187ccd-700a-49df-881f-c61d4b90e612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa92f7043-98')
Dec 05 15:37:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:37:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dmUthAzY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:37:00 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:37:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:37:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:37:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:37:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:37:00 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24e2b72-2223-472b-8518-46381e4ea729]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:37:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:37:00 user nova-compute[75080]: No targets found.
Dec 05 15:37:00 user nova-compute[75080]: iSNS:
Dec 05 15:37:00 user nova-compute[75080]: No targets found.
Dec 05 15:37:00 user nova-compute[75080]: STATIC:
Dec 05 15:37:00 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399
Dec 05 15:37:00 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:37:00 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:37:00 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14
Dec 05 15:37:00 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:37:00 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:37:00 user nova-compute[75080]: FIRMWARE:
Dec 05 15:37:00 user nova-compute[75080]: No targets found.
Dec 05 15:37:00 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:37:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:37:00 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:37:00 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:37:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7971cee5-0385-4740-b5df-bc2eadd67b25', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:37:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:37:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:37:00 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcaab8a-aa75-40e4-a6fc-93e352156be0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:37:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:37:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:37:00 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fd3604-34b6-449f-9721-24bb88caa122]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:37:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:37:00 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:37:00 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:37:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:37:00 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:37:00 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:37:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6638315000>, {}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:37:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Disconnecting from: [] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:37:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:37:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] <== disconnect_volume: return (75ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:37:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:37:00 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Deleting instance files /opt/stack/data/nova/instances/a2482d35-2159-4605-b7af-da232886b8d3_del
Dec 05 15:37:00 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Deletion of /opt/stack/data/nova/instances/a2482d35-2159-4605-b7af-da232886b8d3_del complete
Dec 05 15:37:00 user nova-compute[75080]: INFO nova.compute.manager [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Took 1.05 seconds to destroy the instance on the hypervisor.
Dec 05 15:37:00 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:37:00 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:37:00 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: a2482d35-2159-4605-b7af-da232886b8d3] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:37:01 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:37:01 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Took 0.88 seconds to deallocate network for instance.
Dec 05 15:37:01 user nova-compute[75080]: WARNING nova.volume.cinder [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Attachment 78f807f2-624b-4bba-99e0-0b533eb8b678 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 78f807f2-624b-4bba-99e0-0b533eb8b678. (HTTP 404) (Request-ID: req-afdf63c7-d232-4569-8164-be65185f7962)
Dec 05 15:37:01 user nova-compute[75080]: INFO nova.compute.manager [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Took 0.03 seconds to detach 1 volumes for instance.
Dec 05 15:37:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:37:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:37:01 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:37:01 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:37:01 user nova-compute[75080]: INFO nova.compute.manager [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Rescuing
Dec 05 15:37:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "refresh_cache-e0331194-6106-4621-ab60-94bcf681222e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:37:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquired lock "refresh_cache-e0331194-6106-4621-ab60-94bcf681222e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:37:01 user nova-compute[75080]: DEBUG nova.network.neutron [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:37:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.316s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:37:01 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Deleted allocations for instance a2482d35-2159-4605-b7af-da232886b8d3
Dec 05 15:37:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ce0446eb-b2e2-4cb9-a319-eb23b741d1cc tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "a2482d35-2159-4605-b7af-da232886b8d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.510s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:37:02 user nova-compute[75080]: DEBUG nova.compute.manager [req-ebe4afbc-e968-4c24-856f-7ded3d6d6349 req-b62b2db3-5d3f-436a-994d-6a4d7191bdf6 service nova] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Received event network-vif-plugged-a92f7043-98a8-4f4e-be46-45fc5cc4778d {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:37:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-ebe4afbc-e968-4c24-856f-7ded3d6d6349 req-b62b2db3-5d3f-436a-994d-6a4d7191bdf6 service nova] Acquiring lock "a2482d35-2159-4605-b7af-da232886b8d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:37:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-ebe4afbc-e968-4c24-856f-7ded3d6d6349 req-b62b2db3-5d3f-436a-994d-6a4d7191bdf6 service nova] Lock "a2482d35-2159-4605-b7af-da232886b8d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:37:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-ebe4afbc-e968-4c24-856f-7ded3d6d6349 req-b62b2db3-5d3f-436a-994d-6a4d7191bdf6 service nova] Lock "a2482d35-2159-4605-b7af-da232886b8d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:37:02 user nova-compute[75080]: DEBUG nova.compute.manager [req-ebe4afbc-e968-4c24-856f-7ded3d6d6349 req-b62b2db3-5d3f-436a-994d-6a4d7191bdf6 service nova] [instance: a2482d35-2159-4605-b7af-da232886b8d3] No waiting events found dispatching network-vif-plugged-a92f7043-98a8-4f4e-be46-45fc5cc4778d {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:37:02 user nova-compute[75080]: WARNING nova.compute.manager [req-ebe4afbc-e968-4c24-856f-7ded3d6d6349 req-b62b2db3-5d3f-436a-994d-6a4d7191bdf6 service nova] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Received unexpected event network-vif-plugged-a92f7043-98a8-4f4e-be46-45fc5cc4778d for instance with vm_state deleted and task_state None.
Dec 05 15:37:02 user nova-compute[75080]: DEBUG nova.compute.manager [req-ebe4afbc-e968-4c24-856f-7ded3d6d6349 req-b62b2db3-5d3f-436a-994d-6a4d7191bdf6 service nova] [instance: a2482d35-2159-4605-b7af-da232886b8d3] Received event network-vif-deleted-a92f7043-98a8-4f4e-be46-45fc5cc4778d {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:37:02 user nova-compute[75080]: DEBUG nova.network.neutron [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Updating instance_info_cache with network_info: [{"id": "12153aa9-8336-46dc-8491-6c28da3646a3", "address": "fa:16:3e:0d:84:cd", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12153aa9-83", "ovs_interfaceid": "12153aa9-8336-46dc-8491-6c28da3646a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:37:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Releasing lock "refresh_cache-e0331194-6106-4621-ab60-94bcf681222e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:37:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:03 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: e0331194-6106-4621-ab60-94bcf681222e] Instance destroyed successfully.
Dec 05 15:37:03 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Attempting a stable device rescue
Dec 05 15:37:03 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75080) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 05 15:37:03 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Instance directory exists: not creating {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 05 15:37:03 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Creating image(s)
Dec 05 15:37:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "/opt/stack/data/nova/instances/e0331194-6106-4621-ab60-94bcf681222e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:37:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "/opt/stack/data/nova/instances/e0331194-6106-4621-ab60-94bcf681222e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:37:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "/opt/stack/data/nova/instances/e0331194-6106-4621-ab60-94bcf681222e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:37:03 user nova-compute[75080]: DEBUG nova.objects.instance [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lazy-loading 'trusted_certs' on Instance uuid e0331194-6106-4621-ab60-94bcf681222e {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:37:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "da6ea48d427fd5057b2c2ccf2b1b00b8b2b0d5e0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:37:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "da6ea48d427fd5057b2c2ccf2b1b00b8b2b0d5e0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:37:04 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da6ea48d427fd5057b2c2ccf2b1b00b8b2b0d5e0.part --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:37:04 user nova-compute[75080]: DEBUG nova.compute.manager [req-f6003719-b650-4b5c-94ad-d647c38e0efd req-04e53ef6-d1c4-4c81-9c02-13e9bdf1b963 service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] Received event network-vif-unplugged-12153aa9-8336-46dc-8491-6c28da3646a3 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:37:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f6003719-b650-4b5c-94ad-d647c38e0efd req-04e53ef6-d1c4-4c81-9c02-13e9bdf1b963 service nova] Acquiring lock "e0331194-6106-4621-ab60-94bcf681222e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:37:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f6003719-b650-4b5c-94ad-d647c38e0efd req-04e53ef6-d1c4-4c81-9c02-13e9bdf1b963 service nova] Lock "e0331194-6106-4621-ab60-94bcf681222e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:37:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f6003719-b650-4b5c-94ad-d647c38e0efd req-04e53ef6-d1c4-4c81-9c02-13e9bdf1b963 service nova] Lock "e0331194-6106-4621-ab60-94bcf681222e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:37:04 user nova-compute[75080]: DEBUG nova.compute.manager [req-f6003719-b650-4b5c-94ad-d647c38e0efd req-04e53ef6-d1c4-4c81-9c02-13e9bdf1b963 service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] No waiting events found dispatching network-vif-unplugged-12153aa9-8336-46dc-8491-6c28da3646a3 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:37:04 user nova-compute[75080]: WARNING nova.compute.manager [req-f6003719-b650-4b5c-94ad-d647c38e0efd req-04e53ef6-d1c4-4c81-9c02-13e9bdf1b963 service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] Received unexpected event network-vif-unplugged-12153aa9-8336-46dc-8491-6c28da3646a3 for instance with vm_state active and task_state rescuing.
Dec 05 15:37:04 user nova-compute[75080]: DEBUG nova.compute.manager [req-f6003719-b650-4b5c-94ad-d647c38e0efd req-04e53ef6-d1c4-4c81-9c02-13e9bdf1b963 service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] Received event network-vif-plugged-12153aa9-8336-46dc-8491-6c28da3646a3 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:37:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f6003719-b650-4b5c-94ad-d647c38e0efd req-04e53ef6-d1c4-4c81-9c02-13e9bdf1b963 service nova] Acquiring lock "e0331194-6106-4621-ab60-94bcf681222e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:37:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f6003719-b650-4b5c-94ad-d647c38e0efd req-04e53ef6-d1c4-4c81-9c02-13e9bdf1b963 service nova] Lock "e0331194-6106-4621-ab60-94bcf681222e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:37:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f6003719-b650-4b5c-94ad-d647c38e0efd req-04e53ef6-d1c4-4c81-9c02-13e9bdf1b963 service nova] Lock "e0331194-6106-4621-ab60-94bcf681222e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:37:04 user nova-compute[75080]: DEBUG nova.compute.manager [req-f6003719-b650-4b5c-94ad-d647c38e0efd req-04e53ef6-d1c4-4c81-9c02-13e9bdf1b963 service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] No waiting events found dispatching network-vif-plugged-12153aa9-8336-46dc-8491-6c28da3646a3 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:37:04 user nova-compute[75080]: WARNING nova.compute.manager [req-f6003719-b650-4b5c-94ad-d647c38e0efd req-04e53ef6-d1c4-4c81-9c02-13e9bdf1b963 service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] Received unexpected event network-vif-plugged-12153aa9-8336-46dc-8491-6c28da3646a3 for instance with vm_state active and task_state rescuing.
Dec 05 15:37:04 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da6ea48d427fd5057b2c2ccf2b1b00b8b2b0d5e0.part --force-share --output=json" returned: 0 in 0.218s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:37:04 user nova-compute[75080]: DEBUG nova.virt.images [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] da8767e3-fdc1-4a24-940c-f4f5a1287bbf was qcow2, converting to raw {{(pid=75080) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 05 15:37:04 user nova-compute[75080]: DEBUG nova.privsep.utils [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75080) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 15:37:04 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/da6ea48d427fd5057b2c2ccf2b1b00b8b2b0d5e0.part /opt/stack/data/nova/instances/_base/da6ea48d427fd5057b2c2ccf2b1b00b8b2b0d5e0.converted {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:37:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/da6ea48d427fd5057b2c2ccf2b1b00b8b2b0d5e0.part /opt/stack/data/nova/instances/_base/da6ea48d427fd5057b2c2ccf2b1b00b8b2b0d5e0.converted" returned: 0 in 0.566s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:37:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da6ea48d427fd5057b2c2ccf2b1b00b8b2b0d5e0.converted --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:37:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da6ea48d427fd5057b2c2ccf2b1b00b8b2b0d5e0.converted --force-share --output=json" returned: 0 in 0.236s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:37:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "da6ea48d427fd5057b2c2ccf2b1b00b8b2b0d5e0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.229s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:37:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "da6ea48d427fd5057b2c2ccf2b1b00b8b2b0d5e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:37:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "da6ea48d427fd5057b2c2ccf2b1b00b8b2b0d5e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:37:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da6ea48d427fd5057b2c2ccf2b1b00b8b2b0d5e0 --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:37:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da6ea48d427fd5057b2c2ccf2b1b00b8b2b0d5e0 --force-share --output=json" returned: 0 in 0.270s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:37:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da6ea48d427fd5057b2c2ccf2b1b00b8b2b0d5e0,backing_fmt=raw /opt/stack/data/nova/instances/e0331194-6106-4621-ab60-94bcf681222e/disk.rescue {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:37:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da6ea48d427fd5057b2c2ccf2b1b00b8b2b0d5e0,backing_fmt=raw /opt/stack/data/nova/instances/e0331194-6106-4621-ab60-94bcf681222e/disk.rescue" returned: 0 in 0.131s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:37:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "da6ea48d427fd5057b2c2ccf2b1b00b8b2b0d5e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.410s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:37:05 user nova-compute[75080]: DEBUG nova.objects.instance [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lazy-loading 'migration_context' on Instance uuid e0331194-6106-4621-ab60-94bcf681222e {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:37:05 user nova-compute[75080]: DEBUG nova.objects.base [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Object Instance<e0331194-6106-4621-ab60-94bcf681222e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:37:05 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:37:05 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Start _get_guest_xml network_info=[{"id": "12153aa9-8336-46dc-8491-6c28da3646a3", "address": "fa:16:3e:0d:84:cd", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "vif_mac": "fa:16:3e:0d:84:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12153aa9-83", "ovs_interfaceid": "12153aa9-8336-46dc-8491-6c28da3646a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'da8767e3-fdc1-4a24-940c-f4f5a1287bbf', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ySIZWThQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'e0331194-6106-4621-ab60-94bcf681222e', 'attached_at': '', 'detached_at': '', 'volume_id': '127a183f-56a0-46a7-b282-3478ffda6e14', 'serial': '127a183f-56a0-46a7-b282-3478ffda6e14'}, 'device_type': 'disk', 'attachment_id': '40cc1a50-44e2-4114-b5eb-df5a3d8f7196', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:37:05 user nova-compute[75080]: DEBUG nova.objects.instance [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lazy-loading 'resources' on Instance uuid e0331194-6106-4621-ab60-94bcf681222e {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:37:05 user nova-compute[75080]: DEBUG nova.objects.base [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Object Instance<e0331194-6106-4621-ab60-94bcf681222e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:37:05 user nova-compute[75080]: DEBUG nova.objects.instance [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lazy-loading 'numa_topology' on Instance uuid e0331194-6106-4621-ab60-94bcf681222e {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:37:05 user nova-compute[75080]: DEBUG nova.objects.base [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Object Instance<e0331194-6106-4621-ab60-94bcf681222e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:37:05 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:37:05 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:37:06 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG nova.objects.instance [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lazy-loading 'vcpu_model' on Instance uuid e0331194-6106-4621-ab60-94bcf681222e {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG nova.objects.base [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Object Instance<e0331194-6106-4621-ab60-94bcf681222e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ySIZWThQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:37:06 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:37:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:37:06 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:37:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:37:06 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:37:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f7d97a-f702-4008-afd4-367da8609dfa]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ySIZWThQ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Dec 05 15:37:06 user nova-compute[75080]: node.name = iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14
Dec 05 15:37:06 user nova-compute[75080]: node.tpgt = -1
Dec 05 15:37:06 user nova-compute[75080]: node.startup = automatic
Dec 05 15:37:06 user nova-compute[75080]: node.leading_login = No
Dec 05 15:37:06 user nova-compute[75080]: iface.iscsi_ifacename = default
Dec 05 15:37:06 user nova-compute[75080]: iface.net_ifacename = <empty>
Dec 05 15:37:06 user nova-compute[75080]: iface.ipaddress = <empty>
Dec 05 15:37:06 user nova-compute[75080]: iface.prefix_len = 0
Dec 05 15:37:06 user nova-compute[75080]: iface.hwaddress = <empty>
Dec 05 15:37:06 user nova-compute[75080]: iface.transport_name = tcp
Dec 05 15:37:06 user nova-compute[75080]: iface.initiatorname = <empty>
Dec 05 15:37:06 user nova-compute[75080]: iface.state = <empty>
Dec 05 15:37:06 user nova-compute[75080]: iface.vlan_id = 0
Dec 05 15:37:06 user nova-compute[75080]: iface.vlan_priority = 0
Dec 05 15:37:06 user nova-compute[75080]: iface.vlan_state = <empty>
Dec 05 15:37:06 user nova-compute[75080]: iface.iface_num = 0
Dec 05 15:37:06 user nova-compute[75080]: iface.mtu = 0
Dec 05 15:37:06 user nova-compute[75080]: iface.port = 0
Dec 05 15:37:06 user nova-compute[75080]: iface.bootproto = <empty>
Dec 05 15:37:06 user nova-compute[75080]: iface.subnet_mask = <empty>
Dec 05 15:37:06 user nova-compute[75080]: iface.gateway = <empty>
Dec 05 15:37:06 user nova-compute[75080]: iface.dhcp_alt_client_id_state = <empty>
Dec 05 15:37:06 user nova-compute[75080]: iface.dhcp_alt_client_id = <empty>
Dec 05 15:37:06 user nova-compute[75080]: iface.dhcp_dns = <empty>
Dec 05 15:37:06 user nova-compute[75080]: iface.dhcp_learn_iqn = <empty>
Dec 05 15:37:06 user nova-compute[75080]: iface.dhcp_req_vendor_id_state = <empty>
Dec 05 15:37:06 user nova-compute[75080]: iface.dhcp_vendor_id_state = <empty>
Dec 05 15:37:06 user nova-compute[75080]: iface.dhcp_vendor_id = <empty>
Dec 05 15:37:06 user nova-compute[75080]: iface.dhcp_slp_da = <empty>
Dec 05 15:37:06 user nova-compute[75080]: iface.fragmentation = <empty>
Dec 05 15:37:06 user nova-compute[75080]: iface.gratuitous_arp = <empty>
Dec 05 15:37:06 user nova-compute[75080]: iface.incoming_forwarding = <empty>
Dec 05 15:37:06 user nova-compute[75080]: iface.tos_state = <empty>
Dec 05 15:37:06 user nova-compute[75080]: iface.tos = 0
Dec 05 15:37:06 user nova-compute[75080]: iface.ttl = 0
Dec 05 15:37:06 user nova-compute[75080]: iface.delayed_ack = <empty>
Dec 05 15:37:06 user nova-compute[75080]: iface.tcp_nagle = <empty>
Dec 05 15:37:06 user nova-compute[75080]: iface.tcp_wsf_state = <empty>
Dec 05 15:37:06 user nova-compute[75080]: iface.tcp_wsf = 0
Dec 05 15:37:06 user nova-compute[75080]: iface.tcp_timer_scale = 0
Dec 05 15:37:06 user nova-compute[75080]: iface.tcp_timestamp = <empty>
Dec 05 15:37:06 user nova-compute[75080]: iface.redirect = <empty>
Dec 05 15:37:06 user nova-compute[75080]: iface.def_task_mgmt_timeout = 0
Dec 05 15:37:06 user nova-compute[75080]: iface.header_digest = <empty>
Dec 05 15:37:06 user nova-compute[75080]: iface.data_digest = <empty>
Dec 05 15:37:06 user nova-compute[75080]: iface.immediate_data = <empty>
Dec 05 15:37:06 user nova-compute[75080]: iface.initial_r2t = <empty>
Dec 05 15:37:06 user nova-compute[75080]: iface.data_seq_inorder = <empty>
Dec 05 15:37:06 user nova-compute[75080]: iface.data_pdu_inorder = <empty>
Dec 05 15:37:06 user nova-compute[75080]: iface.erl = 0
Dec 05 15:37:06 user nova-compute[75080]: iface.max_receive_data_len = 0
Dec 05 15:37:06 user nova-compute[75080]: iface.first_burst_len = 0
Dec 05 15:37:06 user nova-compute[75080]: iface.max_outstanding_r2t = 0
Dec 05 15:37:06 user nova-compute[75080]: iface.max_burst_len = 0
Dec 05 15:37:06 user nova-compute[75080]: iface.chap_auth = <empty>
Dec 05 15:37:06 user nova-compute[75080]: iface.bidi_chap = <empty>
Dec 05 15:37:06 user nova-compute[75080]: iface.strict_login_compliance = <empty>
Dec 05 15:37:06 user nova-compute[75080]: iface.discovery_auth = <empty>
Dec 05 15:37:06 user nova-compute[75080]: iface.discovery_logout = <empty>
Dec 05 15:37:06 user nova-compute[75080]: node.discovery_address = <empty>
Dec 05 15:37:06 user nova-compute[75080]: node.discovery_port = 0
Dec 05 15:37:06 user nova-compute[75080]: node.discovery_type = static
Dec 05 15:37:06 user nova-compute[75080]: node.session.initial_cmdsn = 0
Dec 05 15:37:06 user nova-compute[75080]: node.session.initial_login_retry_max = 8
Dec 05 15:37:06 user nova-compute[75080]: node.session.xmit_thread_priority = -20
Dec 05 15:37:06 user nova-compute[75080]: node.session.cmds_max = 128
Dec 05 15:37:06 user nova-compute[75080]: node.session.queue_depth = 32
Dec 05 15:37:06 user nova-compute[75080]: node.session.nr_sessions = 1
Dec 05 15:37:06 user nova-compute[75080]: node.session.auth.authmethod = CHAP
Dec 05 15:37:06 user nova-compute[75080]: node.session.auth.username = ySIZWThQ
Dec 05 15:37:06 user nova-compute[75080]: node.session.auth.password = ***
Dec 05 15:37:06 user nova-compute[75080]: node.session.auth.username_in = <empty>
Dec 05 15:37:06 user nova-compute[75080]: node.session.auth.password_in = <empty>
Dec 05 15:37:06 user nova-compute[75080]: node.session.auth.chap_algs = MD5
Dec 05 15:37:06 user nova-compute[75080]: node.session.timeo.replacement_timeout = 120
Dec 05 15:37:06 user nova-compute[75080]: node.session.err_timeo.abort_timeout = 15
Dec 05 15:37:06 user nova-compute[75080]: node.session.err_timeo.lu_reset_timeout = 30
Dec 05 15:37:06 user nova-compute[75080]: node.session.err_timeo.tgt_reset_timeout = 30
Dec 05 15:37:06 user nova-compute[75080]: node.session.err_timeo.host_reset_timeout = 60
Dec 05 15:37:06 user nova-compute[75080]: node.session.iscsi.FastAbort = Yes
Dec 05 15:37:06 user nova-compute[75080]: node.session.iscsi.InitialR2T = No
Dec 05 15:37:06 user nova-compute[75080]: node.session.iscsi.ImmediateData = Yes
Dec 05 15:37:06 user nova-compute[75080]: node.session.iscsi.FirstBurstLength = 262144
Dec 05 15:37:06 user nova-compute[75080]: node.session.iscsi.MaxBurstLength = 16776192
Dec 05 15:37:06 user nova-compute[75080]: node.session.iscsi.DefaultTime2Retain = 0
Dec 05 15:37:06 user nova-compute[75080]: node.session.iscsi.DefaultTime2Wait = 2
Dec 05 15:37:06 user nova-compute[75080]: node.session.iscsi.MaxConnections = 1
Dec 05 15:37:06 user nova-compute[75080]: node.session.iscsi.MaxOutstandingR2T = 1
Dec 05 15:37:06 user nova-compute[75080]: node.session.iscsi.ERL = 0
Dec 05 15:37:06 user nova-compute[75080]: node.session.scan = manual
Dec 05 15:37:06 user nova-compute[75080]: node.session.reopen_max = 0
Dec 05 15:37:06 user nova-compute[75080]: node.conn[0].address = 172.16.0.220
Dec 05 15:37:06 user nova-compute[75080]: node.conn[0].port = 3260
Dec 05 15:37:06 user nova-compute[75080]: node.conn[0].startup = manual
Dec 05 15:37:06 user nova-compute[75080]: node.conn[0].tcp.window_size = 524288
Dec 05 15:37:06 user nova-compute[75080]: node.conn[0].tcp.type_of_service = 0
Dec 05 15:37:06 user nova-compute[75080]: node.conn[0].timeo.logout_timeout = 15
Dec 05 15:37:06 user nova-compute[75080]: node.conn[0].timeo.login_timeout = 15
Dec 05 15:37:06 user nova-compute[75080]: node.conn[0].timeo.auth_timeout = 45
Dec 05 15:37:06 user nova-compute[75080]: node.conn[0].timeo.noop_out_interval = 5
Dec 05 15:37:06 user nova-compute[75080]: node.conn[0].timeo.noop_out_timeout = 5
Dec 05 15:37:06 user nova-compute[75080]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Dec 05 15:37:06 user nova-compute[75080]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Dec 05 15:37:06 user nova-compute[75080]: node.conn[0].iscsi.HeaderDigest = None
Dec 05 15:37:06 user nova-compute[75080]: node.conn[0].iscsi.DataDigest = None
Dec 05 15:37:06 user nova-compute[75080]: node.conn[0].iscsi.IFMarker = No
Dec 05 15:37:06 user nova-compute[75080]: node.conn[0].iscsi.OFMarker = No
Dec 05 15:37:06 user nova-compute[75080]: # END RECORD
Dec 05 15:37:06 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a59be4-b4d5-4223-ba0c-036f6fd30ef5]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec22085b-1e1b-41b2-aca7-fb0e340eca67]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ySIZWThQ {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ySIZWThQ" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[29cff7a3-d476-4af3-8ae4-056e8d85a01c]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ySIZWThQ'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c825c61-7c14-4ec5-b79c-335cb1e2cc00]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[27414bd9-c73a-4a4b-8c5c-b26ef9b61cd5]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:37:06 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:37:06 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:37:06 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:37:06 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.181s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] HCTL ('33', '0', '0', 0) found on session 40 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90b9d84-fed3-4f6d-b8da-4db1e51d361d]: (4, ('0 0 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Searching for a device in session 40 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ySIZWThQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.207s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] <== connect_volume: return (208ms) {'type': 'block', 'scsi_wwn': '23264326563353334', 'path': '/dev/sdb'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264326563353334', 'path': '/dev/sdb'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:35:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1468368929',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1468368929',id=36,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:35:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97145ab79b414c4fb8772c71e9414581',ramdisk_id='',reservation_id='r-cqnwpz86',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2060228993',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:35:37Z,user_data=None,user_id='829d709c32db431199af609ddbc8b090',uuid=e0331194-6106-4621-ab60-94bcf681222e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12153aa9-8336-46dc-8491-6c28da3646a3", "address": "fa:16:3e:0d:84:cd", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "vif_mac": "fa:16:3e:0d:84:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12153aa9-83", "ovs_interfaceid": "12153aa9-8336-46dc-8491-6c28da3646a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Converting VIF {"id": "12153aa9-8336-46dc-8491-6c28da3646a3", "address": "fa:16:3e:0d:84:cd", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "vif_mac": "fa:16:3e:0d:84:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12153aa9-83", "ovs_interfaceid": "12153aa9-8336-46dc-8491-6c28da3646a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:84:cd,bridge_name='br-int',has_traffic_filtering=True,id=12153aa9-8336-46dc-8491-6c28da3646a3,network=Network(61aa968d-7e44-4ef2-955f-2e5441416f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12153aa9-83') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG nova.objects.instance [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lazy-loading 'pci_devices' on Instance uuid e0331194-6106-4621-ab60-94bcf681222e {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG nova.objects.base [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Object Instance<e0331194-6106-4621-ab60-94bcf681222e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:37:06 user nova-compute[75080]:   <uuid>e0331194-6106-4621-ab60-94bcf681222e</uuid>
Dec 05 15:37:06 user nova-compute[75080]:   <name>instance-00000024</name>
Dec 05 15:37:06 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:37:06 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:37:06 user nova-compute[75080]:   <metadata>
Dec 05 15:37:06 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:37:06 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:37:06 user nova-compute[75080]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1468368929</nova:name>
Dec 05 15:37:06 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:37:05</nova:creationTime>
Dec 05 15:37:06 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:37:06 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:37:06 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:37:06 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:37:06 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:37:06 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:37:06 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:37:06 user nova-compute[75080]:       <nova:owner>
Dec 05 15:37:06 user nova-compute[75080]:         <nova:user uuid="829d709c32db431199af609ddbc8b090">tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member</nova:user>
Dec 05 15:37:06 user nova-compute[75080]:         <nova:project uuid="97145ab79b414c4fb8772c71e9414581">tempest-ServerBootFromVolumeStableRescueTest-2060228993</nova:project>
Dec 05 15:37:06 user nova-compute[75080]:       </nova:owner>
Dec 05 15:37:06 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:37:06 user nova-compute[75080]:       <nova:ports>
Dec 05 15:37:06 user nova-compute[75080]:         <nova:port uuid="12153aa9-8336-46dc-8491-6c28da3646a3">
Dec 05 15:37:06 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 05 15:37:06 user nova-compute[75080]:         </nova:port>
Dec 05 15:37:06 user nova-compute[75080]:       </nova:ports>
Dec 05 15:37:06 user nova-compute[75080]:     </nova:instance>
Dec 05 15:37:06 user nova-compute[75080]:   </metadata>
Dec 05 15:37:06 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:37:06 user nova-compute[75080]:     <system>
Dec 05 15:37:06 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:37:06 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:37:06 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:37:06 user nova-compute[75080]:       <entry name="serial">e0331194-6106-4621-ab60-94bcf681222e</entry>
Dec 05 15:37:06 user nova-compute[75080]:       <entry name="uuid">e0331194-6106-4621-ab60-94bcf681222e</entry>
Dec 05 15:37:06 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:37:06 user nova-compute[75080]:     </system>
Dec 05 15:37:06 user nova-compute[75080]:   </sysinfo>
Dec 05 15:37:06 user nova-compute[75080]:   <os>
Dec 05 15:37:06 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:37:06 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:37:06 user nova-compute[75080]:   </os>
Dec 05 15:37:06 user nova-compute[75080]:   <features>
Dec 05 15:37:06 user nova-compute[75080]:     <acpi/>
Dec 05 15:37:06 user nova-compute[75080]:     <apic/>
Dec 05 15:37:06 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:37:06 user nova-compute[75080]:   </features>
Dec 05 15:37:06 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:37:06 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:37:06 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:37:06 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:37:06 user nova-compute[75080]:   </clock>
Dec 05 15:37:06 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:37:06 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:37:06 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:37:06 user nova-compute[75080]:   </cpu>
Dec 05 15:37:06 user nova-compute[75080]:   <devices>
Dec 05 15:37:06 user nova-compute[75080]:     <disk type="block" device="disk">
Dec 05 15:37:06 user nova-compute[75080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:37:06 user nova-compute[75080]:       <source dev="/dev/sdb"/>
Dec 05 15:37:06 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:37:06 user nova-compute[75080]:       <serial>127a183f-56a0-46a7-b282-3478ffda6e14</serial>
Dec 05 15:37:06 user nova-compute[75080]:     </disk>
Dec 05 15:37:06 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:37:06 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:37:06 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/e0331194-6106-4621-ab60-94bcf681222e/disk.rescue"/>
Dec 05 15:37:06 user nova-compute[75080]:       <target dev="vdb" bus="virtio"/>
Dec 05 15:37:06 user nova-compute[75080]:       <boot order="1"/>
Dec 05 15:37:06 user nova-compute[75080]:     </disk>
Dec 05 15:37:06 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:37:06 user nova-compute[75080]:       <mac address="fa:16:3e:0d:84:cd"/>
Dec 05 15:37:06 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:37:06 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:37:06 user nova-compute[75080]:       <target dev="tap12153aa9-83"/>
Dec 05 15:37:06 user nova-compute[75080]:     </interface>
Dec 05 15:37:06 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:37:06 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/e0331194-6106-4621-ab60-94bcf681222e/console.log" append="off"/>
Dec 05 15:37:06 user nova-compute[75080]:     </serial>
Dec 05 15:37:06 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:37:06 user nova-compute[75080]:     <video>
Dec 05 15:37:06 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:37:06 user nova-compute[75080]:     </video>
Dec 05 15:37:06 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:37:06 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:37:06 user nova-compute[75080]:     </rng>
Dec 05 15:37:06 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:37:06 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:37:06 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:37:06 user nova-compute[75080]:     </memballoon>
Dec 05 15:37:06 user nova-compute[75080]:   </devices>
Dec 05 15:37:06 user nova-compute[75080]: </domain>
Dec 05 15:37:06 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:37:06 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: e0331194-6106-4621-ab60-94bcf681222e] Instance destroyed successfully.
Dec 05 15:37:06 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:37:06 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] No VIF found with MAC fa:16:3e:0d:84:cd, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:37:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:08 user nova-compute[75080]: DEBUG nova.compute.manager [req-a7cf2171-0889-44d6-ba1d-18c74bfbebe6 req-09ae47da-5f55-4930-a5b0-4da809129c0d service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] Received event network-vif-plugged-12153aa9-8336-46dc-8491-6c28da3646a3 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:37:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a7cf2171-0889-44d6-ba1d-18c74bfbebe6 req-09ae47da-5f55-4930-a5b0-4da809129c0d service nova] Acquiring lock "e0331194-6106-4621-ab60-94bcf681222e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:37:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a7cf2171-0889-44d6-ba1d-18c74bfbebe6 req-09ae47da-5f55-4930-a5b0-4da809129c0d service nova] Lock "e0331194-6106-4621-ab60-94bcf681222e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:37:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a7cf2171-0889-44d6-ba1d-18c74bfbebe6 req-09ae47da-5f55-4930-a5b0-4da809129c0d service nova] Lock "e0331194-6106-4621-ab60-94bcf681222e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:37:08 user nova-compute[75080]: DEBUG nova.compute.manager [req-a7cf2171-0889-44d6-ba1d-18c74bfbebe6 req-09ae47da-5f55-4930-a5b0-4da809129c0d service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] No waiting events found dispatching network-vif-plugged-12153aa9-8336-46dc-8491-6c28da3646a3 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:37:08 user nova-compute[75080]: WARNING nova.compute.manager [req-a7cf2171-0889-44d6-ba1d-18c74bfbebe6 req-09ae47da-5f55-4930-a5b0-4da809129c0d service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] Received unexpected event network-vif-plugged-12153aa9-8336-46dc-8491-6c28da3646a3 for instance with vm_state active and task_state rescuing.
Dec 05 15:37:10 user nova-compute[75080]: DEBUG nova.compute.manager [None req-edccb10e-6b46-4546-bc8d-4d664ac4d4c7 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:37:10 user nova-compute[75080]: DEBUG nova.compute.manager [req-c13f080f-017f-47a5-8490-972c1ccb5d9a req-e87d326d-3c0b-44b6-a6d7-6b9dbd96e8f3 service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] Received event network-vif-plugged-12153aa9-8336-46dc-8491-6c28da3646a3 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:37:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c13f080f-017f-47a5-8490-972c1ccb5d9a req-e87d326d-3c0b-44b6-a6d7-6b9dbd96e8f3 service nova] Acquiring lock "e0331194-6106-4621-ab60-94bcf681222e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:37:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c13f080f-017f-47a5-8490-972c1ccb5d9a req-e87d326d-3c0b-44b6-a6d7-6b9dbd96e8f3 service nova] Lock "e0331194-6106-4621-ab60-94bcf681222e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:37:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c13f080f-017f-47a5-8490-972c1ccb5d9a req-e87d326d-3c0b-44b6-a6d7-6b9dbd96e8f3 service nova] Lock "e0331194-6106-4621-ab60-94bcf681222e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:37:10 user nova-compute[75080]: DEBUG nova.compute.manager [req-c13f080f-017f-47a5-8490-972c1ccb5d9a req-e87d326d-3c0b-44b6-a6d7-6b9dbd96e8f3 service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] No waiting events found dispatching network-vif-plugged-12153aa9-8336-46dc-8491-6c28da3646a3 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:37:10 user nova-compute[75080]: WARNING nova.compute.manager [req-c13f080f-017f-47a5-8490-972c1ccb5d9a req-e87d326d-3c0b-44b6-a6d7-6b9dbd96e8f3 service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] Received unexpected event network-vif-plugged-12153aa9-8336-46dc-8491-6c28da3646a3 for instance with vm_state rescued and task_state None.
Dec 05 15:37:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:15 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:40 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:37:42 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:37:42 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:37:42 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:37:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:43 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:37:43 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:37:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-011d3446-577a-4f5c-b8f0-ef04940cad17" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:37:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-011d3446-577a-4f5c-b8f0-ef04940cad17" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:37:43 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 15:37:44 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Updating instance_info_cache with network_info: [{"id": "dfee0a0e-5241-4d51-879d-7667bb06344b", "address": "fa:16:3e:be:d6:bd", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfee0a0e-52", "ovs_interfaceid": "dfee0a0e-5241-4d51-879d-7667bb06344b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:37:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-011d3446-577a-4f5c-b8f0-ef04940cad17" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:37:44 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 15:37:44 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:37:44 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:37:44 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:37:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:37:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:37:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:37:44 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:37:44 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:37:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0331194-6106-4621-ab60-94bcf681222e/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:37:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0331194-6106-4621-ab60-94bcf681222e/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:37:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0331194-6106-4621-ab60-94bcf681222e/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:37:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0331194-6106-4621-ab60-94bcf681222e/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:37:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:37:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:37:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:37:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:37:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:37:45 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:37:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:37:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:37:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:37:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:37:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:37:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:37:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:37:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:37:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:37:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:37:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:37:46 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:37:46 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:37:46 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=8298MB free_disk=24.813335418701172GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:37:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:37:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:37:46 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 07b025ff-4a9d-48a2-b950-b8f2d165f33c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:37:46 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance ab882db7-e6d7-44ca-9ea4-ae2fa68f7929 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:37:46 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 011d3446-577a-4f5c-b8f0-ef04940cad17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:37:46 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance b47129e8-c02b-4107-af4f-329173dd453f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:37:46 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance e0331194-6106-4621-ab60-94bcf681222e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:37:46 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 1e352b3b-ee04-42f6-af53-973c3154a342 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:37:46 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:37:46 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:37:47 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:37:47 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:37:47 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:37:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.344s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:37:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:49 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:37:49 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:37:49 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:37:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Acquiring lock "fe780f8f-12ad-49c7-92f1-547694e4755e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:37:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "fe780f8f-12ad-49c7-92f1-547694e4755e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:37:49 user nova-compute[75080]: DEBUG nova.compute.manager [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:37:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:37:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:37:49 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:37:49 user nova-compute[75080]: INFO nova.compute.claims [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Claim successful on node user
Dec 05 15:37:50 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:37:50 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:37:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.336s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:37:50 user nova-compute[75080]: DEBUG nova.compute.manager [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:37:50 user nova-compute[75080]: DEBUG nova.compute.manager [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:37:50 user nova-compute[75080]: DEBUG nova.network.neutron [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:37:50 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:37:50 user nova-compute[75080]: DEBUG nova.compute.manager [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:37:50 user nova-compute[75080]: DEBUG nova.policy [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '025ecd26509b46b8b0157d0abe16eec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a1b1f1ed346949ac0f633ae7e530b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:37:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:50 user nova-compute[75080]: DEBUG nova.compute.manager [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:37:50 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:37:50 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Creating image(s)
Dec 05 15:37:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Acquiring lock "/opt/stack/data/nova/instances/fe780f8f-12ad-49c7-92f1-547694e4755e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:37:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "/opt/stack/data/nova/instances/fe780f8f-12ad-49c7-92f1-547694e4755e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:37:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "/opt/stack/data/nova/instances/fe780f8f-12ad-49c7-92f1-547694e4755e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:37:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:37:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.182s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:37:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:37:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:37:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:37:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.218s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:37:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/fe780f8f-12ad-49c7-92f1-547694e4755e/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:37:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/fe780f8f-12ad-49c7-92f1-547694e4755e/disk 1073741824" returned: 0 in 0.050s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:37:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:37:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:37:51 user nova-compute[75080]: DEBUG nova.network.neutron [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Successfully created port: 7d7165da-a177-4c78-85bb-9e3dbda56be8 {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:37:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.187s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:37:51 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fe780f8f-12ad-49c7-92f1-547694e4755e/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 15:37:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe780f8f-12ad-49c7-92f1-547694e4755e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:37:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe780f8f-12ad-49c7-92f1-547694e4755e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:37:51 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Cannot resize image /opt/stack/data/nova/instances/fe780f8f-12ad-49c7-92f1-547694e4755e/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 15:37:51 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:37:51 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Ensure instance console log exists: /opt/stack/data/nova/instances/fe780f8f-12ad-49c7-92f1-547694e4755e/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:37:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:37:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:37:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:37:51 user nova-compute[75080]: DEBUG nova.network.neutron [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Successfully updated port: 7d7165da-a177-4c78-85bb-9e3dbda56be8 {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:37:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Acquiring lock "refresh_cache-fe780f8f-12ad-49c7-92f1-547694e4755e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:37:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Acquired lock "refresh_cache-fe780f8f-12ad-49c7-92f1-547694e4755e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:37:51 user nova-compute[75080]: DEBUG nova.network.neutron [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:37:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-33bedfae-5e27-45f6-b3df-f487a77af783 req-29639a69-ffdf-49d1-8856-8869d889c873 service nova] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Received event network-changed-7d7165da-a177-4c78-85bb-9e3dbda56be8 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:37:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-33bedfae-5e27-45f6-b3df-f487a77af783 req-29639a69-ffdf-49d1-8856-8869d889c873 service nova] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Refreshing instance network info cache due to event network-changed-7d7165da-a177-4c78-85bb-9e3dbda56be8. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:37:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-33bedfae-5e27-45f6-b3df-f487a77af783 req-29639a69-ffdf-49d1-8856-8869d889c873 service nova] Acquiring lock "refresh_cache-fe780f8f-12ad-49c7-92f1-547694e4755e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:37:51 user nova-compute[75080]: DEBUG nova.network.neutron [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG nova.network.neutron [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Updating instance_info_cache with network_info: [{"id": "7d7165da-a177-4c78-85bb-9e3dbda56be8", "address": "fa:16:3e:8f:a1:9b", "network": {"id": "eb187ccd-700a-49df-881f-c61d4b90e612", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053782949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e8a1b1f1ed346949ac0f633ae7e530b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d7165da-a1", "ovs_interfaceid": "7d7165da-a177-4c78-85bb-9e3dbda56be8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Releasing lock "refresh_cache-fe780f8f-12ad-49c7-92f1-547694e4755e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG nova.compute.manager [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Instance network_info: |[{"id": "7d7165da-a177-4c78-85bb-9e3dbda56be8", "address": "fa:16:3e:8f:a1:9b", "network": {"id": "eb187ccd-700a-49df-881f-c61d4b90e612", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053782949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e8a1b1f1ed346949ac0f633ae7e530b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d7165da-a1", "ovs_interfaceid": "7d7165da-a177-4c78-85bb-9e3dbda56be8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-33bedfae-5e27-45f6-b3df-f487a77af783 req-29639a69-ffdf-49d1-8856-8869d889c873 service nova] Acquired lock "refresh_cache-fe780f8f-12ad-49c7-92f1-547694e4755e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG nova.network.neutron [req-33bedfae-5e27-45f6-b3df-f487a77af783 req-29639a69-ffdf-49d1-8856-8869d889c873 service nova] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Refreshing network info cache for port 7d7165da-a177-4c78-85bb-9e3dbda56be8 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Start _get_guest_xml network_info=[{"id": "7d7165da-a177-4c78-85bb-9e3dbda56be8", "address": "fa:16:3e:8f:a1:9b", "network": {"id": "eb187ccd-700a-49df-881f-c61d4b90e612", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053782949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e8a1b1f1ed346949ac0f633ae7e530b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d7165da-a1", "ovs_interfaceid": "7d7165da-a177-4c78-85bb-9e3dbda56be8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:37:52 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:37:52 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:37:52 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:37:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1180066338',display_name='tempest-VolumesSnapshotTestJSON-instance-1180066338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1180066338',id=38,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPT6lOJZ49XRTEfXgfj07Gq7/EVFnXSGjIkD4RCKh5KPuwkZ8ZmVBlaYHNVajxJSwnsAV5gT71prHXcwBBNGGdNUgRe/yWJ29eFxyyZLz9UCz6xPJvikKFe8/Y0m4GBlcQ==',key_name='tempest-keypair-618590875',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e8a1b1f1ed346949ac0f633ae7e530b',ramdisk_id='',reservation_id='r-e038mnoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1567075546',owner_user_name='tempest-VolumesSnapshotTestJSON-1567075546-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:37:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='025ecd26509b46b8b0157d0abe16eec8',uuid=fe780f8f-12ad-49c7-92f1-547694e4755e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d7165da-a177-4c78-85bb-9e3dbda56be8", "address": "fa:16:3e:8f:a1:9b", "network": {"id": "eb187ccd-700a-49df-881f-c61d4b90e612", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053782949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e8a1b1f1ed346949ac0f633ae7e530b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d7165da-a1", "ovs_interfaceid": "7d7165da-a177-4c78-85bb-9e3dbda56be8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Converting VIF {"id": "7d7165da-a177-4c78-85bb-9e3dbda56be8", "address": "fa:16:3e:8f:a1:9b", "network": {"id": "eb187ccd-700a-49df-881f-c61d4b90e612", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053782949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e8a1b1f1ed346949ac0f633ae7e530b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d7165da-a1", "ovs_interfaceid": "7d7165da-a177-4c78-85bb-9e3dbda56be8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:a1:9b,bridge_name='br-int',has_traffic_filtering=True,id=7d7165da-a177-4c78-85bb-9e3dbda56be8,network=Network(eb187ccd-700a-49df-881f-c61d4b90e612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d7165da-a1') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG nova.objects.instance [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lazy-loading 'pci_devices' on Instance uuid fe780f8f-12ad-49c7-92f1-547694e4755e {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:37:52 user nova-compute[75080]:   <uuid>fe780f8f-12ad-49c7-92f1-547694e4755e</uuid>
Dec 05 15:37:52 user nova-compute[75080]:   <name>instance-00000026</name>
Dec 05 15:37:52 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:37:52 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:37:52 user nova-compute[75080]:   <metadata>
Dec 05 15:37:52 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:37:52 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:37:52 user nova-compute[75080]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1180066338</nova:name>
Dec 05 15:37:52 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:37:52</nova:creationTime>
Dec 05 15:37:52 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:37:52 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:37:52 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:37:52 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:37:52 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:37:52 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:37:52 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:37:52 user nova-compute[75080]:       <nova:owner>
Dec 05 15:37:52 user nova-compute[75080]:         <nova:user uuid="025ecd26509b46b8b0157d0abe16eec8">tempest-VolumesSnapshotTestJSON-1567075546-project-member</nova:user>
Dec 05 15:37:52 user nova-compute[75080]:         <nova:project uuid="6e8a1b1f1ed346949ac0f633ae7e530b">tempest-VolumesSnapshotTestJSON-1567075546</nova:project>
Dec 05 15:37:52 user nova-compute[75080]:       </nova:owner>
Dec 05 15:37:52 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:37:52 user nova-compute[75080]:       <nova:ports>
Dec 05 15:37:52 user nova-compute[75080]:         <nova:port uuid="7d7165da-a177-4c78-85bb-9e3dbda56be8">
Dec 05 15:37:52 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 05 15:37:52 user nova-compute[75080]:         </nova:port>
Dec 05 15:37:52 user nova-compute[75080]:       </nova:ports>
Dec 05 15:37:52 user nova-compute[75080]:     </nova:instance>
Dec 05 15:37:52 user nova-compute[75080]:   </metadata>
Dec 05 15:37:52 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:37:52 user nova-compute[75080]:     <system>
Dec 05 15:37:52 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:37:52 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:37:52 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:37:52 user nova-compute[75080]:       <entry name="serial">fe780f8f-12ad-49c7-92f1-547694e4755e</entry>
Dec 05 15:37:52 user nova-compute[75080]:       <entry name="uuid">fe780f8f-12ad-49c7-92f1-547694e4755e</entry>
Dec 05 15:37:52 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:37:52 user nova-compute[75080]:     </system>
Dec 05 15:37:52 user nova-compute[75080]:   </sysinfo>
Dec 05 15:37:52 user nova-compute[75080]:   <os>
Dec 05 15:37:52 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:37:52 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:37:52 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:37:52 user nova-compute[75080]:   </os>
Dec 05 15:37:52 user nova-compute[75080]:   <features>
Dec 05 15:37:52 user nova-compute[75080]:     <acpi/>
Dec 05 15:37:52 user nova-compute[75080]:     <apic/>
Dec 05 15:37:52 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:37:52 user nova-compute[75080]:   </features>
Dec 05 15:37:52 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:37:52 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:37:52 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:37:52 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:37:52 user nova-compute[75080]:   </clock>
Dec 05 15:37:52 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:37:52 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:37:52 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:37:52 user nova-compute[75080]:   </cpu>
Dec 05 15:37:52 user nova-compute[75080]:   <devices>
Dec 05 15:37:52 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:37:52 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:37:52 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/fe780f8f-12ad-49c7-92f1-547694e4755e/disk"/>
Dec 05 15:37:52 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:37:52 user nova-compute[75080]:     </disk>
Dec 05 15:37:52 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:37:52 user nova-compute[75080]:       <mac address="fa:16:3e:8f:a1:9b"/>
Dec 05 15:37:52 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:37:52 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:37:52 user nova-compute[75080]:       <target dev="tap7d7165da-a1"/>
Dec 05 15:37:52 user nova-compute[75080]:     </interface>
Dec 05 15:37:52 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:37:52 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/fe780f8f-12ad-49c7-92f1-547694e4755e/console.log" append="off"/>
Dec 05 15:37:52 user nova-compute[75080]:     </serial>
Dec 05 15:37:52 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:37:52 user nova-compute[75080]:     <video>
Dec 05 15:37:52 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:37:52 user nova-compute[75080]:     </video>
Dec 05 15:37:52 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:37:52 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:37:52 user nova-compute[75080]:     </rng>
Dec 05 15:37:52 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:37:52 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:37:52 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:37:52 user nova-compute[75080]:     </memballoon>
Dec 05 15:37:52 user nova-compute[75080]:   </devices>
Dec 05 15:37:52 user nova-compute[75080]: </domain>
Dec 05 15:37:52 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:37:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1180066338',display_name='tempest-VolumesSnapshotTestJSON-instance-1180066338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1180066338',id=38,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPT6lOJZ49XRTEfXgfj07Gq7/EVFnXSGjIkD4RCKh5KPuwkZ8ZmVBlaYHNVajxJSwnsAV5gT71prHXcwBBNGGdNUgRe/yWJ29eFxyyZLz9UCz6xPJvikKFe8/Y0m4GBlcQ==',key_name='tempest-keypair-618590875',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e8a1b1f1ed346949ac0f633ae7e530b',ramdisk_id='',reservation_id='r-e038mnoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1567075546',owner_user_name='tempest-VolumesSnapshotTestJSON-1567075546-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:37:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='025ecd26509b46b8b0157d0abe16eec8',uuid=fe780f8f-12ad-49c7-92f1-547694e4755e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d7165da-a177-4c78-85bb-9e3dbda56be8", "address": "fa:16:3e:8f:a1:9b", "network": {"id": "eb187ccd-700a-49df-881f-c61d4b90e612", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053782949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e8a1b1f1ed346949ac0f633ae7e530b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d7165da-a1", "ovs_interfaceid": "7d7165da-a177-4c78-85bb-9e3dbda56be8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Converting VIF {"id": "7d7165da-a177-4c78-85bb-9e3dbda56be8", "address": "fa:16:3e:8f:a1:9b", "network": {"id": "eb187ccd-700a-49df-881f-c61d4b90e612", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053782949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e8a1b1f1ed346949ac0f633ae7e530b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d7165da-a1", "ovs_interfaceid": "7d7165da-a177-4c78-85bb-9e3dbda56be8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:a1:9b,bridge_name='br-int',has_traffic_filtering=True,id=7d7165da-a177-4c78-85bb-9e3dbda56be8,network=Network(eb187ccd-700a-49df-881f-c61d4b90e612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d7165da-a1') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG os_vif [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:a1:9b,bridge_name='br-int',has_traffic_filtering=True,id=7d7165da-a177-4c78-85bb-9e3dbda56be8,network=Network(eb187ccd-700a-49df-881f-c61d4b90e612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d7165da-a1') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '662bea2c-cd80-5376-9249-15c21fd94241', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d7165da-a1, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7d7165da-a1, col_values=(('qos', UUID('273f584b-0bd2-427e-b8dc-d02473a15c6a')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7d7165da-a1, col_values=(('external_ids', {'iface-id': '7d7165da-a177-4c78-85bb-9e3dbda56be8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:a1:9b', 'vm-uuid': 'fe780f8f-12ad-49c7-92f1-547694e4755e'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:52 user nova-compute[75080]: INFO os_vif [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:a1:9b,bridge_name='br-int',has_traffic_filtering=True,id=7d7165da-a177-4c78-85bb-9e3dbda56be8,network=Network(eb187ccd-700a-49df-881f-c61d4b90e612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d7165da-a1')
Dec 05 15:37:52 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] No VIF found with MAC fa:16:3e:8f:a1:9b, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG nova.network.neutron [req-33bedfae-5e27-45f6-b3df-f487a77af783 req-29639a69-ffdf-49d1-8856-8869d889c873 service nova] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Updated VIF entry in instance network info cache for port 7d7165da-a177-4c78-85bb-9e3dbda56be8. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG nova.network.neutron [req-33bedfae-5e27-45f6-b3df-f487a77af783 req-29639a69-ffdf-49d1-8856-8869d889c873 service nova] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Updating instance_info_cache with network_info: [{"id": "7d7165da-a177-4c78-85bb-9e3dbda56be8", "address": "fa:16:3e:8f:a1:9b", "network": {"id": "eb187ccd-700a-49df-881f-c61d4b90e612", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053782949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e8a1b1f1ed346949ac0f633ae7e530b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d7165da-a1", "ovs_interfaceid": "7d7165da-a177-4c78-85bb-9e3dbda56be8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:37:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-33bedfae-5e27-45f6-b3df-f487a77af783 req-29639a69-ffdf-49d1-8856-8869d889c873 service nova] Releasing lock "refresh_cache-fe780f8f-12ad-49c7-92f1-547694e4755e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:37:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:55 user nova-compute[75080]: DEBUG nova.compute.manager [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:37:55 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:37:56 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Instance spawned successfully.
Dec 05 15:37:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:37:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:37:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:37:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:37:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:37:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:37:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:37:56 user nova-compute[75080]: INFO nova.compute.manager [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Took 5.67 seconds to spawn the instance on the hypervisor.
Dec 05 15:37:56 user nova-compute[75080]: DEBUG nova.compute.manager [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:37:56 user nova-compute[75080]: INFO nova.compute.manager [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Took 6.35 seconds to build instance.
Dec 05 15:37:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2269b900-2a64-4cb4-abc8-f351001e1df5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "fe780f8f-12ad-49c7-92f1-547694e4755e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.477s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:37:56 user nova-compute[75080]: DEBUG nova.compute.manager [req-fe3eaece-dfb8-4f15-a036-7b4a1b882e1b req-1327e2f8-d170-494f-bb37-9e3f3b7b7792 service nova] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Received event network-vif-plugged-7d7165da-a177-4c78-85bb-9e3dbda56be8 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:37:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-fe3eaece-dfb8-4f15-a036-7b4a1b882e1b req-1327e2f8-d170-494f-bb37-9e3f3b7b7792 service nova] Acquiring lock "fe780f8f-12ad-49c7-92f1-547694e4755e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:37:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-fe3eaece-dfb8-4f15-a036-7b4a1b882e1b req-1327e2f8-d170-494f-bb37-9e3f3b7b7792 service nova] Lock "fe780f8f-12ad-49c7-92f1-547694e4755e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:37:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-fe3eaece-dfb8-4f15-a036-7b4a1b882e1b req-1327e2f8-d170-494f-bb37-9e3f3b7b7792 service nova] Lock "fe780f8f-12ad-49c7-92f1-547694e4755e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:37:56 user nova-compute[75080]: DEBUG nova.compute.manager [req-fe3eaece-dfb8-4f15-a036-7b4a1b882e1b req-1327e2f8-d170-494f-bb37-9e3f3b7b7792 service nova] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] No waiting events found dispatching network-vif-plugged-7d7165da-a177-4c78-85bb-9e3dbda56be8 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:37:56 user nova-compute[75080]: WARNING nova.compute.manager [req-fe3eaece-dfb8-4f15-a036-7b4a1b882e1b req-1327e2f8-d170-494f-bb37-9e3f3b7b7792 service nova] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Received unexpected event network-vif-plugged-7d7165da-a177-4c78-85bb-9e3dbda56be8 for instance with vm_state active and task_state None.
Dec 05 15:37:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:37:58 user nova-compute[75080]: DEBUG nova.compute.manager [req-4ad8b7d5-b45b-4e10-a1c9-724a816bfc73 req-21bd9832-2ab5-4e85-9d6a-701466e6e447 service nova] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Received event network-vif-plugged-7d7165da-a177-4c78-85bb-9e3dbda56be8 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:37:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4ad8b7d5-b45b-4e10-a1c9-724a816bfc73 req-21bd9832-2ab5-4e85-9d6a-701466e6e447 service nova] Acquiring lock "fe780f8f-12ad-49c7-92f1-547694e4755e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:37:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4ad8b7d5-b45b-4e10-a1c9-724a816bfc73 req-21bd9832-2ab5-4e85-9d6a-701466e6e447 service nova] Lock "fe780f8f-12ad-49c7-92f1-547694e4755e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:37:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4ad8b7d5-b45b-4e10-a1c9-724a816bfc73 req-21bd9832-2ab5-4e85-9d6a-701466e6e447 service nova] Lock "fe780f8f-12ad-49c7-92f1-547694e4755e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:37:58 user nova-compute[75080]: DEBUG nova.compute.manager [req-4ad8b7d5-b45b-4e10-a1c9-724a816bfc73 req-21bd9832-2ab5-4e85-9d6a-701466e6e447 service nova] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] No waiting events found dispatching network-vif-plugged-7d7165da-a177-4c78-85bb-9e3dbda56be8 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:37:58 user nova-compute[75080]: WARNING nova.compute.manager [req-4ad8b7d5-b45b-4e10-a1c9-724a816bfc73 req-21bd9832-2ab5-4e85-9d6a-701466e6e447 service nova] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Received unexpected event network-vif-plugged-7d7165da-a177-4c78-85bb-9e3dbda56be8 for instance with vm_state active and task_state None.
Dec 05 15:38:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Acquiring lock "675f9326-411b-4d0d-921c-f5375ffec457" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:38:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Lock "675f9326-411b-4d0d-921c-f5375ffec457" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:38:05 user nova-compute[75080]: DEBUG nova.compute.manager [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:38:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:38:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:38:05 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:38:05 user nova-compute[75080]: INFO nova.compute.claims [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Claim successful on node user
Dec 05 15:38:06 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:38:06 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:38:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.356s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:38:06 user nova-compute[75080]: DEBUG nova.compute.manager [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:38:06 user nova-compute[75080]: DEBUG nova.compute.manager [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:38:06 user nova-compute[75080]: DEBUG nova.network.neutron [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:38:06 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:38:06 user nova-compute[75080]: DEBUG nova.compute.manager [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:38:06 user nova-compute[75080]: DEBUG nova.policy [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2b1bbf8f0a8f44a3a5dc224bcf9e7139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c63445ed4f466b8c00af6d9bc40e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:38:06 user nova-compute[75080]: INFO nova.virt.block_device [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Booting with volume 5e132bcf-9292-494f-bd93-f747af60818b at /dev/vda
Dec 05 15:38:06 user nova-compute[75080]: DEBUG os_brick.utils [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:38:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29faef4-9284-4967-9ae3-0e802e3e344a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:38:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d713bb8a-ecc2-41a6-b092-452b9a134e3c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:38:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a9d247-c46f-4f3b-98e7-f0c68f2de11e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:38:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[880c9d49-ebae-438e-9d7e-618e1e101e87]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:38:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:38:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:38:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:38:06 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:38:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[457d87e6-5802-4fab-83ef-60573b38ef4b]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:38:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:38:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:38:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:38:06 user nova-compute[75080]: DEBUG os_brick.utils [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:38:06 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Updating existing volume attachment record: ae89dac7-cde2-4e4b-9b51-22e5c4c0ac8a {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:38:07 user nova-compute[75080]: DEBUG nova.network.neutron [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Successfully created port: e6fdf36d-c77d-4dbb-94c8-61d010e00884 {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:38:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:07 user nova-compute[75080]: DEBUG nova.network.neutron [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Successfully updated port: e6fdf36d-c77d-4dbb-94c8-61d010e00884 {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:38:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Acquiring lock "refresh_cache-675f9326-411b-4d0d-921c-f5375ffec457" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:38:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Acquired lock "refresh_cache-675f9326-411b-4d0d-921c-f5375ffec457" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:38:07 user nova-compute[75080]: DEBUG nova.network.neutron [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:38:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-46836235-359a-43dc-aeea-5afab4c5d944 req-b03e76d1-c308-4172-8d07-e61cb5083615 service nova] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Received event network-changed-e6fdf36d-c77d-4dbb-94c8-61d010e00884 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:38:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-46836235-359a-43dc-aeea-5afab4c5d944 req-b03e76d1-c308-4172-8d07-e61cb5083615 service nova] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Refreshing instance network info cache due to event network-changed-e6fdf36d-c77d-4dbb-94c8-61d010e00884. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:38:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-46836235-359a-43dc-aeea-5afab4c5d944 req-b03e76d1-c308-4172-8d07-e61cb5083615 service nova] Acquiring lock "refresh_cache-675f9326-411b-4d0d-921c-f5375ffec457" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:38:07 user nova-compute[75080]: DEBUG nova.network.neutron [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:38:07 user nova-compute[75080]: DEBUG nova.network.neutron [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Updating instance_info_cache with network_info: [{"id": "e6fdf36d-c77d-4dbb-94c8-61d010e00884", "address": "fa:16:3e:76:b9:75", "network": {"id": "cab219d9-2a41-4553-9030-07efee59df1b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1667827966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c63445ed4f466b8c00af6d9bc40e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fdf36d-c7", "ovs_interfaceid": "e6fdf36d-c77d-4dbb-94c8-61d010e00884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:38:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Releasing lock "refresh_cache-675f9326-411b-4d0d-921c-f5375ffec457" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:38:07 user nova-compute[75080]: DEBUG nova.compute.manager [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Instance network_info: |[{"id": "e6fdf36d-c77d-4dbb-94c8-61d010e00884", "address": "fa:16:3e:76:b9:75", "network": {"id": "cab219d9-2a41-4553-9030-07efee59df1b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1667827966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c63445ed4f466b8c00af6d9bc40e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fdf36d-c7", "ovs_interfaceid": "e6fdf36d-c77d-4dbb-94c8-61d010e00884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:38:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-46836235-359a-43dc-aeea-5afab4c5d944 req-b03e76d1-c308-4172-8d07-e61cb5083615 service nova] Acquired lock "refresh_cache-675f9326-411b-4d0d-921c-f5375ffec457" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:38:07 user nova-compute[75080]: DEBUG nova.network.neutron [req-46836235-359a-43dc-aeea-5afab4c5d944 req-b03e76d1-c308-4172-8d07-e61cb5083615 service nova] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Refreshing network info cache for port e6fdf36d-c77d-4dbb-94c8-61d010e00884 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:38:08 user nova-compute[75080]: DEBUG nova.network.neutron [req-46836235-359a-43dc-aeea-5afab4c5d944 req-b03e76d1-c308-4172-8d07-e61cb5083615 service nova] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Updated VIF entry in instance network info cache for port e6fdf36d-c77d-4dbb-94c8-61d010e00884. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:38:08 user nova-compute[75080]: DEBUG nova.network.neutron [req-46836235-359a-43dc-aeea-5afab4c5d944 req-b03e76d1-c308-4172-8d07-e61cb5083615 service nova] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Updating instance_info_cache with network_info: [{"id": "e6fdf36d-c77d-4dbb-94c8-61d010e00884", "address": "fa:16:3e:76:b9:75", "network": {"id": "cab219d9-2a41-4553-9030-07efee59df1b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1667827966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c63445ed4f466b8c00af6d9bc40e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fdf36d-c7", "ovs_interfaceid": "e6fdf36d-c77d-4dbb-94c8-61d010e00884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:38:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-46836235-359a-43dc-aeea-5afab4c5d944 req-b03e76d1-c308-4172-8d07-e61cb5083615 service nova] Releasing lock "refresh_cache-675f9326-411b-4d0d-921c-f5375ffec457" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:38:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:38:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG nova.compute.manager [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:38:16 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Creating image(s)
Dec 05 15:38:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Did not create local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Ensure instance console log exists: /opt/stack/data/nova/instances/675f9326-411b-4d0d-921c-f5375ffec457/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Start _get_guest_xml network_info=[{"id": "e6fdf36d-c77d-4dbb-94c8-61d010e00884", "address": "fa:16:3e:76:b9:75", "network": {"id": "cab219d9-2a41-4553-9030-07efee59df1b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1667827966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c63445ed4f466b8c00af6d9bc40e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fdf36d-c7", "ovs_interfaceid": "e6fdf36d-c77d-4dbb-94c8-61d010e00884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OForJHUu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '675f9326-411b-4d0d-921c-f5375ffec457', 'attached_at': '', 'detached_at': '', 'volume_id': '5e132bcf-9292-494f-bd93-f747af60818b', 'serial': '5e132bcf-9292-494f-bd93-f747af60818b'}, 'device_type': 'disk', 'attachment_id': 'ae89dac7-cde2-4e4b-9b51-22e5c4c0ac8a', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:38:16 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:38:16 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:38:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OForJHUu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:38:16 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:38:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:38:16 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:38:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:38:16 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:38:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa74452a-b746-4e90-91c3-fb385ce9a7de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:38:16 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dff9019-e4a7-4281-aa1d-92581f90c043]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b] added
Dec 05 15:38:16 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc72083-93fc-4122-9b11-5cee410b079f]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[382cf6aa-f274-4d01-8bec-f574e94ad357]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OForJHUu {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OForJHUu" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3d9365-7661-41dd-86a6-4419001b2b5a]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OForJHUu'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[599676df-9959-41b0-a1ad-aaf88aa7326b]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[75000878-bda0-47cf-ba98-1a5434092ad1]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:38:16 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:38:16 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:38:16 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:38:16 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df77a6b-9474-4712-9a06-67bec6436bca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b, portal: 172.16.0.220,3260]
Dec 05 15:38:16 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b, portal: 172.16.0.220,3260] successful.
Dec 05 15:38:16 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32268d8-cd7a-4294-b209-5fa764ec229c]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef135b03-1e50-450b-86a3-8872179c4094]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:38:16 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:38:16 user nova-compute[75080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)
Dec 05 15:38:16 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:38:16 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:38:16 user nova-compute[75080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)
Dec 05 15:38:16 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5b323b-e72f-4c00-9bf0-79c5890111d8]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:38:16 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: None {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:38:17 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:38:17 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OForJHUu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:38:17 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:38:17 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23133316533333264', 'path': '/dev/sdc'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:38:17 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133316533333264', 'path': '/dev/sdc'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:38:17 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:38:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1207311612',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1207311612',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOHaSHjIWUzcs1FaMsetX+3Qdvz6+YCwRv1EvXdnmZXZwDLOl4AJxUX/t389zTETH0szJ2Ih2H3ox/1CCyz6EVUkTwws1K0LLBMLy8dIcwnjvHvzYMNik58gI35jDQnCw==',key_name='tempest-keypair-2048690446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99c63445ed4f466b8c00af6d9bc40e42',ramdisk_id='',reservation_id='r-hir48rfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1910922312',owner_user_name='tempest-ServerActionsV293TestJSON-1910922312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:38:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b1bbf8f0a8f44a3a5dc224bcf9e7139',uuid=675f9326-411b-4d0d-921c-f5375ffec457,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6fdf36d-c77d-4dbb-94c8-61d010e00884", "address": "fa:16:3e:76:b9:75", "network": {"id": "cab219d9-2a41-4553-9030-07efee59df1b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1667827966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c63445ed4f466b8c00af6d9bc40e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fdf36d-c7", "ovs_interfaceid": "e6fdf36d-c77d-4dbb-94c8-61d010e00884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:38:17 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Converting VIF {"id": "e6fdf36d-c77d-4dbb-94c8-61d010e00884", "address": "fa:16:3e:76:b9:75", "network": {"id": "cab219d9-2a41-4553-9030-07efee59df1b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1667827966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c63445ed4f466b8c00af6d9bc40e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fdf36d-c7", "ovs_interfaceid": "e6fdf36d-c77d-4dbb-94c8-61d010e00884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:38:17 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:b9:75,bridge_name='br-int',has_traffic_filtering=True,id=e6fdf36d-c77d-4dbb-94c8-61d010e00884,network=Network(cab219d9-2a41-4553-9030-07efee59df1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6fdf36d-c7') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:38:17 user nova-compute[75080]: DEBUG nova.objects.instance [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Lazy-loading 'pci_devices' on Instance uuid 675f9326-411b-4d0d-921c-f5375ffec457 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:38:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:17 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:38:17 user nova-compute[75080]:   <uuid>675f9326-411b-4d0d-921c-f5375ffec457</uuid>
Dec 05 15:38:17 user nova-compute[75080]:   <name>instance-00000027</name>
Dec 05 15:38:17 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:38:17 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:38:17 user nova-compute[75080]:   <metadata>
Dec 05 15:38:17 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:38:17 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:38:17 user nova-compute[75080]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1207311612</nova:name>
Dec 05 15:38:17 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:38:16</nova:creationTime>
Dec 05 15:38:17 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:38:17 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:38:17 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:38:17 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:38:17 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:38:17 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:38:17 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:38:17 user nova-compute[75080]:       <nova:owner>
Dec 05 15:38:17 user nova-compute[75080]:         <nova:user uuid="2b1bbf8f0a8f44a3a5dc224bcf9e7139">tempest-ServerActionsV293TestJSON-1910922312-project-member</nova:user>
Dec 05 15:38:17 user nova-compute[75080]:         <nova:project uuid="99c63445ed4f466b8c00af6d9bc40e42">tempest-ServerActionsV293TestJSON-1910922312</nova:project>
Dec 05 15:38:17 user nova-compute[75080]:       </nova:owner>
Dec 05 15:38:17 user nova-compute[75080]:       <nova:ports>
Dec 05 15:38:17 user nova-compute[75080]:         <nova:port uuid="e6fdf36d-c77d-4dbb-94c8-61d010e00884">
Dec 05 15:38:17 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 05 15:38:17 user nova-compute[75080]:         </nova:port>
Dec 05 15:38:17 user nova-compute[75080]:       </nova:ports>
Dec 05 15:38:17 user nova-compute[75080]:     </nova:instance>
Dec 05 15:38:17 user nova-compute[75080]:   </metadata>
Dec 05 15:38:17 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:38:17 user nova-compute[75080]:     <system>
Dec 05 15:38:17 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:38:17 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:38:17 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:38:17 user nova-compute[75080]:       <entry name="serial">675f9326-411b-4d0d-921c-f5375ffec457</entry>
Dec 05 15:38:17 user nova-compute[75080]:       <entry name="uuid">675f9326-411b-4d0d-921c-f5375ffec457</entry>
Dec 05 15:38:17 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:38:17 user nova-compute[75080]:     </system>
Dec 05 15:38:17 user nova-compute[75080]:   </sysinfo>
Dec 05 15:38:17 user nova-compute[75080]:   <os>
Dec 05 15:38:17 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:38:17 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:38:17 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:38:17 user nova-compute[75080]:   </os>
Dec 05 15:38:17 user nova-compute[75080]:   <features>
Dec 05 15:38:17 user nova-compute[75080]:     <acpi/>
Dec 05 15:38:17 user nova-compute[75080]:     <apic/>
Dec 05 15:38:17 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:38:17 user nova-compute[75080]:   </features>
Dec 05 15:38:17 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:38:17 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:38:17 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:38:17 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:38:17 user nova-compute[75080]:   </clock>
Dec 05 15:38:17 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:38:17 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:38:17 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:38:17 user nova-compute[75080]:   </cpu>
Dec 05 15:38:17 user nova-compute[75080]:   <devices>
Dec 05 15:38:17 user nova-compute[75080]:     <disk type="block" device="disk">
Dec 05 15:38:17 user nova-compute[75080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:38:17 user nova-compute[75080]:       <source dev="/dev/sdc"/>
Dec 05 15:38:17 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:38:17 user nova-compute[75080]:       <serial>5e132bcf-9292-494f-bd93-f747af60818b</serial>
Dec 05 15:38:17 user nova-compute[75080]:     </disk>
Dec 05 15:38:17 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:38:17 user nova-compute[75080]:       <mac address="fa:16:3e:76:b9:75"/>
Dec 05 15:38:17 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:38:17 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:38:17 user nova-compute[75080]:       <target dev="tape6fdf36d-c7"/>
Dec 05 15:38:17 user nova-compute[75080]:     </interface>
Dec 05 15:38:17 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:38:17 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/675f9326-411b-4d0d-921c-f5375ffec457/console.log" append="off"/>
Dec 05 15:38:17 user nova-compute[75080]:     </serial>
Dec 05 15:38:17 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:38:17 user nova-compute[75080]:     <video>
Dec 05 15:38:17 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:38:17 user nova-compute[75080]:     </video>
Dec 05 15:38:17 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:38:17 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:38:17 user nova-compute[75080]:     </rng>
Dec 05 15:38:17 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:38:17 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:38:17 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:38:17 user nova-compute[75080]:     </memballoon>
Dec 05 15:38:17 user nova-compute[75080]:   </devices>
Dec 05 15:38:17 user nova-compute[75080]: </domain>
Dec 05 15:38:17 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:38:17 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:38:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1207311612',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1207311612',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOHaSHjIWUzcs1FaMsetX+3Qdvz6+YCwRv1EvXdnmZXZwDLOl4AJxUX/t389zTETH0szJ2Ih2H3ox/1CCyz6EVUkTwws1K0LLBMLy8dIcwnjvHvzYMNik58gI35jDQnCw==',key_name='tempest-keypair-2048690446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99c63445ed4f466b8c00af6d9bc40e42',ramdisk_id='',reservation_id='r-hir48rfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1910922312',owner_user_name='tempest-ServerActionsV293TestJSON-1910922312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:38:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b1bbf8f0a8f44a3a5dc224bcf9e7139',uuid=675f9326-411b-4d0d-921c-f5375ffec457,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6fdf36d-c77d-4dbb-94c8-61d010e00884", "address": "fa:16:3e:76:b9:75", "network": {"id": "cab219d9-2a41-4553-9030-07efee59df1b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1667827966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c63445ed4f466b8c00af6d9bc40e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fdf36d-c7", "ovs_interfaceid": "e6fdf36d-c77d-4dbb-94c8-61d010e00884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:38:17 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Converting VIF {"id": "e6fdf36d-c77d-4dbb-94c8-61d010e00884", "address": "fa:16:3e:76:b9:75", "network": {"id": "cab219d9-2a41-4553-9030-07efee59df1b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1667827966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c63445ed4f466b8c00af6d9bc40e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fdf36d-c7", "ovs_interfaceid": "e6fdf36d-c77d-4dbb-94c8-61d010e00884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:38:17 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:b9:75,bridge_name='br-int',has_traffic_filtering=True,id=e6fdf36d-c77d-4dbb-94c8-61d010e00884,network=Network(cab219d9-2a41-4553-9030-07efee59df1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6fdf36d-c7') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:38:17 user nova-compute[75080]: DEBUG os_vif [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:b9:75,bridge_name='br-int',has_traffic_filtering=True,id=e6fdf36d-c77d-4dbb-94c8-61d010e00884,network=Network(cab219d9-2a41-4553-9030-07efee59df1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6fdf36d-c7') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:38:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:38:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:38:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab2c16e4-a4db-5342-a5f2-29774a51f8bd', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:38:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6fdf36d-c7, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:38:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape6fdf36d-c7, col_values=(('qos', UUID('cf72a1bd-d008-4dd6-981c-5eb6811e381f')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:38:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape6fdf36d-c7, col_values=(('external_ids', {'iface-id': 'e6fdf36d-c77d-4dbb-94c8-61d010e00884', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:b9:75', 'vm-uuid': '675f9326-411b-4d0d-921c-f5375ffec457'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:38:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:38:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:17 user nova-compute[75080]: INFO os_vif [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:b9:75,bridge_name='br-int',has_traffic_filtering=True,id=e6fdf36d-c77d-4dbb-94c8-61d010e00884,network=Network(cab219d9-2a41-4553-9030-07efee59df1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6fdf36d-c7')
Dec 05 15:38:17 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:38:17 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] No VIF found with MAC fa:16:3e:76:b9:75, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:38:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:19 user nova-compute[75080]: DEBUG nova.compute.manager [req-97a4b21e-e744-4a5b-bba7-4a678919ed69 req-4fed5777-0ef2-49cd-a614-644d955d2afd service nova] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Received event network-vif-plugged-e6fdf36d-c77d-4dbb-94c8-61d010e00884 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:38:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-97a4b21e-e744-4a5b-bba7-4a678919ed69 req-4fed5777-0ef2-49cd-a614-644d955d2afd service nova] Acquiring lock "675f9326-411b-4d0d-921c-f5375ffec457-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:38:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-97a4b21e-e744-4a5b-bba7-4a678919ed69 req-4fed5777-0ef2-49cd-a614-644d955d2afd service nova] Lock "675f9326-411b-4d0d-921c-f5375ffec457-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:38:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-97a4b21e-e744-4a5b-bba7-4a678919ed69 req-4fed5777-0ef2-49cd-a614-644d955d2afd service nova] Lock "675f9326-411b-4d0d-921c-f5375ffec457-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:38:19 user nova-compute[75080]: DEBUG nova.compute.manager [req-97a4b21e-e744-4a5b-bba7-4a678919ed69 req-4fed5777-0ef2-49cd-a614-644d955d2afd service nova] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] No waiting events found dispatching network-vif-plugged-e6fdf36d-c77d-4dbb-94c8-61d010e00884 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:38:19 user nova-compute[75080]: WARNING nova.compute.manager [req-97a4b21e-e744-4a5b-bba7-4a678919ed69 req-4fed5777-0ef2-49cd-a614-644d955d2afd service nova] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Received unexpected event network-vif-plugged-e6fdf36d-c77d-4dbb-94c8-61d010e00884 for instance with vm_state building and task_state spawning.
Dec 05 15:38:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:20 user nova-compute[75080]: DEBUG nova.compute.manager [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:38:20 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:38:20 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Instance spawned successfully.
Dec 05 15:38:20 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:38:20 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:38:20 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:38:20 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:38:20 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:38:20 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:38:20 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:38:21 user nova-compute[75080]: INFO nova.compute.manager [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Took 4.98 seconds to spawn the instance on the hypervisor.
Dec 05 15:38:21 user nova-compute[75080]: DEBUG nova.compute.manager [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:38:21 user nova-compute[75080]: DEBUG nova.compute.manager [req-071c0dae-02d3-48ea-a931-33f3ff361c6a req-568265fb-4494-4b7c-ac8e-48b523e789dd service nova] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Received event network-vif-plugged-e6fdf36d-c77d-4dbb-94c8-61d010e00884 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:38:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-071c0dae-02d3-48ea-a931-33f3ff361c6a req-568265fb-4494-4b7c-ac8e-48b523e789dd service nova] Acquiring lock "675f9326-411b-4d0d-921c-f5375ffec457-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:38:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-071c0dae-02d3-48ea-a931-33f3ff361c6a req-568265fb-4494-4b7c-ac8e-48b523e789dd service nova] Lock "675f9326-411b-4d0d-921c-f5375ffec457-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:38:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-071c0dae-02d3-48ea-a931-33f3ff361c6a req-568265fb-4494-4b7c-ac8e-48b523e789dd service nova] Lock "675f9326-411b-4d0d-921c-f5375ffec457-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:38:21 user nova-compute[75080]: DEBUG nova.compute.manager [req-071c0dae-02d3-48ea-a931-33f3ff361c6a req-568265fb-4494-4b7c-ac8e-48b523e789dd service nova] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] No waiting events found dispatching network-vif-plugged-e6fdf36d-c77d-4dbb-94c8-61d010e00884 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:38:21 user nova-compute[75080]: WARNING nova.compute.manager [req-071c0dae-02d3-48ea-a931-33f3ff361c6a req-568265fb-4494-4b7c-ac8e-48b523e789dd service nova] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Received unexpected event network-vif-plugged-e6fdf36d-c77d-4dbb-94c8-61d010e00884 for instance with vm_state building and task_state spawning.
Dec 05 15:38:21 user nova-compute[75080]: INFO nova.compute.manager [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Took 15.31 seconds to build instance.
Dec 05 15:38:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1eb65afb-a24d-4590-9522-8b001a6218f6 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Lock "675f9326-411b-4d0d-921c-f5375ffec457" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.497s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:38:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquiring lock "1e352b3b-ee04-42f6-af53-973c3154a342" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:38:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "1e352b3b-ee04-42f6-af53-973c3154a342" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:38:31 user nova-compute[75080]: DEBUG nova.objects.instance [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lazy-loading 'flavor' on Instance uuid 1e352b3b-ee04-42f6-af53-973c3154a342 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:38:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "1e352b3b-ee04-42f6-af53-973c3154a342" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:38:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquiring lock "1e352b3b-ee04-42f6-af53-973c3154a342" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:38:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "1e352b3b-ee04-42f6-af53-973c3154a342" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:38:31 user nova-compute[75080]: INFO nova.compute.manager [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Attaching volume 91cc30e8-ecf0-4547-853f-d34403b077af to /dev/vdb
Dec 05 15:38:31 user nova-compute[75080]: DEBUG os_brick.utils [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:38:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:31 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eca417d-d09b-4c6c-9be6-69280b56378e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:38:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:31 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f41f94-3efd-4f05-8ab8-5d220f96f952]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:38:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:31 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[25808c8a-89ce-4e39-ae78-bb9954c175c5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:38:31 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbcf5b7-1755-40e3-a388-69ba5d7aaaf1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:38:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:38:31 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:38:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:38:32 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:38:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98f046c-cea6-44db-8383-31433b8c4e5d]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:38:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:38:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:38:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:38:32 user nova-compute[75080]: DEBUG os_brick.utils [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:38:32 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Updating existing volume attachment record: 49c608db-d415-4b74-b95e-c4198a52bf84 {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:38:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:38:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 15:38:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:38:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:38:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b493ae82-9b34-414c-9ddf-374c2f0d8fc9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "011d3446-577a-4f5c-b8f0-ef04940cad17" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:38:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b493ae82-9b34-414c-9ddf-374c2f0d8fc9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:38:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b493ae82-9b34-414c-9ddf-374c2f0d8fc9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "011d3446-577a-4f5c-b8f0-ef04940cad17-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:38:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b493ae82-9b34-414c-9ddf-374c2f0d8fc9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:38:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b493ae82-9b34-414c-9ddf-374c2f0d8fc9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:38:33 user nova-compute[75080]: INFO nova.compute.manager [None req-b493ae82-9b34-414c-9ddf-374c2f0d8fc9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Terminating instance
Dec 05 15:38:33 user nova-compute[75080]: DEBUG nova.compute.manager [None req-b493ae82-9b34-414c-9ddf-374c2f0d8fc9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:38:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:34 user nova-compute[75080]: DEBUG nova.compute.manager [req-63773e7e-667a-424d-9501-41dbdf7c1c2a req-5657ad4a-e470-4680-a235-489d7ca208d4 service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Received event network-vif-unplugged-dfee0a0e-5241-4d51-879d-7667bb06344b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:38:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-63773e7e-667a-424d-9501-41dbdf7c1c2a req-5657ad4a-e470-4680-a235-489d7ca208d4 service nova] Acquiring lock "011d3446-577a-4f5c-b8f0-ef04940cad17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:38:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-63773e7e-667a-424d-9501-41dbdf7c1c2a req-5657ad4a-e470-4680-a235-489d7ca208d4 service nova] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:38:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-63773e7e-667a-424d-9501-41dbdf7c1c2a req-5657ad4a-e470-4680-a235-489d7ca208d4 service nova] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:38:34 user nova-compute[75080]: DEBUG nova.compute.manager [req-63773e7e-667a-424d-9501-41dbdf7c1c2a req-5657ad4a-e470-4680-a235-489d7ca208d4 service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] No waiting events found dispatching network-vif-unplugged-dfee0a0e-5241-4d51-879d-7667bb06344b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:38:34 user nova-compute[75080]: DEBUG nova.compute.manager [req-63773e7e-667a-424d-9501-41dbdf7c1c2a req-5657ad4a-e470-4680-a235-489d7ca208d4 service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Received event network-vif-unplugged-dfee0a0e-5241-4d51-879d-7667bb06344b for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:38:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:34 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Instance destroyed successfully.
Dec 05 15:38:34 user nova-compute[75080]: DEBUG nova.objects.instance [None req-b493ae82-9b34-414c-9ddf-374c2f0d8fc9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lazy-loading 'resources' on Instance uuid 011d3446-577a-4f5c-b8f0-ef04940cad17 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:38:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-b493ae82-9b34-414c-9ddf-374c2f0d8fc9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:28:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-215552341',display_name='tempest-AttachVolumeTestJSON-server-215552341',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-215552341',id=28,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNR5WqP/N7bn4T+SXNEWvIjtaw5+s7Hk+R+FM8SRLh86FpF209SN9UyEjy0e1+2DKmJSUEmh664j9n8POCm+HUQ9EtbpXmMRPj40zHqJTQgREs+C9f2zqAuxq3d0+o2xbw==',key_name='tempest-keypair-1745876029',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:28:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a01b18b2a93b457c8e160447d44a673e',ramdisk_id='',reservation_id='r-oe6cj9ox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1911411330',owner_user_name='tempest-AttachVolumeTestJSON-1911411330-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:36:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a02caebbfe541209b87adcbf848ede6',uuid=011d3446-577a-4f5c-b8f0-ef04940cad17,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfee0a0e-5241-4d51-879d-7667bb06344b", "address": "fa:16:3e:be:d6:bd", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfee0a0e-52", "ovs_interfaceid": "dfee0a0e-5241-4d51-879d-7667bb06344b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:38:34 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-b493ae82-9b34-414c-9ddf-374c2f0d8fc9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Converting VIF {"id": "dfee0a0e-5241-4d51-879d-7667bb06344b", "address": "fa:16:3e:be:d6:bd", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfee0a0e-52", "ovs_interfaceid": "dfee0a0e-5241-4d51-879d-7667bb06344b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:38:34 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-b493ae82-9b34-414c-9ddf-374c2f0d8fc9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:d6:bd,bridge_name='br-int',has_traffic_filtering=True,id=dfee0a0e-5241-4d51-879d-7667bb06344b,network=Network(3037e443-f4eb-446e-8a80-53f409b02ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfee0a0e-52') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:38:34 user nova-compute[75080]: DEBUG os_vif [None req-b493ae82-9b34-414c-9ddf-374c2f0d8fc9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:d6:bd,bridge_name='br-int',has_traffic_filtering=True,id=dfee0a0e-5241-4d51-879d-7667bb06344b,network=Network(3037e443-f4eb-446e-8a80-53f409b02ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfee0a0e-52') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:38:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfee0a0e-52, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:38:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:38:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=43300376-85ea-48a5-ba4a-3bce8bc0b9e8) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:38:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:34 user nova-compute[75080]: INFO os_vif [None req-b493ae82-9b34-414c-9ddf-374c2f0d8fc9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:d6:bd,bridge_name='br-int',has_traffic_filtering=True,id=dfee0a0e-5241-4d51-879d-7667bb06344b,network=Network(3037e443-f4eb-446e-8a80-53f409b02ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfee0a0e-52')
Dec 05 15:38:34 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-b493ae82-9b34-414c-9ddf-374c2f0d8fc9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Deleting instance files /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17_del
Dec 05 15:38:34 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-b493ae82-9b34-414c-9ddf-374c2f0d8fc9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Deletion of /opt/stack/data/nova/instances/011d3446-577a-4f5c-b8f0-ef04940cad17_del complete
Dec 05 15:38:34 user nova-compute[75080]: INFO nova.compute.manager [None req-b493ae82-9b34-414c-9ddf-374c2f0d8fc9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Took 0.66 seconds to destroy the instance on the hypervisor.
Dec 05 15:38:34 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-b493ae82-9b34-414c-9ddf-374c2f0d8fc9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:38:34 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:38:34 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:38:35 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:38:35 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Took 0.73 seconds to deallocate network for instance.
Dec 05 15:38:35 user nova-compute[75080]: DEBUG nova.compute.manager [req-7424e4f2-6d73-4d86-82f7-d6f59658eaed req-677d7dc8-90fa-4043-84cf-c8c2182ff8c2 service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Received event network-vif-deleted-dfee0a0e-5241-4d51-879d-7667bb06344b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:38:35 user nova-compute[75080]: INFO nova.compute.manager [req-7424e4f2-6d73-4d86-82f7-d6f59658eaed req-677d7dc8-90fa-4043-84cf-c8c2182ff8c2 service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Neutron deleted interface dfee0a0e-5241-4d51-879d-7667bb06344b; detaching it from the instance and deleting it from the info cache
Dec 05 15:38:35 user nova-compute[75080]: DEBUG nova.network.neutron [req-7424e4f2-6d73-4d86-82f7-d6f59658eaed req-677d7dc8-90fa-4043-84cf-c8c2182ff8c2 service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:38:35 user nova-compute[75080]: DEBUG nova.compute.manager [req-7424e4f2-6d73-4d86-82f7-d6f59658eaed req-677d7dc8-90fa-4043-84cf-c8c2182ff8c2 service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Detach interface failed, port_id=dfee0a0e-5241-4d51-879d-7667bb06344b, reason: Instance 011d3446-577a-4f5c-b8f0-ef04940cad17 could not be found. {{(pid=75080) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 15:38:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b493ae82-9b34-414c-9ddf-374c2f0d8fc9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:38:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b493ae82-9b34-414c-9ddf-374c2f0d8fc9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:38:35 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-b493ae82-9b34-414c-9ddf-374c2f0d8fc9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:38:35 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-b493ae82-9b34-414c-9ddf-374c2f0d8fc9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:38:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b493ae82-9b34-414c-9ddf-374c2f0d8fc9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.288s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:38:35 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-b493ae82-9b34-414c-9ddf-374c2f0d8fc9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Deleted allocations for instance 011d3446-577a-4f5c-b8f0-ef04940cad17
Dec 05 15:38:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b493ae82-9b34-414c-9ddf-374c2f0d8fc9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.960s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:38:36 user nova-compute[75080]: DEBUG nova.compute.manager [req-007027f8-1aa4-4597-9386-446f5fba3d3d req-d0a0cd14-45cb-4ab7-b0eb-4205632f7fd6 service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Received event network-vif-plugged-dfee0a0e-5241-4d51-879d-7667bb06344b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:38:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-007027f8-1aa4-4597-9386-446f5fba3d3d req-d0a0cd14-45cb-4ab7-b0eb-4205632f7fd6 service nova] Acquiring lock "011d3446-577a-4f5c-b8f0-ef04940cad17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:38:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-007027f8-1aa4-4597-9386-446f5fba3d3d req-d0a0cd14-45cb-4ab7-b0eb-4205632f7fd6 service nova] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:38:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-007027f8-1aa4-4597-9386-446f5fba3d3d req-d0a0cd14-45cb-4ab7-b0eb-4205632f7fd6 service nova] Lock "011d3446-577a-4f5c-b8f0-ef04940cad17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:38:36 user nova-compute[75080]: DEBUG nova.compute.manager [req-007027f8-1aa4-4597-9386-446f5fba3d3d req-d0a0cd14-45cb-4ab7-b0eb-4205632f7fd6 service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] No waiting events found dispatching network-vif-plugged-dfee0a0e-5241-4d51-879d-7667bb06344b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:38:36 user nova-compute[75080]: WARNING nova.compute.manager [req-007027f8-1aa4-4597-9386-446f5fba3d3d req-d0a0cd14-45cb-4ab7-b0eb-4205632f7fd6 service nova] [instance: 011d3446-577a-4f5c-b8f0-ef04940cad17] Received unexpected event network-vif-plugged-dfee0a0e-5241-4d51-879d-7667bb06344b for instance with vm_state deleted and task_state None.
Dec 05 15:38:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:39 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:38:39 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75080) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 05 15:38:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:40 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:38:40 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:38:40 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Cleaning up deleted instances {{(pid=75080) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 05 15:38:40 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] There are 0 instances to clean {{(pid=75080) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BIKxwXhb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:38:41 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:38:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:38:41 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:38:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:38:41 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:38:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbae692-6997-438b-9fc8-34bc31219bfd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:38:41 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[116d807e-1535-47a6-8c90-d8c70596197c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af] added
Dec 05 15:38:41 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c5f0ef-69a8-4edc-9f34-9b9f0f4bd9dc]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bed22af-7a2f-499f-8447-07a8d69d6bad]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BIKxwXhb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BIKxwXhb" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a825b25-77e9-4a18-a0c3-ebd1553b42ac]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BIKxwXhb'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2759344b-69c1-4f57-b85c-a182c24af0bd]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b912a8-7601-4424-9e6d-2c21515f2e4d]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:38:41 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:38:41 user nova-compute[75080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)
Dec 05 15:38:41 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:38:41 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:38:41 user nova-compute[75080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)
Dec 05 15:38:41 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3371ba-3319-409e-928b-51c933223e3f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af, portal: 172.16.0.220,3260]
Dec 05 15:38:41 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af, portal: 172.16.0.220,3260] successful.
Dec 05 15:38:41 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5732478-3dcb-4cba-bd56-84c4a057b6b8]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56d8792-5d2a-4ac4-85db-c5343d199205]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:38:41 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:38:41 user nova-compute[75080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)
Dec 05 15:38:41 user nova-compute[75080]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af (non-flash)
Dec 05 15:38:41 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:38:41 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:38:41 user nova-compute[75080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)
Dec 05 15:38:41 user nova-compute[75080]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af (non-flash)
Dec 05 15:38:41 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0849a2-9e6f-497d-90df-f0e1c565e9ba]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:38:41 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: None {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:38:42 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:38:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:42 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:38:42 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BIKxwXhb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:38:42 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:38:42 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26163336531316336', 'path': '/dev/sdd'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:38:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163336531316336', 'path': '/dev/sdd'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:38:42 user nova-compute[75080]: DEBUG nova.objects.instance [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lazy-loading 'flavor' on Instance uuid 1e352b3b-ee04-42f6-af53-973c3154a342 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:38:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 15:38:42 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:38:42 user nova-compute[75080]:   <source dev="/dev/sdd"/>
Dec 05 15:38:42 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:38:42 user nova-compute[75080]:   <serial>91cc30e8-ecf0-4547-853f-d34403b077af</serial>
Dec 05 15:38:42 user nova-compute[75080]: </disk>
Dec 05 15:38:42 user nova-compute[75080]:  {{(pid=75080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 15:38:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "b5a4b977-1e76-45c7-bf97-b4db5fb615e2" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:38:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "b5a4b977-1e76-45c7-bf97-b4db5fb615e2" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:38:43 user nova-compute[75080]: INFO nova.compute.manager [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Unshelving
Dec 05 15:38:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:38:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:38:43 user nova-compute[75080]: DEBUG nova.objects.instance [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lazy-loading 'pci_requests' on Instance uuid b5a4b977-1e76-45c7-bf97-b4db5fb615e2 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:38:43 user nova-compute[75080]: DEBUG nova.objects.instance [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lazy-loading 'numa_topology' on Instance uuid b5a4b977-1e76-45c7-bf97-b4db5fb615e2 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:38:43 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:38:43 user nova-compute[75080]: INFO nova.compute.claims [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Claim successful on node user
Dec 05 15:38:43 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:38:43 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:38:43 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] No VIF found with MAC fa:16:3e:47:d3:7c, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:38:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f35ef746-5c2d-48bf-bd25-319836905d12 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "1e352b3b-ee04-42f6-af53-973c3154a342" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.619s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:38:43 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:38:43 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:38:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.379s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:38:43 user nova-compute[75080]: INFO nova.network.neutron [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Updating port 4fcca870-3cc7-4338-b912-84e32dc7d4c0 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Dec 05 15:38:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "refresh_cache-b5a4b977-1e76-45c7-bf97-b4db5fb615e2" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:38:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquired lock "refresh_cache-b5a4b977-1e76-45c7-bf97-b4db5fb615e2" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:38:44 user nova-compute[75080]: DEBUG nova.network.neutron [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:38:44 user nova-compute[75080]: DEBUG nova.compute.manager [req-44b3a6be-786a-4a46-890e-72d9634ca596 req-c47fa945-4f74-4da4-b40c-914f43174cf5 service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Received event network-changed-4fcca870-3cc7-4338-b912-84e32dc7d4c0 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:38:44 user nova-compute[75080]: DEBUG nova.compute.manager [req-44b3a6be-786a-4a46-890e-72d9634ca596 req-c47fa945-4f74-4da4-b40c-914f43174cf5 service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Refreshing instance network info cache due to event network-changed-4fcca870-3cc7-4338-b912-84e32dc7d4c0. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:38:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-44b3a6be-786a-4a46-890e-72d9634ca596 req-c47fa945-4f74-4da4-b40c-914f43174cf5 service nova] Acquiring lock "refresh_cache-b5a4b977-1e76-45c7-bf97-b4db5fb615e2" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:38:44 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:38:44 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:38:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-b47129e8-c02b-4107-af4f-329173dd453f" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:38:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-b47129e8-c02b-4107-af4f-329173dd453f" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:38:44 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 15:38:45 user nova-compute[75080]: DEBUG nova.network.neutron [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Updating instance_info_cache with network_info: [{"id": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "address": "fa:16:3e:c3:a0:3b", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fcca870-3c", "ovs_interfaceid": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:38:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Releasing lock "refresh_cache-b5a4b977-1e76-45c7-bf97-b4db5fb615e2" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:38:45 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:38:45 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Creating image(s)
Dec 05 15:38:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:38:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "/opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:38:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "/opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:38:45 user nova-compute[75080]: DEBUG nova.objects.instance [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lazy-loading 'trusted_certs' on Instance uuid b5a4b977-1e76-45c7-bf97-b4db5fb615e2 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:38:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-44b3a6be-786a-4a46-890e-72d9634ca596 req-c47fa945-4f74-4da4-b40c-914f43174cf5 service nova] Acquired lock "refresh_cache-b5a4b977-1e76-45c7-bf97-b4db5fb615e2" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:38:45 user nova-compute[75080]: DEBUG nova.network.neutron [req-44b3a6be-786a-4a46-890e-72d9634ca596 req-c47fa945-4f74-4da4-b40c-914f43174cf5 service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Refreshing network info cache for port 4fcca870-3cc7-4338-b912-84e32dc7d4c0 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:38:45 user nova-compute[75080]: DEBUG nova.objects.base [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Object Instance<b5a4b977-1e76-45c7-bf97-b4db5fb615e2> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:38:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "37ea81c1c9d0902561967135c472dc0a71c01997" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:38:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "37ea81c1c9d0902561967135c472dc0a71c01997" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:38:45 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Updating instance_info_cache with network_info: [{"id": "c926ed6d-3eed-4727-9a0f-5a9f76c85982", "address": "fa:16:3e:37:91:eb", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc926ed6d-3e", "ovs_interfaceid": "c926ed6d-3eed-4727-9a0f-5a9f76c85982", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:38:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-b47129e8-c02b-4107-af4f-329173dd453f" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:38:45 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 15:38:45 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:38:45 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:38:45 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:38:45 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:38:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:38:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:38:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:38:45 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:38:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37ea81c1c9d0902561967135c472dc0a71c01997.part --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37ea81c1c9d0902561967135c472dc0a71c01997.part --force-share --output=json" returned: 0 in 0.194s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:46 user nova-compute[75080]: DEBUG nova.virt.images [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] 329c8153-7c86-428d-b8f3-e65df9c45c7c was qcow2, converting to raw {{(pid=75080) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 05 15:38:46 user nova-compute[75080]: DEBUG nova.privsep.utils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75080) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 15:38:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/37ea81c1c9d0902561967135c472dc0a71c01997.part /opt/stack/data/nova/instances/_base/37ea81c1c9d0902561967135c472dc0a71c01997.converted {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:38:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0331194-6106-4621-ab60-94bcf681222e/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:46 user nova-compute[75080]: DEBUG nova.network.neutron [req-44b3a6be-786a-4a46-890e-72d9634ca596 req-c47fa945-4f74-4da4-b40c-914f43174cf5 service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Updated VIF entry in instance network info cache for port 4fcca870-3cc7-4338-b912-84e32dc7d4c0. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:38:46 user nova-compute[75080]: DEBUG nova.network.neutron [req-44b3a6be-786a-4a46-890e-72d9634ca596 req-c47fa945-4f74-4da4-b40c-914f43174cf5 service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Updating instance_info_cache with network_info: [{"id": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "address": "fa:16:3e:c3:a0:3b", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fcca870-3c", "ovs_interfaceid": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:38:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-44b3a6be-786a-4a46-890e-72d9634ca596 req-c47fa945-4f74-4da4-b40c-914f43174cf5 service nova] Releasing lock "refresh_cache-b5a4b977-1e76-45c7-bf97-b4db5fb615e2" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:38:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0331194-6106-4621-ab60-94bcf681222e/disk.rescue --force-share --output=json" returned: 0 in 0.257s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0331194-6106-4621-ab60-94bcf681222e/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0331194-6106-4621-ab60-94bcf681222e/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:47 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:38:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/37ea81c1c9d0902561967135c472dc0a71c01997.part /opt/stack/data/nova/instances/_base/37ea81c1c9d0902561967135c472dc0a71c01997.converted" returned: 0 in 0.984s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37ea81c1c9d0902561967135c472dc0a71c01997.converted --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37ea81c1c9d0902561967135c472dc0a71c01997.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "37ea81c1c9d0902561967135c472dc0a71c01997" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.656s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:38:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37ea81c1c9d0902561967135c472dc0a71c01997 --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:47 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:38:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe780f8f-12ad-49c7-92f1-547694e4755e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37ea81c1c9d0902561967135c472dc0a71c01997 --force-share --output=json" returned: 0 in 0.177s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "37ea81c1c9d0902561967135c472dc0a71c01997" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:38:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "37ea81c1c9d0902561967135c472dc0a71c01997" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:38:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37ea81c1c9d0902561967135c472dc0a71c01997 --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe780f8f-12ad-49c7-92f1-547694e4755e/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe780f8f-12ad-49c7-92f1-547694e4755e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37ea81c1c9d0902561967135c472dc0a71c01997 --force-share --output=json" returned: 0 in 0.176s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37ea81c1c9d0902561967135c472dc0a71c01997,backing_fmt=raw /opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37ea81c1c9d0902561967135c472dc0a71c01997,backing_fmt=raw /opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2/disk 1073741824" returned: 0 in 0.064s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "37ea81c1c9d0902561967135c472dc0a71c01997" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:38:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37ea81c1c9d0902561967135c472dc0a71c01997 --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe780f8f-12ad-49c7-92f1-547694e4755e/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37ea81c1c9d0902561967135c472dc0a71c01997 --force-share --output=json" returned: 0 in 0.177s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:48 user nova-compute[75080]: DEBUG nova.objects.instance [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lazy-loading 'migration_context' on Instance uuid b5a4b977-1e76-45c7-bf97-b4db5fb615e2 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:38:48 user nova-compute[75080]: DEBUG nova.objects.base [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Object Instance<b5a4b977-1e76-45c7-bf97-b4db5fb615e2> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:38:48 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Rebasing disk image.
Dec 05 15:38:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.168s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee -F raw /opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2/disk {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:38:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:48 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:38:48 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:38:48 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:38:48 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=8089MB free_disk=24.79970932006836GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:38:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:38:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:38:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 07b025ff-4a9d-48a2-b950-b8f2d165f33c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:38:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance ab882db7-e6d7-44ca-9ea4-ae2fa68f7929 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:38:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance b47129e8-c02b-4107-af4f-329173dd453f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:38:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance e0331194-6106-4621-ab60-94bcf681222e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:38:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 1e352b3b-ee04-42f6-af53-973c3154a342 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:38:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance fe780f8f-12ad-49c7-92f1-547694e4755e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:38:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 675f9326-411b-4d0d-921c-f5375ffec457 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:38:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance b5a4b977-1e76-45c7-bf97-b4db5fb615e2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:38:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:38:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:38:49 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing inventories for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 05 15:38:49 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Updating ProviderTree inventory for provider 21b770fa-b774-46c9-9415-db26064ccd0f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 05 15:38:49 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Updating inventory in ProviderTree for provider 21b770fa-b774-46c9-9415-db26064ccd0f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 15:38:49 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing aggregate associations for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f, aggregates: None {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 05 15:38:49 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing trait associations for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f, traits: COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 05 15:38:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:49 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:38:49 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:38:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:38:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.659s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:38:49 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:38:49 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:38:49 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee -F raw /opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2/disk" returned: 0 in 2.098s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Ensure instance console log exists: /opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Start _get_guest_xml network_info=[{"id": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "address": "fa:16:3e:c3:a0:3b", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fcca870-3c", "ovs_interfaceid": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='84cf5d0c48a5dd789dbf7bde091eea20',container_format='bare',created_at=2023-12-05T15:36:50Z,direct_url=<?>,disk_format='qcow2',id=329c8153-7c86-428d-b8f3-e65df9c45c7c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-951113717-shelved',owner='6350b8a7b0ce4af7b83a280c0c1ec3e6',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-12-05T15:36:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:38:50 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:38:50 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:38:50 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='84cf5d0c48a5dd789dbf7bde091eea20',container_format='bare',created_at=2023-12-05T15:36:50Z,direct_url=<?>,disk_format='qcow2',id=329c8153-7c86-428d-b8f3-e65df9c45c7c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-951113717-shelved',owner='6350b8a7b0ce4af7b83a280c0c1ec3e6',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-12-05T15:36:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG nova.objects.instance [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lazy-loading 'vcpu_model' on Instance uuid b5a4b977-1e76-45c7-bf97-b4db5fb615e2 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG nova.objects.base [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Object Instance<b5a4b977-1e76-45c7-bf97-b4db5fb615e2> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T15:34:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-951113717',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-951113717',id=35,image_ref='329c8153-7c86-428d-b8f3-e65df9c45c7c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-331505788',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:35:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6350b8a7b0ce4af7b83a280c0c1ec3e6',ramdisk_id='',reservation_id='r-goq5cviw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-132988477',owner_user_name='tempest-AttachVolumeShelveTestJSON-132988477-project-member',shelved_at='2023-12-05T15:36:55.320477',shelved_host='user',shelved_image_id='329c8153-7c86-428d-b8f3-e65df9c45c7c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:38:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72a1c29faca44a4095dbda09561e5a91',uuid=b5a4b977-1e76-45c7-bf97-b4db5fb615e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "address": "fa:16:3e:c3:a0:3b", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fcca870-3c", "ovs_interfaceid": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Converting VIF {"id": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "address": "fa:16:3e:c3:a0:3b", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fcca870-3c", "ovs_interfaceid": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a0:3b,bridge_name='br-int',has_traffic_filtering=True,id=4fcca870-3cc7-4338-b912-84e32dc7d4c0,network=Network(b94a6985-25b3-480e-b79f-b753c8b23fa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fcca870-3c') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG nova.objects.instance [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lazy-loading 'pci_devices' on Instance uuid b5a4b977-1e76-45c7-bf97-b4db5fb615e2 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG nova.objects.base [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Object Instance<b5a4b977-1e76-45c7-bf97-b4db5fb615e2> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:38:50 user nova-compute[75080]:   <uuid>b5a4b977-1e76-45c7-bf97-b4db5fb615e2</uuid>
Dec 05 15:38:50 user nova-compute[75080]:   <name>instance-00000023</name>
Dec 05 15:38:50 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:38:50 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:38:50 user nova-compute[75080]:   <metadata>
Dec 05 15:38:50 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:38:50 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:38:50 user nova-compute[75080]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-951113717</nova:name>
Dec 05 15:38:50 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:38:50</nova:creationTime>
Dec 05 15:38:50 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:38:50 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:38:50 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:38:50 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:38:50 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:38:50 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:38:50 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:38:50 user nova-compute[75080]:       <nova:owner>
Dec 05 15:38:50 user nova-compute[75080]:         <nova:user uuid="72a1c29faca44a4095dbda09561e5a91">tempest-AttachVolumeShelveTestJSON-132988477-project-member</nova:user>
Dec 05 15:38:50 user nova-compute[75080]:         <nova:project uuid="6350b8a7b0ce4af7b83a280c0c1ec3e6">tempest-AttachVolumeShelveTestJSON-132988477</nova:project>
Dec 05 15:38:50 user nova-compute[75080]:       </nova:owner>
Dec 05 15:38:50 user nova-compute[75080]:       <nova:root type="image" uuid="329c8153-7c86-428d-b8f3-e65df9c45c7c"/>
Dec 05 15:38:50 user nova-compute[75080]:       <nova:ports>
Dec 05 15:38:50 user nova-compute[75080]:         <nova:port uuid="4fcca870-3cc7-4338-b912-84e32dc7d4c0">
Dec 05 15:38:50 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 05 15:38:50 user nova-compute[75080]:         </nova:port>
Dec 05 15:38:50 user nova-compute[75080]:       </nova:ports>
Dec 05 15:38:50 user nova-compute[75080]:     </nova:instance>
Dec 05 15:38:50 user nova-compute[75080]:   </metadata>
Dec 05 15:38:50 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:38:50 user nova-compute[75080]:     <system>
Dec 05 15:38:50 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:38:50 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:38:50 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:38:50 user nova-compute[75080]:       <entry name="serial">b5a4b977-1e76-45c7-bf97-b4db5fb615e2</entry>
Dec 05 15:38:50 user nova-compute[75080]:       <entry name="uuid">b5a4b977-1e76-45c7-bf97-b4db5fb615e2</entry>
Dec 05 15:38:50 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:38:50 user nova-compute[75080]:     </system>
Dec 05 15:38:50 user nova-compute[75080]:   </sysinfo>
Dec 05 15:38:50 user nova-compute[75080]:   <os>
Dec 05 15:38:50 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:38:50 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:38:50 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:38:50 user nova-compute[75080]:   </os>
Dec 05 15:38:50 user nova-compute[75080]:   <features>
Dec 05 15:38:50 user nova-compute[75080]:     <acpi/>
Dec 05 15:38:50 user nova-compute[75080]:     <apic/>
Dec 05 15:38:50 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:38:50 user nova-compute[75080]:   </features>
Dec 05 15:38:50 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:38:50 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:38:50 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:38:50 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:38:50 user nova-compute[75080]:   </clock>
Dec 05 15:38:50 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:38:50 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:38:50 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:38:50 user nova-compute[75080]:   </cpu>
Dec 05 15:38:50 user nova-compute[75080]:   <devices>
Dec 05 15:38:50 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:38:50 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:38:50 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2/disk"/>
Dec 05 15:38:50 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:38:50 user nova-compute[75080]:     </disk>
Dec 05 15:38:50 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:38:50 user nova-compute[75080]:       <mac address="fa:16:3e:c3:a0:3b"/>
Dec 05 15:38:50 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:38:50 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:38:50 user nova-compute[75080]:       <target dev="tap4fcca870-3c"/>
Dec 05 15:38:50 user nova-compute[75080]:     </interface>
Dec 05 15:38:50 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:38:50 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2/console.log" append="off"/>
Dec 05 15:38:50 user nova-compute[75080]:     </serial>
Dec 05 15:38:50 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:38:50 user nova-compute[75080]:     <video>
Dec 05 15:38:50 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:38:50 user nova-compute[75080]:     </video>
Dec 05 15:38:50 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:38:50 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:38:50 user nova-compute[75080]:     </rng>
Dec 05 15:38:50 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:38:50 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:38:50 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:38:50 user nova-compute[75080]:     </memballoon>
Dec 05 15:38:50 user nova-compute[75080]:   </devices>
Dec 05 15:38:50 user nova-compute[75080]: </domain>
Dec 05 15:38:50 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T15:34:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-951113717',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-951113717',id=35,image_ref='329c8153-7c86-428d-b8f3-e65df9c45c7c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-331505788',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:35:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6350b8a7b0ce4af7b83a280c0c1ec3e6',ramdisk_id='',reservation_id='r-goq5cviw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-132988477',owner_user_name='tempest-AttachVolumeShelveTestJSON-132988477-project-member',shelved_at='2023-12-05T15:36:55.320477',shelved_host='user',shelved_image_id='329c8153-7c86-428d-b8f3-e65df9c45c7c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:38:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72a1c29faca44a4095dbda09561e5a91',uuid=b5a4b977-1e76-45c7-bf97-b4db5fb615e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "address": "fa:16:3e:c3:a0:3b", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fcca870-3c", "ovs_interfaceid": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Converting VIF {"id": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "address": "fa:16:3e:c3:a0:3b", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fcca870-3c", "ovs_interfaceid": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a0:3b,bridge_name='br-int',has_traffic_filtering=True,id=4fcca870-3cc7-4338-b912-84e32dc7d4c0,network=Network(b94a6985-25b3-480e-b79f-b753c8b23fa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fcca870-3c') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG os_vif [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a0:3b,bridge_name='br-int',has_traffic_filtering=True,id=4fcca870-3cc7-4338-b912-84e32dc7d4c0,network=Network(b94a6985-25b3-480e-b79f-b753c8b23fa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fcca870-3c') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd7373c10-9052-56ea-a4c9-4b652ac6bebd', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4fcca870-3c, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4fcca870-3c, col_values=(('qos', UUID('128334ae-a46b-48ab-a889-6b15942917c9')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4fcca870-3c, col_values=(('external_ids', {'iface-id': '4fcca870-3cc7-4338-b912-84e32dc7d4c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:a0:3b', 'vm-uuid': 'b5a4b977-1e76-45c7-bf97-b4db5fb615e2'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:50 user nova-compute[75080]: INFO os_vif [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a0:3b,bridge_name='br-int',has_traffic_filtering=True,id=4fcca870-3cc7-4338-b912-84e32dc7d4c0,network=Network(b94a6985-25b3-480e-b79f-b753c8b23fa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fcca870-3c')
Dec 05 15:38:50 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:38:50 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] No VIF found with MAC fa:16:3e:c3:a0:3b, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:38:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-996a6edc-7a54-426f-8310-4efb78ef4f9d req-b74b6204-c6b6-4f77-9253-d4ee6f337c01 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Received event network-changed-b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:38:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-996a6edc-7a54-426f-8310-4efb78ef4f9d req-b74b6204-c6b6-4f77-9253-d4ee6f337c01 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Refreshing instance network info cache due to event network-changed-b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:38:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-996a6edc-7a54-426f-8310-4efb78ef4f9d req-b74b6204-c6b6-4f77-9253-d4ee6f337c01 service nova] Acquiring lock "refresh_cache-1e352b3b-ee04-42f6-af53-973c3154a342" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:38:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-996a6edc-7a54-426f-8310-4efb78ef4f9d req-b74b6204-c6b6-4f77-9253-d4ee6f337c01 service nova] Acquired lock "refresh_cache-1e352b3b-ee04-42f6-af53-973c3154a342" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:38:51 user nova-compute[75080]: DEBUG nova.network.neutron [req-996a6edc-7a54-426f-8310-4efb78ef4f9d req-b74b6204-c6b6-4f77-9253-d4ee6f337c01 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Refreshing network info cache for port b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:38:51 user nova-compute[75080]: DEBUG nova.network.neutron [req-996a6edc-7a54-426f-8310-4efb78ef4f9d req-b74b6204-c6b6-4f77-9253-d4ee6f337c01 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Updated VIF entry in instance network info cache for port b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:38:51 user nova-compute[75080]: DEBUG nova.network.neutron [req-996a6edc-7a54-426f-8310-4efb78ef4f9d req-b74b6204-c6b6-4f77-9253-d4ee6f337c01 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Updating instance_info_cache with network_info: [{"id": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "address": "fa:16:3e:47:d3:7c", "network": {"id": "1151f7c9-f853-4f06-93d7-74536b8b12ac", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420489370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549e67b7f2574eb38f3395452b647de7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1a68f60-ce", "ovs_interfaceid": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:38:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-996a6edc-7a54-426f-8310-4efb78ef4f9d req-b74b6204-c6b6-4f77-9253-d4ee6f337c01 service nova] Releasing lock "refresh_cache-1e352b3b-ee04-42f6-af53-973c3154a342" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:38:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:52 user nova-compute[75080]: DEBUG nova.compute.manager [req-4efc1005-9171-4873-9e0d-b7adf885c8ea req-bdd6632a-8d53-4b7a-b875-e3d45e717630 service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Received event network-vif-plugged-4fcca870-3cc7-4338-b912-84e32dc7d4c0 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:38:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4efc1005-9171-4873-9e0d-b7adf885c8ea req-bdd6632a-8d53-4b7a-b875-e3d45e717630 service nova] Acquiring lock "b5a4b977-1e76-45c7-bf97-b4db5fb615e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:38:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4efc1005-9171-4873-9e0d-b7adf885c8ea req-bdd6632a-8d53-4b7a-b875-e3d45e717630 service nova] Lock "b5a4b977-1e76-45c7-bf97-b4db5fb615e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:38:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4efc1005-9171-4873-9e0d-b7adf885c8ea req-bdd6632a-8d53-4b7a-b875-e3d45e717630 service nova] Lock "b5a4b977-1e76-45c7-bf97-b4db5fb615e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:38:52 user nova-compute[75080]: DEBUG nova.compute.manager [req-4efc1005-9171-4873-9e0d-b7adf885c8ea req-bdd6632a-8d53-4b7a-b875-e3d45e717630 service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] No waiting events found dispatching network-vif-plugged-4fcca870-3cc7-4338-b912-84e32dc7d4c0 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:38:52 user nova-compute[75080]: WARNING nova.compute.manager [req-4efc1005-9171-4873-9e0d-b7adf885c8ea req-bdd6632a-8d53-4b7a-b875-e3d45e717630 service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Received unexpected event network-vif-plugged-4fcca870-3cc7-4338-b912-84e32dc7d4c0 for instance with vm_state shelved_offloaded and task_state spawning.
Dec 05 15:38:52 user nova-compute[75080]: INFO nova.compute.manager [None req-20af96b5-d1c8-4236-9480-49bf4a2e8d70 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Unrescuing
Dec 05 15:38:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-20af96b5-d1c8-4236-9480-49bf4a2e8d70 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "refresh_cache-e0331194-6106-4621-ab60-94bcf681222e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:38:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-20af96b5-d1c8-4236-9480-49bf4a2e8d70 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquired lock "refresh_cache-e0331194-6106-4621-ab60-94bcf681222e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:38:52 user nova-compute[75080]: DEBUG nova.network.neutron [None req-20af96b5-d1c8-4236-9480-49bf4a2e8d70 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:38:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:53 user nova-compute[75080]: DEBUG nova.network.neutron [None req-20af96b5-d1c8-4236-9480-49bf4a2e8d70 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Updating instance_info_cache with network_info: [{"id": "12153aa9-8336-46dc-8491-6c28da3646a3", "address": "fa:16:3e:0d:84:cd", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12153aa9-83", "ovs_interfaceid": "12153aa9-8336-46dc-8491-6c28da3646a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:38:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-20af96b5-d1c8-4236-9480-49bf4a2e8d70 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Releasing lock "refresh_cache-e0331194-6106-4621-ab60-94bcf681222e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:38:53 user nova-compute[75080]: DEBUG nova.objects.instance [None req-20af96b5-d1c8-4236-9480-49bf4a2e8d70 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lazy-loading 'flavor' on Instance uuid e0331194-6106-4621-ab60-94bcf681222e {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:38:53 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:38:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:53 user nova-compute[75080]: DEBUG nova.compute.manager [req-f3a552c4-4110-48da-9c28-4ffe683efe50 req-d4524b15-2619-48d8-bacd-44c945a4da60 service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] Received event network-vif-unplugged-12153aa9-8336-46dc-8491-6c28da3646a3 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:38:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f3a552c4-4110-48da-9c28-4ffe683efe50 req-d4524b15-2619-48d8-bacd-44c945a4da60 service nova] Acquiring lock "e0331194-6106-4621-ab60-94bcf681222e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:38:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f3a552c4-4110-48da-9c28-4ffe683efe50 req-d4524b15-2619-48d8-bacd-44c945a4da60 service nova] Lock "e0331194-6106-4621-ab60-94bcf681222e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:38:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f3a552c4-4110-48da-9c28-4ffe683efe50 req-d4524b15-2619-48d8-bacd-44c945a4da60 service nova] Lock "e0331194-6106-4621-ab60-94bcf681222e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:38:53 user nova-compute[75080]: DEBUG nova.compute.manager [req-f3a552c4-4110-48da-9c28-4ffe683efe50 req-d4524b15-2619-48d8-bacd-44c945a4da60 service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] No waiting events found dispatching network-vif-unplugged-12153aa9-8336-46dc-8491-6c28da3646a3 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:38:53 user nova-compute[75080]: WARNING nova.compute.manager [req-f3a552c4-4110-48da-9c28-4ffe683efe50 req-d4524b15-2619-48d8-bacd-44c945a4da60 service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] Received unexpected event network-vif-unplugged-12153aa9-8336-46dc-8491-6c28da3646a3 for instance with vm_state rescued and task_state unrescuing.
Dec 05 15:38:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:54 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: e0331194-6106-4621-ab60-94bcf681222e] Instance destroyed successfully.
Dec 05 15:38:54 user nova-compute[75080]: DEBUG nova.compute.manager [req-92577e58-de47-4e94-bc62-891fb043c1a7 req-8fd1605b-d67b-4a32-a001-53e656d6dcd2 service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Received event network-vif-plugged-4fcca870-3cc7-4338-b912-84e32dc7d4c0 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:38:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-92577e58-de47-4e94-bc62-891fb043c1a7 req-8fd1605b-d67b-4a32-a001-53e656d6dcd2 service nova] Acquiring lock "b5a4b977-1e76-45c7-bf97-b4db5fb615e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:38:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-92577e58-de47-4e94-bc62-891fb043c1a7 req-8fd1605b-d67b-4a32-a001-53e656d6dcd2 service nova] Lock "b5a4b977-1e76-45c7-bf97-b4db5fb615e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:38:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-92577e58-de47-4e94-bc62-891fb043c1a7 req-8fd1605b-d67b-4a32-a001-53e656d6dcd2 service nova] Lock "b5a4b977-1e76-45c7-bf97-b4db5fb615e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:38:54 user nova-compute[75080]: DEBUG nova.compute.manager [req-92577e58-de47-4e94-bc62-891fb043c1a7 req-8fd1605b-d67b-4a32-a001-53e656d6dcd2 service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] No waiting events found dispatching network-vif-plugged-4fcca870-3cc7-4338-b912-84e32dc7d4c0 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:38:54 user nova-compute[75080]: WARNING nova.compute.manager [req-92577e58-de47-4e94-bc62-891fb043c1a7 req-8fd1605b-d67b-4a32-a001-53e656d6dcd2 service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Received unexpected event network-vif-plugged-4fcca870-3cc7-4338-b912-84e32dc7d4c0 for instance with vm_state shelved_offloaded and task_state spawning.
Dec 05 15:38:54 user nova-compute[75080]: DEBUG nova.compute.manager [req-92577e58-de47-4e94-bc62-891fb043c1a7 req-8fd1605b-d67b-4a32-a001-53e656d6dcd2 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Received event network-changed-b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:38:54 user nova-compute[75080]: DEBUG nova.compute.manager [req-92577e58-de47-4e94-bc62-891fb043c1a7 req-8fd1605b-d67b-4a32-a001-53e656d6dcd2 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Refreshing instance network info cache due to event network-changed-b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:38:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-92577e58-de47-4e94-bc62-891fb043c1a7 req-8fd1605b-d67b-4a32-a001-53e656d6dcd2 service nova] Acquiring lock "refresh_cache-1e352b3b-ee04-42f6-af53-973c3154a342" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:38:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-92577e58-de47-4e94-bc62-891fb043c1a7 req-8fd1605b-d67b-4a32-a001-53e656d6dcd2 service nova] Acquired lock "refresh_cache-1e352b3b-ee04-42f6-af53-973c3154a342" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:38:54 user nova-compute[75080]: DEBUG nova.network.neutron [req-92577e58-de47-4e94-bc62-891fb043c1a7 req-8fd1605b-d67b-4a32-a001-53e656d6dcd2 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Refreshing network info cache for port b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:38:54 user nova-compute[75080]: DEBUG nova.compute.manager [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:38:54 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:38:54 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Instance spawned successfully.
Dec 05 15:38:54 user nova-compute[75080]: DEBUG nova.compute.manager [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:38:55 user nova-compute[75080]: DEBUG nova.network.neutron [req-92577e58-de47-4e94-bc62-891fb043c1a7 req-8fd1605b-d67b-4a32-a001-53e656d6dcd2 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Updated VIF entry in instance network info cache for port b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:38:55 user nova-compute[75080]: DEBUG nova.network.neutron [req-92577e58-de47-4e94-bc62-891fb043c1a7 req-8fd1605b-d67b-4a32-a001-53e656d6dcd2 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Updating instance_info_cache with network_info: [{"id": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "address": "fa:16:3e:47:d3:7c", "network": {"id": "1151f7c9-f853-4f06-93d7-74536b8b12ac", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420489370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549e67b7f2574eb38f3395452b647de7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1a68f60-ce", "ovs_interfaceid": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:38:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c68b2d4d-4891-4eea-a1e4-061075cfa030 tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "b5a4b977-1e76-45c7-bf97-b4db5fb615e2" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.845s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:38:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-92577e58-de47-4e94-bc62-891fb043c1a7 req-8fd1605b-d67b-4a32-a001-53e656d6dcd2 service nova] Releasing lock "refresh_cache-1e352b3b-ee04-42f6-af53-973c3154a342" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:38:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:55 user nova-compute[75080]: DEBUG nova.compute.manager [req-be3e12d3-624f-4738-9fdb-a78c71510bcf req-78efd0f8-579c-438d-a3e3-ea9603e4e088 service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] Received event network-vif-plugged-12153aa9-8336-46dc-8491-6c28da3646a3 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:38:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-be3e12d3-624f-4738-9fdb-a78c71510bcf req-78efd0f8-579c-438d-a3e3-ea9603e4e088 service nova] Acquiring lock "e0331194-6106-4621-ab60-94bcf681222e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:38:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-be3e12d3-624f-4738-9fdb-a78c71510bcf req-78efd0f8-579c-438d-a3e3-ea9603e4e088 service nova] Lock "e0331194-6106-4621-ab60-94bcf681222e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:38:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-be3e12d3-624f-4738-9fdb-a78c71510bcf req-78efd0f8-579c-438d-a3e3-ea9603e4e088 service nova] Lock "e0331194-6106-4621-ab60-94bcf681222e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:38:55 user nova-compute[75080]: DEBUG nova.compute.manager [req-be3e12d3-624f-4738-9fdb-a78c71510bcf req-78efd0f8-579c-438d-a3e3-ea9603e4e088 service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] No waiting events found dispatching network-vif-plugged-12153aa9-8336-46dc-8491-6c28da3646a3 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:38:55 user nova-compute[75080]: WARNING nova.compute.manager [req-be3e12d3-624f-4738-9fdb-a78c71510bcf req-78efd0f8-579c-438d-a3e3-ea9603e4e088 service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] Received unexpected event network-vif-plugged-12153aa9-8336-46dc-8491-6c28da3646a3 for instance with vm_state rescued and task_state unrescuing.
Dec 05 15:38:55 user nova-compute[75080]: DEBUG nova.compute.manager [req-be3e12d3-624f-4738-9fdb-a78c71510bcf req-78efd0f8-579c-438d-a3e3-ea9603e4e088 service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] Received event network-vif-plugged-12153aa9-8336-46dc-8491-6c28da3646a3 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:38:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-be3e12d3-624f-4738-9fdb-a78c71510bcf req-78efd0f8-579c-438d-a3e3-ea9603e4e088 service nova] Acquiring lock "e0331194-6106-4621-ab60-94bcf681222e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:38:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-be3e12d3-624f-4738-9fdb-a78c71510bcf req-78efd0f8-579c-438d-a3e3-ea9603e4e088 service nova] Lock "e0331194-6106-4621-ab60-94bcf681222e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:38:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-be3e12d3-624f-4738-9fdb-a78c71510bcf req-78efd0f8-579c-438d-a3e3-ea9603e4e088 service nova] Lock "e0331194-6106-4621-ab60-94bcf681222e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:38:55 user nova-compute[75080]: DEBUG nova.compute.manager [req-be3e12d3-624f-4738-9fdb-a78c71510bcf req-78efd0f8-579c-438d-a3e3-ea9603e4e088 service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] No waiting events found dispatching network-vif-plugged-12153aa9-8336-46dc-8491-6c28da3646a3 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:38:55 user nova-compute[75080]: WARNING nova.compute.manager [req-be3e12d3-624f-4738-9fdb-a78c71510bcf req-78efd0f8-579c-438d-a3e3-ea9603e4e088 service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] Received unexpected event network-vif-plugged-12153aa9-8336-46dc-8491-6c28da3646a3 for instance with vm_state rescued and task_state unrescuing.
Dec 05 15:38:55 user nova-compute[75080]: DEBUG nova.compute.manager [req-be3e12d3-624f-4738-9fdb-a78c71510bcf req-78efd0f8-579c-438d-a3e3-ea9603e4e088 service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] Received event network-vif-plugged-12153aa9-8336-46dc-8491-6c28da3646a3 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:38:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-be3e12d3-624f-4738-9fdb-a78c71510bcf req-78efd0f8-579c-438d-a3e3-ea9603e4e088 service nova] Acquiring lock "e0331194-6106-4621-ab60-94bcf681222e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:38:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-be3e12d3-624f-4738-9fdb-a78c71510bcf req-78efd0f8-579c-438d-a3e3-ea9603e4e088 service nova] Lock "e0331194-6106-4621-ab60-94bcf681222e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:38:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-be3e12d3-624f-4738-9fdb-a78c71510bcf req-78efd0f8-579c-438d-a3e3-ea9603e4e088 service nova] Lock "e0331194-6106-4621-ab60-94bcf681222e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:38:55 user nova-compute[75080]: DEBUG nova.compute.manager [req-be3e12d3-624f-4738-9fdb-a78c71510bcf req-78efd0f8-579c-438d-a3e3-ea9603e4e088 service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] No waiting events found dispatching network-vif-plugged-12153aa9-8336-46dc-8491-6c28da3646a3 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:38:55 user nova-compute[75080]: WARNING nova.compute.manager [req-be3e12d3-624f-4738-9fdb-a78c71510bcf req-78efd0f8-579c-438d-a3e3-ea9603e4e088 service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] Received unexpected event network-vif-plugged-12153aa9-8336-46dc-8491-6c28da3646a3 for instance with vm_state rescued and task_state unrescuing.
Dec 05 15:38:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:38:57 user nova-compute[75080]: DEBUG nova.compute.manager [None req-20af96b5-d1c8-4236-9480-49bf4a2e8d70 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:39:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquiring lock "1e352b3b-ee04-42f6-af53-973c3154a342" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:39:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "1e352b3b-ee04-42f6-af53-973c3154a342" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:39:00 user nova-compute[75080]: INFO nova.compute.manager [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Rebooting instance
Dec 05 15:39:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquiring lock "refresh_cache-1e352b3b-ee04-42f6-af53-973c3154a342" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:39:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquired lock "refresh_cache-1e352b3b-ee04-42f6-af53-973c3154a342" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:39:00 user nova-compute[75080]: DEBUG nova.network.neutron [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:39:00 user nova-compute[75080]: DEBUG nova.network.neutron [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Updating instance_info_cache with network_info: [{"id": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "address": "fa:16:3e:47:d3:7c", "network": {"id": "1151f7c9-f853-4f06-93d7-74536b8b12ac", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420489370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549e67b7f2574eb38f3395452b647de7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1a68f60-ce", "ovs_interfaceid": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:39:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Releasing lock "refresh_cache-1e352b3b-ee04-42f6-af53-973c3154a342" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:39:00 user nova-compute[75080]: DEBUG nova.compute.manager [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:39:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG nova.compute.manager [req-390ac7f3-cf01-4aa8-90fe-1c9f9999822e req-7bd5ff12-d7b7-4844-b316-24223ea35242 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Received event network-vif-unplugged-b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-390ac7f3-cf01-4aa8-90fe-1c9f9999822e req-7bd5ff12-d7b7-4844-b316-24223ea35242 service nova] Acquiring lock "1e352b3b-ee04-42f6-af53-973c3154a342-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-390ac7f3-cf01-4aa8-90fe-1c9f9999822e req-7bd5ff12-d7b7-4844-b316-24223ea35242 service nova] Lock "1e352b3b-ee04-42f6-af53-973c3154a342-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-390ac7f3-cf01-4aa8-90fe-1c9f9999822e req-7bd5ff12-d7b7-4844-b316-24223ea35242 service nova] Lock "1e352b3b-ee04-42f6-af53-973c3154a342-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG nova.compute.manager [req-390ac7f3-cf01-4aa8-90fe-1c9f9999822e req-7bd5ff12-d7b7-4844-b316-24223ea35242 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] No waiting events found dispatching network-vif-unplugged-b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:39:01 user nova-compute[75080]: WARNING nova.compute.manager [req-390ac7f3-cf01-4aa8-90fe-1c9f9999822e req-7bd5ff12-d7b7-4844-b316-24223ea35242 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Received unexpected event network-vif-unplugged-b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540 for instance with vm_state active and task_state reboot_started_hard.
Dec 05 15:39:01 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Instance destroyed successfully.
Dec 05 15:39:01 user nova-compute[75080]: DEBUG nova.objects.instance [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lazy-loading 'resources' on Instance uuid 1e352b3b-ee04-42f6-af53-973c3154a342 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:36:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1577552572',display_name='tempest-TestMinimumBasicScenario-server-1577552572',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1577552572',id=37,image_ref='83e7a794-d2df-4acd-be99-9f30b564a2d3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBVo56f6MpZ3G8aHK/NCskAJXqmivK9NR9tXYO7XFZF0y+subtUdlQz10O+5bsDv2J2MCK+m8HVQ7rQyVrJn+Sh0HIgj6JlsELedJ7Cd0brl0Jl9FO+4EMlr97RezQYIQ==',key_name='tempest-TestMinimumBasicScenario-1082211644',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:36:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='549e67b7f2574eb38f3395452b647de7',ramdisk_id='',reservation_id='r-p7hcs3hz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e7a794-d2df-4acd-be99-9f30b564a2d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1307764000',owner_user_name='tempest-TestMinimumBasicScenario-1307764000-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:39:01Z,user_data=None,user_id='e0cb687b9ede4bb8ac3e192766fa4f21',uuid=1e352b3b-ee04-42f6-af53-973c3154a342,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "address": "fa:16:3e:47:d3:7c", "network": {"id": "1151f7c9-f853-4f06-93d7-74536b8b12ac", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420489370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549e67b7f2574eb38f3395452b647de7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1a68f60-ce", "ovs_interfaceid": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Converting VIF {"id": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "address": "fa:16:3e:47:d3:7c", "network": {"id": "1151f7c9-f853-4f06-93d7-74536b8b12ac", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420489370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549e67b7f2574eb38f3395452b647de7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1a68f60-ce", "ovs_interfaceid": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:d3:7c,bridge_name='br-int',has_traffic_filtering=True,id=b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540,network=Network(1151f7c9-f853-4f06-93d7-74536b8b12ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1a68f60-ce') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG os_vif [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:d3:7c,bridge_name='br-int',has_traffic_filtering=True,id=b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540,network=Network(1151f7c9-f853-4f06-93d7-74536b8b12ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1a68f60-ce') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1a68f60-ce, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=59b2e7a6-6243-411b-8e46-115616bc0a3b) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:39:01 user nova-compute[75080]: INFO os_vif [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:d3:7c,bridge_name='br-int',has_traffic_filtering=True,id=b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540,network=Network(1151f7c9-f853-4f06-93d7-74536b8b12ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1a68f60-ce')
Dec 05 15:39:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BIKxwXhb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:39:01 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:39:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30d18e5-78d4-478a-8d41-18642f4df401]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:39:01 user nova-compute[75080]: No targets found.
Dec 05 15:39:01 user nova-compute[75080]: iSNS:
Dec 05 15:39:01 user nova-compute[75080]: No targets found.
Dec 05 15:39:01 user nova-compute[75080]: STATIC:
Dec 05 15:39:01 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399
Dec 05 15:39:01 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:39:01 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:39:01 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b
Dec 05 15:39:01 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:39:01 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:39:01 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af
Dec 05 15:39:01 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:39:01 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:39:01 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14
Dec 05 15:39:01 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:39:01 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:39:01 user nova-compute[75080]: FIRMWARE:
Dec 05 15:39:01 user nova-compute[75080]: No targets found.
Dec 05 15:39:01 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:39:01 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:39:01 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1626fa1b-428c-4c9f-9a52-927e8afd6add]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfdabb7-d552-46bb-999c-bb881f3b0918]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:39:01 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:39:01 user nova-compute[75080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)
Dec 05 15:39:01 user nova-compute[75080]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af (non-flash)
Dec 05 15:39:01 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:39:01 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:39:01 user nova-compute[75080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)
Dec 05 15:39:01 user nova-compute[75080]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af (non-flash)
Dec 05 15:39:01 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f66384a5f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af'): ({'sdd'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Removing single pathed devices sdd {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.034s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88343f3-7ea0-41cf-a417-24ea46848bdf]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d37994-9bc1-437c-b0d0-abc416b1833c]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Flushing IO for device /dev/sdd {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[919537a6-c9e0-430b-83b2-5a30202efed1]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded69250-dd6b-4a1b-8037-5b1a2e3b82c5]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] SCSI volumes sdd have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5cc696-d8a1-4a52-9c90-8747a275d26c]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:39:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9268314e-d126-4390-894f-96028f52fd0e]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af, portal: 172.16.0.220,3260]
Dec 05 15:39:02 user nova-compute[75080]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af, portal: 172.16.0.220,3260] successful.
Dec 05 15:39:02 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[485b2dd0-feda-4455-852a-0a5e5cf33330]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] <== disconnect_volume: return (340ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Start _get_guest_xml network_info=[{"id": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "address": "fa:16:3e:47:d3:7c", "network": {"id": "1151f7c9-f853-4f06-93d7-74536b8b12ac", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420489370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549e67b7f2574eb38f3395452b647de7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1a68f60-ce", "ovs_interfaceid": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=83e7a794-d2df-4acd-be99-9f30b564a2d3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '83e7a794-d2df-4acd-be99-9f30b564a2d3'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BIKxwXhb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '1e352b3b-ee04-42f6-af53-973c3154a342', 'attached_at': '', 'detached_at': '', 'volume_id': '91cc30e8-ecf0-4547-853f-d34403b077af', 'serial': '91cc30e8-ecf0-4547-853f-d34403b077af'}, 'device_type': 'disk', 'attachment_id': '49c608db-d415-4b74-b95e-c4198a52bf84', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:39:02 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:39:02 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:39:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=83e7a794-d2df-4acd-be99-9f30b564a2d3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG nova.objects.instance [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1e352b3b-ee04-42f6-af53-973c3154a342 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG nova.objects.base [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Object Instance<1e352b3b-ee04-42f6-af53-973c3154a342> lazy-loaded attributes: resources,vcpu_model {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BIKxwXhb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:39:02 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:39:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:39:02 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:39:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:39:02 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:39:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7ee171-1f3a-44ee-9c61-872bbd73f6a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:39:02 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[577763e6-4ba2-412d-9a21-3543b41ce8d9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af] added
Dec 05 15:39:02 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc28a08-e606-49db-9126-fd3bba3c1b00]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[42366f86-0762-4886-9bdc-febe6edf89d1]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BIKxwXhb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BIKxwXhb" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[613f0303-c359-4a4d-bb96-f44e79edd824]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BIKxwXhb'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03c9b23-6d8c-4be2-ba24-dcde6846eeef]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[977d51c1-b35c-4f02-99df-17fa64e6d2fb]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:39:02 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:39:02 user nova-compute[75080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)
Dec 05 15:39:02 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:39:02 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:39:02 user nova-compute[75080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)
Dec 05 15:39:02 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[76794569-d605-41d7-9091-ca63763e7c6e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af, portal: 172.16.0.220,3260]
Dec 05 15:39:02 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af, portal: 172.16.0.220,3260] successful.
Dec 05 15:39:02 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[63561dca-c9dd-4b2b-9f38-157f0594fda6]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a63e11-603a-48aa-8cad-c7802df4c630]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:39:02 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:39:02 user nova-compute[75080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)
Dec 05 15:39:02 user nova-compute[75080]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af (non-flash)
Dec 05 15:39:02 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:39:02 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:39:02 user nova-compute[75080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)
Dec 05 15:39:02 user nova-compute[75080]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af (non-flash)
Dec 05 15:39:02 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4a5ac1-14a2-447c-bbc2-4de874a0a3ba]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BIKxwXhb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:39:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:03 user nova-compute[75080]: DEBUG nova.compute.manager [req-30ed225a-6c2f-4a35-9ca4-88f9e614aacf req-93d3f9ad-c3bb-431f-861b-e0caf1a3eb84 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Received event network-vif-plugged-b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:39:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-30ed225a-6c2f-4a35-9ca4-88f9e614aacf req-93d3f9ad-c3bb-431f-861b-e0caf1a3eb84 service nova] Acquiring lock "1e352b3b-ee04-42f6-af53-973c3154a342-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:39:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-30ed225a-6c2f-4a35-9ca4-88f9e614aacf req-93d3f9ad-c3bb-431f-861b-e0caf1a3eb84 service nova] Lock "1e352b3b-ee04-42f6-af53-973c3154a342-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:39:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-30ed225a-6c2f-4a35-9ca4-88f9e614aacf req-93d3f9ad-c3bb-431f-861b-e0caf1a3eb84 service nova] Lock "1e352b3b-ee04-42f6-af53-973c3154a342-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:39:03 user nova-compute[75080]: DEBUG nova.compute.manager [req-30ed225a-6c2f-4a35-9ca4-88f9e614aacf req-93d3f9ad-c3bb-431f-861b-e0caf1a3eb84 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] No waiting events found dispatching network-vif-plugged-b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:39:03 user nova-compute[75080]: WARNING nova.compute.manager [req-30ed225a-6c2f-4a35-9ca4-88f9e614aacf req-93d3f9ad-c3bb-431f-861b-e0caf1a3eb84 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Received unexpected event network-vif-plugged-b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540 for instance with vm_state active and task_state reboot_started_hard.
Dec 05 15:39:03 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:39:03 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26163336531316336', 'path': '/dev/sdd'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:39:03 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163336531316336', 'path': '/dev/sdd'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:39:03 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:36:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1577552572',display_name='tempest-TestMinimumBasicScenario-server-1577552572',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1577552572',id=37,image_ref='83e7a794-d2df-4acd-be99-9f30b564a2d3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBVo56f6MpZ3G8aHK/NCskAJXqmivK9NR9tXYO7XFZF0y+subtUdlQz10O+5bsDv2J2MCK+m8HVQ7rQyVrJn+Sh0HIgj6JlsELedJ7Cd0brl0Jl9FO+4EMlr97RezQYIQ==',key_name='tempest-TestMinimumBasicScenario-1082211644',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:36:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='549e67b7f2574eb38f3395452b647de7',ramdisk_id='',reservation_id='r-p7hcs3hz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e7a794-d2df-4acd-be99-9f30b564a2d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1307764000',owner_user_name='tempest-TestMinimumBasicScenario-1307764000-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:39:01Z,user_data=None,user_id='e0cb687b9ede4bb8ac3e192766fa4f21',uuid=1e352b3b-ee04-42f6-af53-973c3154a342,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "address": "fa:16:3e:47:d3:7c", "network": {"id": "1151f7c9-f853-4f06-93d7-74536b8b12ac", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420489370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549e67b7f2574eb38f3395452b647de7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1a68f60-ce", "ovs_interfaceid": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:39:03 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Converting VIF {"id": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "address": "fa:16:3e:47:d3:7c", "network": {"id": "1151f7c9-f853-4f06-93d7-74536b8b12ac", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420489370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549e67b7f2574eb38f3395452b647de7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1a68f60-ce", "ovs_interfaceid": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:39:03 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:d3:7c,bridge_name='br-int',has_traffic_filtering=True,id=b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540,network=Network(1151f7c9-f853-4f06-93d7-74536b8b12ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1a68f60-ce') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:39:03 user nova-compute[75080]: DEBUG nova.objects.instance [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e352b3b-ee04-42f6-af53-973c3154a342 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:39:03 user nova-compute[75080]: DEBUG nova.objects.base [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Object Instance<1e352b3b-ee04-42f6-af53-973c3154a342> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:39:03 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:39:03 user nova-compute[75080]:   <uuid>1e352b3b-ee04-42f6-af53-973c3154a342</uuid>
Dec 05 15:39:03 user nova-compute[75080]:   <name>instance-00000025</name>
Dec 05 15:39:03 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:39:03 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:39:03 user nova-compute[75080]:   <metadata>
Dec 05 15:39:03 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:39:03 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:39:03 user nova-compute[75080]:       <nova:name>tempest-TestMinimumBasicScenario-server-1577552572</nova:name>
Dec 05 15:39:03 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:39:02</nova:creationTime>
Dec 05 15:39:03 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:39:03 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:39:03 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:39:03 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:39:03 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:39:03 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:39:03 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:39:03 user nova-compute[75080]:       <nova:owner>
Dec 05 15:39:03 user nova-compute[75080]:         <nova:user uuid="e0cb687b9ede4bb8ac3e192766fa4f21">tempest-TestMinimumBasicScenario-1307764000-project-member</nova:user>
Dec 05 15:39:03 user nova-compute[75080]:         <nova:project uuid="549e67b7f2574eb38f3395452b647de7">tempest-TestMinimumBasicScenario-1307764000</nova:project>
Dec 05 15:39:03 user nova-compute[75080]:       </nova:owner>
Dec 05 15:39:03 user nova-compute[75080]:       <nova:root type="image" uuid="83e7a794-d2df-4acd-be99-9f30b564a2d3"/>
Dec 05 15:39:03 user nova-compute[75080]:       <nova:ports>
Dec 05 15:39:03 user nova-compute[75080]:         <nova:port uuid="b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540">
Dec 05 15:39:03 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 05 15:39:03 user nova-compute[75080]:         </nova:port>
Dec 05 15:39:03 user nova-compute[75080]:       </nova:ports>
Dec 05 15:39:03 user nova-compute[75080]:     </nova:instance>
Dec 05 15:39:03 user nova-compute[75080]:   </metadata>
Dec 05 15:39:03 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:39:03 user nova-compute[75080]:     <system>
Dec 05 15:39:03 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:39:03 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:39:03 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:39:03 user nova-compute[75080]:       <entry name="serial">1e352b3b-ee04-42f6-af53-973c3154a342</entry>
Dec 05 15:39:03 user nova-compute[75080]:       <entry name="uuid">1e352b3b-ee04-42f6-af53-973c3154a342</entry>
Dec 05 15:39:03 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:39:03 user nova-compute[75080]:     </system>
Dec 05 15:39:03 user nova-compute[75080]:   </sysinfo>
Dec 05 15:39:03 user nova-compute[75080]:   <os>
Dec 05 15:39:03 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:39:03 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:39:03 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:39:03 user nova-compute[75080]:   </os>
Dec 05 15:39:03 user nova-compute[75080]:   <features>
Dec 05 15:39:03 user nova-compute[75080]:     <acpi/>
Dec 05 15:39:03 user nova-compute[75080]:     <apic/>
Dec 05 15:39:03 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:39:03 user nova-compute[75080]:   </features>
Dec 05 15:39:03 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:39:03 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:39:03 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:39:03 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:39:03 user nova-compute[75080]:   </clock>
Dec 05 15:39:03 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:39:03 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:39:03 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:39:03 user nova-compute[75080]:   </cpu>
Dec 05 15:39:03 user nova-compute[75080]:   <devices>
Dec 05 15:39:03 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:39:03 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:39:03 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk"/>
Dec 05 15:39:03 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:39:03 user nova-compute[75080]:     </disk>
Dec 05 15:39:03 user nova-compute[75080]:     <disk type="block" device="disk">
Dec 05 15:39:03 user nova-compute[75080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:39:03 user nova-compute[75080]:       <source dev="/dev/sdd"/>
Dec 05 15:39:03 user nova-compute[75080]:       <target dev="vdb" bus="virtio"/>
Dec 05 15:39:03 user nova-compute[75080]:       <serial>91cc30e8-ecf0-4547-853f-d34403b077af</serial>
Dec 05 15:39:03 user nova-compute[75080]:     </disk>
Dec 05 15:39:03 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:39:03 user nova-compute[75080]:       <mac address="fa:16:3e:47:d3:7c"/>
Dec 05 15:39:03 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:39:03 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:39:03 user nova-compute[75080]:       <target dev="tapb1a68f60-ce"/>
Dec 05 15:39:03 user nova-compute[75080]:     </interface>
Dec 05 15:39:03 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:39:03 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/console.log" append="off"/>
Dec 05 15:39:03 user nova-compute[75080]:     </serial>
Dec 05 15:39:03 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:39:03 user nova-compute[75080]:     <video>
Dec 05 15:39:03 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:39:03 user nova-compute[75080]:     </video>
Dec 05 15:39:03 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:39:03 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:39:03 user nova-compute[75080]:     </rng>
Dec 05 15:39:03 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:39:03 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:39:03 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:39:03 user nova-compute[75080]:     </memballoon>
Dec 05 15:39:03 user nova-compute[75080]:   </devices>
Dec 05 15:39:03 user nova-compute[75080]: </domain>
Dec 05 15:39:03 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:39:03 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:03 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:03 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:03 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:03 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:39:03 user nova-compute[75080]: DEBUG nova.objects.instance [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1e352b3b-ee04-42f6-af53-973c3154a342 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:39:03 user nova-compute[75080]: DEBUG nova.objects.base [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Object Instance<1e352b3b-ee04-42f6-af53-973c3154a342> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:39:03 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fdcd1adbc55311e43e8b7a1fda6100cfedd56d3 --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:04 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fdcd1adbc55311e43e8b7a1fda6100cfedd56d3 --force-share --output=json" returned: 0 in 0.253s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:04 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 15:39:04 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:04 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:04 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Cannot resize image /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 15:39:04 user nova-compute[75080]: DEBUG nova.objects.instance [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lazy-loading 'migration_context' on Instance uuid 1e352b3b-ee04-42f6-af53-973c3154a342 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:39:04 user nova-compute[75080]: DEBUG nova.objects.base [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Object Instance<1e352b3b-ee04-42f6-af53-973c3154a342> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:39:04 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:36:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1577552572',display_name='tempest-TestMinimumBasicScenario-server-1577552572',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1577552572',id=37,image_ref='83e7a794-d2df-4acd-be99-9f30b564a2d3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBVo56f6MpZ3G8aHK/NCskAJXqmivK9NR9tXYO7XFZF0y+subtUdlQz10O+5bsDv2J2MCK+m8HVQ7rQyVrJn+Sh0HIgj6JlsELedJ7Cd0brl0Jl9FO+4EMlr97RezQYIQ==',key_name='tempest-TestMinimumBasicScenario-1082211644',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:36:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='549e67b7f2574eb38f3395452b647de7',ramdisk_id='',reservation_id='r-p7hcs3hz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e7a794-d2df-4acd-be99-9f30b564a2d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1307764000',owner_user_name='tempest-TestMinimumBasicScenario-1307764000-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:39:01Z,user_data=None,user_id='e0cb687b9ede4bb8ac3e192766fa4f21',uuid=1e352b3b-ee04-42f6-af53-973c3154a342,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "address": "fa:16:3e:47:d3:7c", "network": {"id": "1151f7c9-f853-4f06-93d7-74536b8b12ac", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420489370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549e67b7f2574eb38f3395452b647de7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1a68f60-ce", "ovs_interfaceid": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:39:04 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Converting VIF {"id": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "address": "fa:16:3e:47:d3:7c", "network": {"id": "1151f7c9-f853-4f06-93d7-74536b8b12ac", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420489370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549e67b7f2574eb38f3395452b647de7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1a68f60-ce", "ovs_interfaceid": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:39:04 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:d3:7c,bridge_name='br-int',has_traffic_filtering=True,id=b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540,network=Network(1151f7c9-f853-4f06-93d7-74536b8b12ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1a68f60-ce') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:39:04 user nova-compute[75080]: DEBUG os_vif [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:d3:7c,bridge_name='br-int',has_traffic_filtering=True,id=b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540,network=Network(1151f7c9-f853-4f06-93d7-74536b8b12ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1a68f60-ce') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:39:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:39:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:39:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '352ea435-74f8-546d-83de-733b41b336cc', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:39:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:39:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1a68f60-ce, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:39:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb1a68f60-ce, col_values=(('qos', UUID('b5f41376-8b3f-42e3-a752-86ee62eff763')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:39:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb1a68f60-ce, col_values=(('external_ids', {'iface-id': 'b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:d3:7c', 'vm-uuid': '1e352b3b-ee04-42f6-af53-973c3154a342'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:39:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:39:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:04 user nova-compute[75080]: INFO os_vif [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:d3:7c,bridge_name='br-int',has_traffic_filtering=True,id=b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540,network=Network(1151f7c9-f853-4f06-93d7-74536b8b12ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1a68f60-ce')
Dec 05 15:39:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:06 user nova-compute[75080]: DEBUG nova.compute.manager [req-142fdc46-8bf6-426b-8e69-5ab5997eeb3e req-d2a322d2-2482-4c97-a009-ec8a3677f67b service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Received event network-vif-plugged-b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:39:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-142fdc46-8bf6-426b-8e69-5ab5997eeb3e req-d2a322d2-2482-4c97-a009-ec8a3677f67b service nova] Acquiring lock "1e352b3b-ee04-42f6-af53-973c3154a342-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:39:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-142fdc46-8bf6-426b-8e69-5ab5997eeb3e req-d2a322d2-2482-4c97-a009-ec8a3677f67b service nova] Lock "1e352b3b-ee04-42f6-af53-973c3154a342-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:39:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-142fdc46-8bf6-426b-8e69-5ab5997eeb3e req-d2a322d2-2482-4c97-a009-ec8a3677f67b service nova] Lock "1e352b3b-ee04-42f6-af53-973c3154a342-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:39:06 user nova-compute[75080]: DEBUG nova.compute.manager [req-142fdc46-8bf6-426b-8e69-5ab5997eeb3e req-d2a322d2-2482-4c97-a009-ec8a3677f67b service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] No waiting events found dispatching network-vif-plugged-b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:39:06 user nova-compute[75080]: WARNING nova.compute.manager [req-142fdc46-8bf6-426b-8e69-5ab5997eeb3e req-d2a322d2-2482-4c97-a009-ec8a3677f67b service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Received unexpected event network-vif-plugged-b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540 for instance with vm_state active and task_state reboot_started_hard.
Dec 05 15:39:06 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:06 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:06 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:08 user nova-compute[75080]: DEBUG nova.compute.manager [req-a972076b-07bc-4721-9ce0-3bff70fad979 req-951df758-c9be-47ad-a6d6-9a20d54edf76 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Received event network-vif-plugged-b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:39:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a972076b-07bc-4721-9ce0-3bff70fad979 req-951df758-c9be-47ad-a6d6-9a20d54edf76 service nova] Acquiring lock "1e352b3b-ee04-42f6-af53-973c3154a342-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:39:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a972076b-07bc-4721-9ce0-3bff70fad979 req-951df758-c9be-47ad-a6d6-9a20d54edf76 service nova] Lock "1e352b3b-ee04-42f6-af53-973c3154a342-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:39:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a972076b-07bc-4721-9ce0-3bff70fad979 req-951df758-c9be-47ad-a6d6-9a20d54edf76 service nova] Lock "1e352b3b-ee04-42f6-af53-973c3154a342-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:39:08 user nova-compute[75080]: DEBUG nova.compute.manager [req-a972076b-07bc-4721-9ce0-3bff70fad979 req-951df758-c9be-47ad-a6d6-9a20d54edf76 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] No waiting events found dispatching network-vif-plugged-b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:39:08 user nova-compute[75080]: WARNING nova.compute.manager [req-a972076b-07bc-4721-9ce0-3bff70fad979 req-951df758-c9be-47ad-a6d6-9a20d54edf76 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Received unexpected event network-vif-plugged-b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540 for instance with vm_state active and task_state reboot_started_hard.
Dec 05 15:39:08 user nova-compute[75080]: DEBUG nova.compute.manager [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:39:08 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Instance rebooted successfully.
Dec 05 15:39:08 user nova-compute[75080]: DEBUG nova.compute.manager [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:39:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-65c72f92-ced4-43e1-960a-518e80b1c01f tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "1e352b3b-ee04-42f6-af53-973c3154a342" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.286s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:39:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:14 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:39:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:39:27 user nova-compute[75080]: DEBUG nova.compute.manager [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:39:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:39:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:39:27 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:39:27 user nova-compute[75080]: INFO nova.compute.claims [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Claim successful on node user
Dec 05 15:39:28 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:39:28 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:39:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.363s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:39:28 user nova-compute[75080]: DEBUG nova.compute.manager [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:39:28 user nova-compute[75080]: DEBUG nova.compute.manager [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:39:28 user nova-compute[75080]: DEBUG nova.network.neutron [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:39:28 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:39:28 user nova-compute[75080]: DEBUG nova.compute.manager [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:39:28 user nova-compute[75080]: DEBUG nova.policy [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7a02caebbfe541209b87adcbf848ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01b18b2a93b457c8e160447d44a673e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:39:28 user nova-compute[75080]: DEBUG nova.compute.manager [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:39:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:39:28 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Creating image(s)
Dec 05 15:39:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "/opt/stack/data/nova/instances/2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:39:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "/opt/stack/data/nova/instances/2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:39:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "/opt/stack/data/nova/instances/2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:39:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.181s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:39:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:39:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.174s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e/disk 1073741824" returned: 0 in 0.064s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:39:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:28 user nova-compute[75080]: DEBUG nova.network.neutron [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Successfully created port: c66977a0-8209-4cd2-8c16-fe7819474020 {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:39:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.199s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Cannot resize image /opt/stack/data/nova/instances/2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Ensure instance console log exists: /opt/stack/data/nova/instances/2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG nova.network.neutron [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Successfully updated port: c66977a0-8209-4cd2-8c16-fe7819474020 {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "refresh_cache-2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquired lock "refresh_cache-2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG nova.network.neutron [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG nova.compute.manager [req-54893e44-bd74-4d1b-9628-8cf142b8ac22 req-d9f2b65c-80ad-4ca9-828b-18f4fc912d09 service nova] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Received event network-changed-c66977a0-8209-4cd2-8c16-fe7819474020 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG nova.compute.manager [req-54893e44-bd74-4d1b-9628-8cf142b8ac22 req-d9f2b65c-80ad-4ca9-828b-18f4fc912d09 service nova] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Refreshing instance network info cache due to event network-changed-c66977a0-8209-4cd2-8c16-fe7819474020. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-54893e44-bd74-4d1b-9628-8cf142b8ac22 req-d9f2b65c-80ad-4ca9-828b-18f4fc912d09 service nova] Acquiring lock "refresh_cache-2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG nova.network.neutron [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG nova.network.neutron [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Updating instance_info_cache with network_info: [{"id": "c66977a0-8209-4cd2-8c16-fe7819474020", "address": "fa:16:3e:c4:b6:76", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66977a0-82", "ovs_interfaceid": "c66977a0-8209-4cd2-8c16-fe7819474020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Releasing lock "refresh_cache-2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG nova.compute.manager [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Instance network_info: |[{"id": "c66977a0-8209-4cd2-8c16-fe7819474020", "address": "fa:16:3e:c4:b6:76", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66977a0-82", "ovs_interfaceid": "c66977a0-8209-4cd2-8c16-fe7819474020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-54893e44-bd74-4d1b-9628-8cf142b8ac22 req-d9f2b65c-80ad-4ca9-828b-18f4fc912d09 service nova] Acquired lock "refresh_cache-2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG nova.network.neutron [req-54893e44-bd74-4d1b-9628-8cf142b8ac22 req-d9f2b65c-80ad-4ca9-828b-18f4fc912d09 service nova] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Refreshing network info cache for port c66977a0-8209-4cd2-8c16-fe7819474020 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Start _get_guest_xml network_info=[{"id": "c66977a0-8209-4cd2-8c16-fe7819474020", "address": "fa:16:3e:c4:b6:76", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66977a0-82", "ovs_interfaceid": "c66977a0-8209-4cd2-8c16-fe7819474020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:39:29 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:39:29 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:39:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:39:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2055643896',display_name='tempest-AttachVolumeTestJSON-server-2055643896',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2055643896',id=40,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIbzWBH2VpjYZ5gmgoWAk+WS06HrUFllhiEF732gV/d/ELgSBSoXH6pwoxrzvtyHYp60QglYaR11pJDGZUo/0uUkPrK+Frrzh8NjcsAQRwaXVKSfiKkoNz/3WXmyOSOPw==',key_name='tempest-keypair-1775072225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a01b18b2a93b457c8e160447d44a673e',ramdisk_id='',reservation_id='r-f4xhzy5w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1911411330',owner_user_name='tempest-AttachVolumeTestJSON-1911411330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:39:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a02caebbfe541209b87adcbf848ede6',uuid=2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c66977a0-8209-4cd2-8c16-fe7819474020", "address": "fa:16:3e:c4:b6:76", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66977a0-82", "ovs_interfaceid": "c66977a0-8209-4cd2-8c16-fe7819474020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Converting VIF {"id": "c66977a0-8209-4cd2-8c16-fe7819474020", "address": "fa:16:3e:c4:b6:76", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66977a0-82", "ovs_interfaceid": "c66977a0-8209-4cd2-8c16-fe7819474020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:b6:76,bridge_name='br-int',has_traffic_filtering=True,id=c66977a0-8209-4cd2-8c16-fe7819474020,network=Network(3037e443-f4eb-446e-8a80-53f409b02ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66977a0-82') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG nova.objects.instance [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lazy-loading 'pci_devices' on Instance uuid 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:39:29 user nova-compute[75080]:   <uuid>2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e</uuid>
Dec 05 15:39:29 user nova-compute[75080]:   <name>instance-00000028</name>
Dec 05 15:39:29 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:39:29 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:39:29 user nova-compute[75080]:   <metadata>
Dec 05 15:39:29 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:39:29 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:39:29 user nova-compute[75080]:       <nova:name>tempest-AttachVolumeTestJSON-server-2055643896</nova:name>
Dec 05 15:39:29 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:39:29</nova:creationTime>
Dec 05 15:39:29 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:39:29 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:39:29 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:39:29 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:39:29 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:39:29 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:39:29 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:39:29 user nova-compute[75080]:       <nova:owner>
Dec 05 15:39:29 user nova-compute[75080]:         <nova:user uuid="7a02caebbfe541209b87adcbf848ede6">tempest-AttachVolumeTestJSON-1911411330-project-member</nova:user>
Dec 05 15:39:29 user nova-compute[75080]:         <nova:project uuid="a01b18b2a93b457c8e160447d44a673e">tempest-AttachVolumeTestJSON-1911411330</nova:project>
Dec 05 15:39:29 user nova-compute[75080]:       </nova:owner>
Dec 05 15:39:29 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:39:29 user nova-compute[75080]:       <nova:ports>
Dec 05 15:39:29 user nova-compute[75080]:         <nova:port uuid="c66977a0-8209-4cd2-8c16-fe7819474020">
Dec 05 15:39:29 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 05 15:39:29 user nova-compute[75080]:         </nova:port>
Dec 05 15:39:29 user nova-compute[75080]:       </nova:ports>
Dec 05 15:39:29 user nova-compute[75080]:     </nova:instance>
Dec 05 15:39:29 user nova-compute[75080]:   </metadata>
Dec 05 15:39:29 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:39:29 user nova-compute[75080]:     <system>
Dec 05 15:39:29 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:39:29 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:39:29 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:39:29 user nova-compute[75080]:       <entry name="serial">2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e</entry>
Dec 05 15:39:29 user nova-compute[75080]:       <entry name="uuid">2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e</entry>
Dec 05 15:39:29 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:39:29 user nova-compute[75080]:     </system>
Dec 05 15:39:29 user nova-compute[75080]:   </sysinfo>
Dec 05 15:39:29 user nova-compute[75080]:   <os>
Dec 05 15:39:29 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:39:29 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:39:29 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:39:29 user nova-compute[75080]:   </os>
Dec 05 15:39:29 user nova-compute[75080]:   <features>
Dec 05 15:39:29 user nova-compute[75080]:     <acpi/>
Dec 05 15:39:29 user nova-compute[75080]:     <apic/>
Dec 05 15:39:29 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:39:29 user nova-compute[75080]:   </features>
Dec 05 15:39:29 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:39:29 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:39:29 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:39:29 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:39:29 user nova-compute[75080]:   </clock>
Dec 05 15:39:29 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:39:29 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:39:29 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:39:29 user nova-compute[75080]:   </cpu>
Dec 05 15:39:29 user nova-compute[75080]:   <devices>
Dec 05 15:39:29 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:39:29 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:39:29 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e/disk"/>
Dec 05 15:39:29 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:39:29 user nova-compute[75080]:     </disk>
Dec 05 15:39:29 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:39:29 user nova-compute[75080]:       <mac address="fa:16:3e:c4:b6:76"/>
Dec 05 15:39:29 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:39:29 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:39:29 user nova-compute[75080]:       <target dev="tapc66977a0-82"/>
Dec 05 15:39:29 user nova-compute[75080]:     </interface>
Dec 05 15:39:29 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:39:29 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e/console.log" append="off"/>
Dec 05 15:39:29 user nova-compute[75080]:     </serial>
Dec 05 15:39:29 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:39:29 user nova-compute[75080]:     <video>
Dec 05 15:39:29 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:39:29 user nova-compute[75080]:     </video>
Dec 05 15:39:29 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:39:29 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:39:29 user nova-compute[75080]:     </rng>
Dec 05 15:39:29 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:39:29 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:39:29 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:39:29 user nova-compute[75080]:     </memballoon>
Dec 05 15:39:29 user nova-compute[75080]:   </devices>
Dec 05 15:39:29 user nova-compute[75080]: </domain>
Dec 05 15:39:29 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:39:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2055643896',display_name='tempest-AttachVolumeTestJSON-server-2055643896',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2055643896',id=40,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIbzWBH2VpjYZ5gmgoWAk+WS06HrUFllhiEF732gV/d/ELgSBSoXH6pwoxrzvtyHYp60QglYaR11pJDGZUo/0uUkPrK+Frrzh8NjcsAQRwaXVKSfiKkoNz/3WXmyOSOPw==',key_name='tempest-keypair-1775072225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a01b18b2a93b457c8e160447d44a673e',ramdisk_id='',reservation_id='r-f4xhzy5w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1911411330',owner_user_name='tempest-AttachVolumeTestJSON-1911411330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:39:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a02caebbfe541209b87adcbf848ede6',uuid=2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c66977a0-8209-4cd2-8c16-fe7819474020", "address": "fa:16:3e:c4:b6:76", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66977a0-82", "ovs_interfaceid": "c66977a0-8209-4cd2-8c16-fe7819474020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Converting VIF {"id": "c66977a0-8209-4cd2-8c16-fe7819474020", "address": "fa:16:3e:c4:b6:76", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66977a0-82", "ovs_interfaceid": "c66977a0-8209-4cd2-8c16-fe7819474020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:b6:76,bridge_name='br-int',has_traffic_filtering=True,id=c66977a0-8209-4cd2-8c16-fe7819474020,network=Network(3037e443-f4eb-446e-8a80-53f409b02ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66977a0-82') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG os_vif [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:b6:76,bridge_name='br-int',has_traffic_filtering=True,id=c66977a0-8209-4cd2-8c16-fe7819474020,network=Network(3037e443-f4eb-446e-8a80-53f409b02ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66977a0-82') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd609d4e0-d09f-5f94-a3d8-16fb5bb6a679', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc66977a0-82, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc66977a0-82, col_values=(('qos', UUID('b7949c98-10b1-4c07-8b59-467ec4e1d1ba')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc66977a0-82, col_values=(('external_ids', {'iface-id': 'c66977a0-8209-4cd2-8c16-fe7819474020', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:b6:76', 'vm-uuid': '2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:39:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:29 user nova-compute[75080]: INFO os_vif [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:b6:76,bridge_name='br-int',has_traffic_filtering=True,id=c66977a0-8209-4cd2-8c16-fe7819474020,network=Network(3037e443-f4eb-446e-8a80-53f409b02ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66977a0-82')
Dec 05 15:39:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:39:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] No VIF found with MAC fa:16:3e:c4:b6:76, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:39:30 user nova-compute[75080]: DEBUG nova.network.neutron [req-54893e44-bd74-4d1b-9628-8cf142b8ac22 req-d9f2b65c-80ad-4ca9-828b-18f4fc912d09 service nova] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Updated VIF entry in instance network info cache for port c66977a0-8209-4cd2-8c16-fe7819474020. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:39:30 user nova-compute[75080]: DEBUG nova.network.neutron [req-54893e44-bd74-4d1b-9628-8cf142b8ac22 req-d9f2b65c-80ad-4ca9-828b-18f4fc912d09 service nova] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Updating instance_info_cache with network_info: [{"id": "c66977a0-8209-4cd2-8c16-fe7819474020", "address": "fa:16:3e:c4:b6:76", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66977a0-82", "ovs_interfaceid": "c66977a0-8209-4cd2-8c16-fe7819474020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:39:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-54893e44-bd74-4d1b-9628-8cf142b8ac22 req-d9f2b65c-80ad-4ca9-828b-18f4fc912d09 service nova] Releasing lock "refresh_cache-2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:39:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:31 user nova-compute[75080]: DEBUG nova.compute.manager [req-7b7943bf-0c00-4241-a65c-2e1251657362 req-0f9bff8e-433e-4b32-8e78-22e41b857026 service nova] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Received event network-vif-plugged-c66977a0-8209-4cd2-8c16-fe7819474020 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:39:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7b7943bf-0c00-4241-a65c-2e1251657362 req-0f9bff8e-433e-4b32-8e78-22e41b857026 service nova] Acquiring lock "2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:39:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7b7943bf-0c00-4241-a65c-2e1251657362 req-0f9bff8e-433e-4b32-8e78-22e41b857026 service nova] Lock "2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:39:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7b7943bf-0c00-4241-a65c-2e1251657362 req-0f9bff8e-433e-4b32-8e78-22e41b857026 service nova] Lock "2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:39:31 user nova-compute[75080]: DEBUG nova.compute.manager [req-7b7943bf-0c00-4241-a65c-2e1251657362 req-0f9bff8e-433e-4b32-8e78-22e41b857026 service nova] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] No waiting events found dispatching network-vif-plugged-c66977a0-8209-4cd2-8c16-fe7819474020 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:39:31 user nova-compute[75080]: WARNING nova.compute.manager [req-7b7943bf-0c00-4241-a65c-2e1251657362 req-0f9bff8e-433e-4b32-8e78-22e41b857026 service nova] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Received unexpected event network-vif-plugged-c66977a0-8209-4cd2-8c16-fe7819474020 for instance with vm_state building and task_state spawning.
Dec 05 15:39:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:33 user nova-compute[75080]: DEBUG nova.compute.manager [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:39:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:39:33 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Instance spawned successfully.
Dec 05 15:39:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:39:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:39:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:39:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:39:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:39:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:39:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:39:33 user nova-compute[75080]: INFO nova.compute.manager [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Took 5.26 seconds to spawn the instance on the hypervisor.
Dec 05 15:39:33 user nova-compute[75080]: DEBUG nova.compute.manager [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:39:33 user nova-compute[75080]: DEBUG nova.compute.manager [req-1ecc08db-d0a9-4452-88c2-ab60cf7a4067 req-f396cbcf-0c0c-47f2-8ff7-c02fb5aa48c2 service nova] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Received event network-vif-plugged-c66977a0-8209-4cd2-8c16-fe7819474020 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:39:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-1ecc08db-d0a9-4452-88c2-ab60cf7a4067 req-f396cbcf-0c0c-47f2-8ff7-c02fb5aa48c2 service nova] Acquiring lock "2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:39:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-1ecc08db-d0a9-4452-88c2-ab60cf7a4067 req-f396cbcf-0c0c-47f2-8ff7-c02fb5aa48c2 service nova] Lock "2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:39:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-1ecc08db-d0a9-4452-88c2-ab60cf7a4067 req-f396cbcf-0c0c-47f2-8ff7-c02fb5aa48c2 service nova] Lock "2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:39:33 user nova-compute[75080]: DEBUG nova.compute.manager [req-1ecc08db-d0a9-4452-88c2-ab60cf7a4067 req-f396cbcf-0c0c-47f2-8ff7-c02fb5aa48c2 service nova] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] No waiting events found dispatching network-vif-plugged-c66977a0-8209-4cd2-8c16-fe7819474020 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:39:33 user nova-compute[75080]: WARNING nova.compute.manager [req-1ecc08db-d0a9-4452-88c2-ab60cf7a4067 req-f396cbcf-0c0c-47f2-8ff7-c02fb5aa48c2 service nova] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Received unexpected event network-vif-plugged-c66977a0-8209-4cd2-8c16-fe7819474020 for instance with vm_state building and task_state spawning.
Dec 05 15:39:33 user nova-compute[75080]: INFO nova.compute.manager [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Took 5.95 seconds to build instance.
Dec 05 15:39:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ef16e494-0acd-4a7b-984c-e07e4d0ea04c tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.052s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:39:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:40 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:39:41 user nova-compute[75080]: DEBUG nova.compute.manager [req-7e5c1666-7588-4881-99d6-a22a9ab585f5 req-52018d15-e17f-4478-aa53-609db24c3df8 service nova] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Received event network-changed-7d7165da-a177-4c78-85bb-9e3dbda56be8 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:39:41 user nova-compute[75080]: DEBUG nova.compute.manager [req-7e5c1666-7588-4881-99d6-a22a9ab585f5 req-52018d15-e17f-4478-aa53-609db24c3df8 service nova] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Refreshing instance network info cache due to event network-changed-7d7165da-a177-4c78-85bb-9e3dbda56be8. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:39:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7e5c1666-7588-4881-99d6-a22a9ab585f5 req-52018d15-e17f-4478-aa53-609db24c3df8 service nova] Acquiring lock "refresh_cache-fe780f8f-12ad-49c7-92f1-547694e4755e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:39:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7e5c1666-7588-4881-99d6-a22a9ab585f5 req-52018d15-e17f-4478-aa53-609db24c3df8 service nova] Acquired lock "refresh_cache-fe780f8f-12ad-49c7-92f1-547694e4755e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:39:41 user nova-compute[75080]: DEBUG nova.network.neutron [req-7e5c1666-7588-4881-99d6-a22a9ab585f5 req-52018d15-e17f-4478-aa53-609db24c3df8 service nova] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Refreshing network info cache for port 7d7165da-a177-4c78-85bb-9e3dbda56be8 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:39:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Acquiring lock "fe780f8f-12ad-49c7-92f1-547694e4755e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:39:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "fe780f8f-12ad-49c7-92f1-547694e4755e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:39:41 user nova-compute[75080]: DEBUG nova.objects.instance [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lazy-loading 'flavor' on Instance uuid fe780f8f-12ad-49c7-92f1-547694e4755e {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:39:41 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Ignoring supplied device name: /dev/vdb
Dec 05 15:39:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "fe780f8f-12ad-49c7-92f1-547694e4755e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:39:41 user nova-compute[75080]: DEBUG nova.network.neutron [req-7e5c1666-7588-4881-99d6-a22a9ab585f5 req-52018d15-e17f-4478-aa53-609db24c3df8 service nova] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Updated VIF entry in instance network info cache for port 7d7165da-a177-4c78-85bb-9e3dbda56be8. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:39:41 user nova-compute[75080]: DEBUG nova.network.neutron [req-7e5c1666-7588-4881-99d6-a22a9ab585f5 req-52018d15-e17f-4478-aa53-609db24c3df8 service nova] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Updating instance_info_cache with network_info: [{"id": "7d7165da-a177-4c78-85bb-9e3dbda56be8", "address": "fa:16:3e:8f:a1:9b", "network": {"id": "eb187ccd-700a-49df-881f-c61d4b90e612", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053782949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e8a1b1f1ed346949ac0f633ae7e530b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d7165da-a1", "ovs_interfaceid": "7d7165da-a177-4c78-85bb-9e3dbda56be8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:39:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7e5c1666-7588-4881-99d6-a22a9ab585f5 req-52018d15-e17f-4478-aa53-609db24c3df8 service nova] Releasing lock "refresh_cache-fe780f8f-12ad-49c7-92f1-547694e4755e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:39:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Acquiring lock "fe780f8f-12ad-49c7-92f1-547694e4755e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:39:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "fe780f8f-12ad-49c7-92f1-547694e4755e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:39:41 user nova-compute[75080]: INFO nova.compute.manager [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Attaching volume ca733344-e116-455b-a863-c20edfcbf189 to /dev/vdb
Dec 05 15:39:41 user nova-compute[75080]: DEBUG os_brick.utils [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:39:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:41 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab78e817-b157-45af-bdd2-c1eb1a2f22be]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:41 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[559f81b6-6f74-4cae-a789-2f2bacf181f1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.099s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:42 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0563a3a0-07a9-4c7a-bf18-72936c45774a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:42 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f75293f-6a7c-4e81-bf52-800c03ebfe96]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:39:42 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:39:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:39:42 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:39:42 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1254b8fa-ab28-49aa-9abe-66811c9e0e3e]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:42 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:39:42 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:39:42 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:39:42 user nova-compute[75080]: DEBUG os_brick.utils [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] <== get_connector_properties: return (219ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:39:42 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Updating existing volume attachment record: 5d5e1bd6-a1b1-4147-ade6-1b123ea5f290 {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:39:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:44 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:39:44 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:39:44 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:39:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:45 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:39:45 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:39:45 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Didn't find any instances for network info cache update. {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 15:39:45 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:39:46 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:39:46 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:39:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:39:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:39:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:39:46 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:39:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:39:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:39:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:47 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:39:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe780f8f-12ad-49c7-92f1-547694e4755e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe780f8f-12ad-49c7-92f1-547694e4755e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe780f8f-12ad-49c7-92f1-547694e4755e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe780f8f-12ad-49c7-92f1-547694e4755e/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:39:49 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:39:49 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:39:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=7868MB free_disk=24.772586822509766GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:39:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:39:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:39:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 07b025ff-4a9d-48a2-b950-b8f2d165f33c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:39:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance ab882db7-e6d7-44ca-9ea4-ae2fa68f7929 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:39:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance b47129e8-c02b-4107-af4f-329173dd453f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:39:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance e0331194-6106-4621-ab60-94bcf681222e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:39:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 1e352b3b-ee04-42f6-af53-973c3154a342 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:39:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance fe780f8f-12ad-49c7-92f1-547694e4755e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:39:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 675f9326-411b-4d0d-921c-f5375ffec457 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:39:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance b5a4b977-1e76-45c7-bf97-b4db5fb615e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:39:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:39:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:39:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:39:49 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:39:49 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:39:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:39:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.422s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:39:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NFZsCnci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:39:51 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:39:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:39:51 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:39:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:39:51 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:39:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3756e128-e14b-442a-8431-ff4101c5d087]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:39:51 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[066cd196-cae0-41e1-8021-9b7f9af4fa1f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189] added
Dec 05 15:39:51 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f282ae47-7fb4-4876-8942-011b44300990]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc3e3fc-e2d6-4de7-a9d6-6cf39d30bb95]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NFZsCnci {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NFZsCnci" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[96508dea-d4a9-47ff-bd4a-fc4a18e0a446]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NFZsCnci'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a526b9b-0e95-4e08-9540-f21f1388cd4c]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad7668e-e4db-43a7-af02-8dcd9ff7704a]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:39:51 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:39:51 user nova-compute[75080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)
Dec 05 15:39:51 user nova-compute[75080]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af (non-flash)
Dec 05 15:39:51 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:39:51 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:39:51 user nova-compute[75080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)
Dec 05 15:39:51 user nova-compute[75080]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af (non-flash)
Dec 05 15:39:51 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05285d6-dee2-4b6d-82eb-a307480276aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189, portal: 172.16.0.220,3260]
Dec 05 15:39:51 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189, portal: 172.16.0.220,3260] successful.
Dec 05 15:39:51 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:39:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:52 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbed6c89-2e6f-4e2e-b399-5d3184273ffe]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:52 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:39:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:52 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e8bb69-87b0-46b2-9ad1-65d6c0e75a06]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:52 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:39:52 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:39:52 user nova-compute[75080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)
Dec 05 15:39:52 user nova-compute[75080]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af (non-flash)
Dec 05 15:39:52 user nova-compute[75080]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 (non-flash)
Dec 05 15:39:52 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:39:52 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:39:52 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:39:52 user nova-compute[75080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)
Dec 05 15:39:52 user nova-compute[75080]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af (non-flash)
Dec 05 15:39:52 user nova-compute[75080]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 (non-flash)
Dec 05 15:39:52 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:39:52 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:39:52 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:39:52 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] HCTL ('36', '-', '-', 0) found on session 45 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:39:52 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:39:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:52 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[01762460-d38a-4671-a430-02ebeebf08cb]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:52 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Searching for a device in session 45 and hctl ['36', '*', '*', 0] yield: None {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:39:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:53 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Searching for a device in session 45 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:39:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NFZsCnci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:39:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:39:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26465383261366365', 'path': '/dev/sde'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:39:53 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465383261366365', 'path': '/dev/sde'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:39:53 user nova-compute[75080]: DEBUG nova.objects.instance [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lazy-loading 'flavor' on Instance uuid fe780f8f-12ad-49c7-92f1-547694e4755e {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:39:53 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 15:39:53 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:39:53 user nova-compute[75080]:   <source dev="/dev/sde"/>
Dec 05 15:39:53 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:39:53 user nova-compute[75080]:   <serial>ca733344-e116-455b-a863-c20edfcbf189</serial>
Dec 05 15:39:53 user nova-compute[75080]: </disk>
Dec 05 15:39:53 user nova-compute[75080]:  {{(pid=75080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 15:39:53 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:39:53 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:39:53 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] No VIF found with MAC fa:16:3e:8f:a1:9b, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:39:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0c7518f2-e7d5-418e-baef-3239c481a6f2 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "fe780f8f-12ad-49c7-92f1-547694e4755e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.813s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:39:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:56 user nova-compute[75080]: DEBUG nova.compute.manager [req-4ba4f7a7-aead-4580-baa2-4b463c5403f3 req-3f7da542-3295-4c82-98ad-40b1e16b07c0 service nova] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Received event network-changed-e6fdf36d-c77d-4dbb-94c8-61d010e00884 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:39:56 user nova-compute[75080]: DEBUG nova.compute.manager [req-4ba4f7a7-aead-4580-baa2-4b463c5403f3 req-3f7da542-3295-4c82-98ad-40b1e16b07c0 service nova] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Refreshing instance network info cache due to event network-changed-e6fdf36d-c77d-4dbb-94c8-61d010e00884. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:39:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4ba4f7a7-aead-4580-baa2-4b463c5403f3 req-3f7da542-3295-4c82-98ad-40b1e16b07c0 service nova] Acquiring lock "refresh_cache-675f9326-411b-4d0d-921c-f5375ffec457" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:39:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4ba4f7a7-aead-4580-baa2-4b463c5403f3 req-3f7da542-3295-4c82-98ad-40b1e16b07c0 service nova] Acquired lock "refresh_cache-675f9326-411b-4d0d-921c-f5375ffec457" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:39:56 user nova-compute[75080]: DEBUG nova.network.neutron [req-4ba4f7a7-aead-4580-baa2-4b463c5403f3 req-3f7da542-3295-4c82-98ad-40b1e16b07c0 service nova] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Refreshing network info cache for port e6fdf36d-c77d-4dbb-94c8-61d010e00884 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:39:57 user nova-compute[75080]: DEBUG nova.network.neutron [req-4ba4f7a7-aead-4580-baa2-4b463c5403f3 req-3f7da542-3295-4c82-98ad-40b1e16b07c0 service nova] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Updated VIF entry in instance network info cache for port e6fdf36d-c77d-4dbb-94c8-61d010e00884. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:39:57 user nova-compute[75080]: DEBUG nova.network.neutron [req-4ba4f7a7-aead-4580-baa2-4b463c5403f3 req-3f7da542-3295-4c82-98ad-40b1e16b07c0 service nova] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Updating instance_info_cache with network_info: [{"id": "e6fdf36d-c77d-4dbb-94c8-61d010e00884", "address": "fa:16:3e:76:b9:75", "network": {"id": "cab219d9-2a41-4553-9030-07efee59df1b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1667827966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c63445ed4f466b8c00af6d9bc40e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fdf36d-c7", "ovs_interfaceid": "e6fdf36d-c77d-4dbb-94c8-61d010e00884", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:39:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4ba4f7a7-aead-4580-baa2-4b463c5403f3 req-3f7da542-3295-4c82-98ad-40b1e16b07c0 service nova] Releasing lock "refresh_cache-675f9326-411b-4d0d-921c-f5375ffec457" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:39:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:57 user nova-compute[75080]: INFO nova.compute.manager [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Rebuilding instance
Dec 05 15:39:58 user nova-compute[75080]: DEBUG nova.compute.manager [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:39:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:58 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Instance destroyed successfully.
Dec 05 15:39:58 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Instance destroyed successfully.
Dec 05 15:39:58 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:38:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-388294122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1207311612',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOHaSHjIWUzcs1FaMsetX+3Qdvz6+YCwRv1EvXdnmZXZwDLOl4AJxUX/t389zTETH0szJ2Ih2H3ox/1CCyz6EVUkTwws1K0LLBMLy8dIcwnjvHvzYMNik58gI35jDQnCw==',key_name='tempest-keypair-2048690446',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:38:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='99c63445ed4f466b8c00af6d9bc40e42',ramdisk_id='',reservation_id='r-hir48rfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1910922312',owner_user_name='tempest-ServerActionsV293TestJSON-1910922312-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:39:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b1bbf8f0a8f44a3a5dc224bcf9e7139',uuid=675f9326-411b-4d0d-921c-f5375ffec457,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6fdf36d-c77d-4dbb-94c8-61d010e00884", "address": "fa:16:3e:76:b9:75", "network": {"id": "cab219d9-2a41-4553-9030-07efee59df1b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1667827966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c63445ed4f466b8c00af6d9bc40e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fdf36d-c7", "ovs_interfaceid": "e6fdf36d-c77d-4dbb-94c8-61d010e00884", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:39:58 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Converting VIF {"id": "e6fdf36d-c77d-4dbb-94c8-61d010e00884", "address": "fa:16:3e:76:b9:75", "network": {"id": "cab219d9-2a41-4553-9030-07efee59df1b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1667827966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c63445ed4f466b8c00af6d9bc40e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fdf36d-c7", "ovs_interfaceid": "e6fdf36d-c77d-4dbb-94c8-61d010e00884", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:39:58 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:b9:75,bridge_name='br-int',has_traffic_filtering=True,id=e6fdf36d-c77d-4dbb-94c8-61d010e00884,network=Network(cab219d9-2a41-4553-9030-07efee59df1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6fdf36d-c7') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:39:58 user nova-compute[75080]: DEBUG os_vif [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:b9:75,bridge_name='br-int',has_traffic_filtering=True,id=e6fdf36d-c77d-4dbb-94c8-61d010e00884,network=Network(cab219d9-2a41-4553-9030-07efee59df1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6fdf36d-c7') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:39:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6fdf36d-c7, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:39:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cf72a1bd-d008-4dd6-981c-5eb6811e381f) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:39:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:39:58 user nova-compute[75080]: INFO os_vif [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:b9:75,bridge_name='br-int',has_traffic_filtering=True,id=e6fdf36d-c77d-4dbb-94c8-61d010e00884,network=Network(cab219d9-2a41-4553-9030-07efee59df1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6fdf36d-c7')
Dec 05 15:39:58 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:39:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OForJHUu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:39:58 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 05 15:39:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:39:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:39:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[689be558-426a-469c-941b-4610d91c495c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:39:58 user nova-compute[75080]: No targets found.
Dec 05 15:39:58 user nova-compute[75080]: iSNS:
Dec 05 15:39:58 user nova-compute[75080]: No targets found.
Dec 05 15:39:58 user nova-compute[75080]: STATIC:
Dec 05 15:39:58 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399
Dec 05 15:39:58 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:39:58 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:39:58 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189
Dec 05 15:39:58 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:39:58 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:39:58 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b
Dec 05 15:39:58 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:39:58 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:39:58 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af
Dec 05 15:39:58 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:39:58 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:39:58 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14
Dec 05 15:39:58 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:39:58 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:39:58 user nova-compute[75080]: FIRMWARE:
Dec 05 15:39:58 user nova-compute[75080]: No targets found.
Dec 05 15:39:58 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:39:59 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:39:59 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6d2fa9-5335-4822-aff0-88949496aa15]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG nova.compute.manager [req-818167ce-4d8f-4f86-9a36-f086eaac4c48 req-f189717c-f3f3-4141-a53d-9c88e5cda7d7 service nova] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Received event network-vif-unplugged-e6fdf36d-c77d-4dbb-94c8-61d010e00884 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-818167ce-4d8f-4f86-9a36-f086eaac4c48 req-f189717c-f3f3-4141-a53d-9c88e5cda7d7 service nova] Acquiring lock "675f9326-411b-4d0d-921c-f5375ffec457-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-818167ce-4d8f-4f86-9a36-f086eaac4c48 req-f189717c-f3f3-4141-a53d-9c88e5cda7d7 service nova] Lock "675f9326-411b-4d0d-921c-f5375ffec457-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-818167ce-4d8f-4f86-9a36-f086eaac4c48 req-f189717c-f3f3-4141-a53d-9c88e5cda7d7 service nova] Lock "675f9326-411b-4d0d-921c-f5375ffec457-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG nova.compute.manager [req-818167ce-4d8f-4f86-9a36-f086eaac4c48 req-f189717c-f3f3-4141-a53d-9c88e5cda7d7 service nova] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] No waiting events found dispatching network-vif-unplugged-e6fdf36d-c77d-4dbb-94c8-61d010e00884 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:39:59 user nova-compute[75080]: WARNING nova.compute.manager [req-818167ce-4d8f-4f86-9a36-f086eaac4c48 req-f189717c-f3f3-4141-a53d-9c88e5cda7d7 service nova] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Received unexpected event network-vif-unplugged-e6fdf36d-c77d-4dbb-94c8-61d010e00884 for instance with vm_state active and task_state rebuilding.
Dec 05 15:39:59 user nova-compute[75080]: DEBUG nova.compute.manager [req-818167ce-4d8f-4f86-9a36-f086eaac4c48 req-f189717c-f3f3-4141-a53d-9c88e5cda7d7 service nova] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Received event network-vif-plugged-e6fdf36d-c77d-4dbb-94c8-61d010e00884 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-818167ce-4d8f-4f86-9a36-f086eaac4c48 req-f189717c-f3f3-4141-a53d-9c88e5cda7d7 service nova] Acquiring lock "675f9326-411b-4d0d-921c-f5375ffec457-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-818167ce-4d8f-4f86-9a36-f086eaac4c48 req-f189717c-f3f3-4141-a53d-9c88e5cda7d7 service nova] Lock "675f9326-411b-4d0d-921c-f5375ffec457-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-818167ce-4d8f-4f86-9a36-f086eaac4c48 req-f189717c-f3f3-4141-a53d-9c88e5cda7d7 service nova] Lock "675f9326-411b-4d0d-921c-f5375ffec457-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG nova.compute.manager [req-818167ce-4d8f-4f86-9a36-f086eaac4c48 req-f189717c-f3f3-4141-a53d-9c88e5cda7d7 service nova] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] No waiting events found dispatching network-vif-plugged-e6fdf36d-c77d-4dbb-94c8-61d010e00884 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:39:59 user nova-compute[75080]: WARNING nova.compute.manager [req-818167ce-4d8f-4f86-9a36-f086eaac4c48 req-f189717c-f3f3-4141-a53d-9c88e5cda7d7 service nova] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Received unexpected event network-vif-plugged-e6fdf36d-c77d-4dbb-94c8-61d010e00884 for instance with vm_state active and task_state rebuilding.
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0065d66-55ff-40cc-a295-0d0ad16e52cc]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:39:59 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:39:59 user nova-compute[75080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)
Dec 05 15:39:59 user nova-compute[75080]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af (non-flash)
Dec 05 15:39:59 user nova-compute[75080]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 (non-flash)
Dec 05 15:39:59 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:39:59 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:39:59 user nova-compute[75080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)
Dec 05 15:39:59 user nova-compute[75080]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af (non-flash)
Dec 05 15:39:59 user nova-compute[75080]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 (non-flash)
Dec 05 15:39:59 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f665c772e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b'): ({'sdc'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Removing single pathed devices sdc {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50c9f0e-eb86-41e0-b73e-3dc86c46090f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02c614e-04d6-4f6e-be07-4fc789a4d2b2]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Flushing IO for device /dev/sdc {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15216a5-ec0b-445e-82c4-69fbb5276f81]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93f0ae5-781b-496d-aabb-9b1d5c9943a2]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] SCSI volumes sdc have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[845874ab-586d-4bd5-8f80-054c846c3b29]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6066cffa-7568-42bd-b294-8c6ab5b83802]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b, portal: 172.16.0.220,3260]
Dec 05 15:39:59 user nova-compute[75080]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b, portal: 172.16.0.220,3260] successful.
Dec 05 15:39:59 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[144f8e11-e665-4249-9daf-27f8f2f94650]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] <== disconnect_volume: return (342ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:39:59 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Deleting instance files /opt/stack/data/nova/instances/675f9326-411b-4d0d-921c-f5375ffec457_del
Dec 05 15:39:59 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Deletion of /opt/stack/data/nova/instances/675f9326-411b-4d0d-921c-f5375ffec457_del complete
Dec 05 15:39:59 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 675f9326-411b-4d0d-921c-f5375ffec457 could not be found.
Dec 05 15:39:59 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OForJHUu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:39:59 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 05 15:39:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f7ba68-abca-4d34-a2ec-351069e88d4a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:39:59 user nova-compute[75080]: No targets found.
Dec 05 15:39:59 user nova-compute[75080]: iSNS:
Dec 05 15:39:59 user nova-compute[75080]: No targets found.
Dec 05 15:39:59 user nova-compute[75080]: STATIC:
Dec 05 15:39:59 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399
Dec 05 15:39:59 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:39:59 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:39:59 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189
Dec 05 15:39:59 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:39:59 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:39:59 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af
Dec 05 15:39:59 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:39:59 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:39:59 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14
Dec 05 15:39:59 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:39:59 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:39:59 user nova-compute[75080]: FIRMWARE:
Dec 05 15:39:59 user nova-compute[75080]: No targets found.
Dec 05 15:39:59 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:39:59 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:39:59 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4118a90b-2920-47d3-9fac-1cb09d5dc60a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c624a19-2abf-40bd-b371-f8f01a96395e]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:39:59 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:39:59 user nova-compute[75080]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af (non-flash)
Dec 05 15:39:59 user nova-compute[75080]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 (non-flash)
Dec 05 15:39:59 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:39:59 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:39:59 user nova-compute[75080]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af (non-flash)
Dec 05 15:39:59 user nova-compute[75080]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 (non-flash)
Dec 05 15:39:59 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f665c1f5f30>, {}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Disconnecting from: [] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.079s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] <== disconnect_volume: return (81ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:39:59 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:40:00 user nova-compute[75080]: DEBUG nova.compute.manager [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Preparing to wait for external event volume-reimaged-5e132bcf-9292-494f-bd93-f747af60818b {{(pid=75080) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Dec 05 15:40:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Acquiring lock "675f9326-411b-4d0d-921c-f5375ffec457-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:40:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Lock "675f9326-411b-4d0d-921c-f5375ffec457-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:40:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Lock "675f9326-411b-4d0d-921c-f5375ffec457-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:40:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e445fc2f-5eab-495a-960d-235a1643bec5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Acquiring lock "fe780f8f-12ad-49c7-92f1-547694e4755e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:40:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e445fc2f-5eab-495a-960d-235a1643bec5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "fe780f8f-12ad-49c7-92f1-547694e4755e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:40:17 user nova-compute[75080]: INFO nova.compute.manager [None req-e445fc2f-5eab-495a-960d-235a1643bec5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Detaching volume ca733344-e116-455b-a863-c20edfcbf189
Dec 05 15:40:17 user nova-compute[75080]: INFO nova.virt.block_device [None req-e445fc2f-5eab-495a-960d-235a1643bec5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Attempting to driver detach volume ca733344-e116-455b-a863-c20edfcbf189 from mountpoint /dev/vdb
Dec 05 15:40:17 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e445fc2f-5eab-495a-960d-235a1643bec5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Attempting to detach device vdb from instance fe780f8f-12ad-49c7-92f1-547694e4755e from the persistent domain config. {{(pid=75080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 15:40:17 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-e445fc2f-5eab-495a-960d-235a1643bec5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:40:17 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:40:17 user nova-compute[75080]:   <source dev="/dev/sde"/>
Dec 05 15:40:17 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:40:17 user nova-compute[75080]:   <serial>ca733344-e116-455b-a863-c20edfcbf189</serial>
Dec 05 15:40:17 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 15:40:17 user nova-compute[75080]: </disk>
Dec 05 15:40:17 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:40:17 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-e445fc2f-5eab-495a-960d-235a1643bec5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Successfully detached device vdb from instance fe780f8f-12ad-49c7-92f1-547694e4755e from the persistent domain config.
Dec 05 15:40:17 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e445fc2f-5eab-495a-960d-235a1643bec5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fe780f8f-12ad-49c7-92f1-547694e4755e from the live domain config. {{(pid=75080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 15:40:17 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-e445fc2f-5eab-495a-960d-235a1643bec5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:40:17 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:40:17 user nova-compute[75080]:   <source dev="/dev/sde"/>
Dec 05 15:40:17 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:40:17 user nova-compute[75080]:   <serial>ca733344-e116-455b-a863-c20edfcbf189</serial>
Dec 05 15:40:17 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 15:40:17 user nova-compute[75080]: </disk>
Dec 05 15:40:17 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:40:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Acquiring lock "fe780f8f-12ad-49c7-92f1-547694e4755e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:40:17 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e445fc2f-5eab-495a-960d-235a1643bec5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fe780f8f-12ad-49c7-92f1-547694e4755e {{(pid=75080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 15:40:18 user nova-compute[75080]: DEBUG nova.compute.manager [req-b2c21432-477a-4cc5-8d7e-167eff953159 req-262358be-2bc8-4dab-ba3f-56376be57db5 service nova] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Received event volume-reimaged-5e132bcf-9292-494f-bd93-f747af60818b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:40:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-b2c21432-477a-4cc5-8d7e-167eff953159 req-262358be-2bc8-4dab-ba3f-56376be57db5 service nova] Acquiring lock "675f9326-411b-4d0d-921c-f5375ffec457-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:40:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-b2c21432-477a-4cc5-8d7e-167eff953159 req-262358be-2bc8-4dab-ba3f-56376be57db5 service nova] Lock "675f9326-411b-4d0d-921c-f5375ffec457-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:40:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-b2c21432-477a-4cc5-8d7e-167eff953159 req-262358be-2bc8-4dab-ba3f-56376be57db5 service nova] Lock "675f9326-411b-4d0d-921c-f5375ffec457-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:40:18 user nova-compute[75080]: DEBUG nova.compute.manager [req-b2c21432-477a-4cc5-8d7e-167eff953159 req-262358be-2bc8-4dab-ba3f-56376be57db5 service nova] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Processing event volume-reimaged-5e132bcf-9292-494f-bd93-f747af60818b {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Dec 05 15:40:18 user nova-compute[75080]: DEBUG nova.compute.manager [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Instance event wait completed in 18 seconds for volume-reimaged {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:40:18 user nova-compute[75080]: INFO nova.virt.block_device [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Booting with volume 5e132bcf-9292-494f-bd93-f747af60818b at /dev/vda
Dec 05 15:40:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:40:19 user nova-compute[75080]: DEBUG os_brick.utils [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:40:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:19 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bc4dda-e3f9-4779-9c33-4a10aaf5fe32]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:19 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[962ec47a-6dd9-43fa-9dee-f0bf1afee5b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:19 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece562c2-a457-47e9-871b-378e4856eb10]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:19 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e79562-8a0d-477d-abbe-f626ef59b590]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:40:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:40:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:40:19 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:40:19 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed54681-8d0c-45e3-bf5e-36ada0afbb2d]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:40:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:40:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:40:19 user nova-compute[75080]: DEBUG os_brick.utils [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:40:19 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Updating existing volume attachment record: 76015a46-eb08-46f6-b1d5-2241d775e332 {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:40:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:40:28 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Creating image(s)
Dec 05 15:40:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Did not create local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Ensure instance console log exists: /opt/stack/data/nova/instances/675f9326-411b-4d0d-921c-f5375ffec457/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Start _get_guest_xml network_info=[{"id": "e6fdf36d-c77d-4dbb-94c8-61d010e00884", "address": "fa:16:3e:76:b9:75", "network": {"id": "cab219d9-2a41-4553-9030-07efee59df1b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1667827966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c63445ed4f466b8c00af6d9bc40e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fdf36d-c7", "ovs_interfaceid": "e6fdf36d-c77d-4dbb-94c8-61d010e00884", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OForJHUu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '675f9326-411b-4d0d-921c-f5375ffec457', 'attached_at': '', 'detached_at': '', 'volume_id': '5e132bcf-9292-494f-bd93-f747af60818b', 'serial': '5e132bcf-9292-494f-bd93-f747af60818b'}, 'device_type': 'disk', 'attachment_id': '76015a46-eb08-46f6-b1d5-2241d775e332', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:40:28 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Dec 05 15:40:28 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Dec 05 15:40:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG nova.objects.instance [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Lazy-loading 'vcpu_model' on Instance uuid 675f9326-411b-4d0d-921c-f5375ffec457 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OForJHUu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:40:28 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 05 15:40:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:40:28 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 05 15:40:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:40:28 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:40:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b6586d-a6f0-4e5f-a34e-9c2bd3c491d4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:40:28 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2e3094-80a7-4f8a-a879-c8d93e7d7419]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b] added
Dec 05 15:40:28 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f122cef2-d258-45c0-aae1-220c4c6a3ef8]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ec0dc0-dc2d-4f83-8124-4f4b9cf0cab9]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OForJHUu {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OForJHUu" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e410acb-a247-4aaa-a322-f36d9aa81e0a]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OForJHUu'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2464f6c-1c17-4d03-a509-fa7f16f1e951]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e24018c-5c98-4d4c-9c20-ba8e6b36ec72]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:40:28 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:40:28 user nova-compute[75080]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af (non-flash)
Dec 05 15:40:28 user nova-compute[75080]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 (non-flash)
Dec 05 15:40:28 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:40:28 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:40:28 user nova-compute[75080]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af (non-flash)
Dec 05 15:40:28 user nova-compute[75080]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 (non-flash)
Dec 05 15:40:28 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d3b975-c3ae-479a-89eb-4ec001b13857]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b, portal: 172.16.0.220,3260]
Dec 05 15:40:28 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b, portal: 172.16.0.220,3260] successful.
Dec 05 15:40:28 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:40:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba113fad-7975-4ed0-b44a-5927e2c32009]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:40:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b8d797-6403-40c0-959a-83c86b9545f9]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:40:29 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:40:29 user nova-compute[75080]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af (non-flash)
Dec 05 15:40:29 user nova-compute[75080]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 (non-flash)
Dec 05 15:40:29 user nova-compute[75080]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)
Dec 05 15:40:29 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:40:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:40:29 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:40:29 user nova-compute[75080]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af (non-flash)
Dec 05 15:40:29 user nova-compute[75080]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 (non-flash)
Dec 05 15:40:29 user nova-compute[75080]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)
Dec 05 15:40:29 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:40:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:40:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:40:29 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:40:29 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:40:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[966c0698-9699-4346-9025-9310fbf7d9b2]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:29 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:40:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OForJHUu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:40:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:40:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23133316533333264', 'path': '/dev/sdc'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:40:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133316533333264', 'path': '/dev/sdc'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:40:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T15:38:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-388294122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1207311612',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOHaSHjIWUzcs1FaMsetX+3Qdvz6+YCwRv1EvXdnmZXZwDLOl4AJxUX/t389zTETH0szJ2Ih2H3ox/1CCyz6EVUkTwws1K0LLBMLy8dIcwnjvHvzYMNik58gI35jDQnCw==',key_name='tempest-keypair-2048690446',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:38:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='99c63445ed4f466b8c00af6d9bc40e42',ramdisk_id='',reservation_id='r-hir48rfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1910922312',owner_user_name='tempest-ServerActionsV293TestJSON-1910922312-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:40:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b1bbf8f0a8f44a3a5dc224bcf9e7139',uuid=675f9326-411b-4d0d-921c-f5375ffec457,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6fdf36d-c77d-4dbb-94c8-61d010e00884", "address": "fa:16:3e:76:b9:75", "network": {"id": "cab219d9-2a41-4553-9030-07efee59df1b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1667827966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c63445ed4f466b8c00af6d9bc40e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fdf36d-c7", "ovs_interfaceid": "e6fdf36d-c77d-4dbb-94c8-61d010e00884", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:40:30 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Converting VIF {"id": "e6fdf36d-c77d-4dbb-94c8-61d010e00884", "address": "fa:16:3e:76:b9:75", "network": {"id": "cab219d9-2a41-4553-9030-07efee59df1b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1667827966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c63445ed4f466b8c00af6d9bc40e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fdf36d-c7", "ovs_interfaceid": "e6fdf36d-c77d-4dbb-94c8-61d010e00884", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:40:30 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:b9:75,bridge_name='br-int',has_traffic_filtering=True,id=e6fdf36d-c77d-4dbb-94c8-61d010e00884,network=Network(cab219d9-2a41-4553-9030-07efee59df1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6fdf36d-c7') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:40:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:40:30 user nova-compute[75080]:   <uuid>675f9326-411b-4d0d-921c-f5375ffec457</uuid>
Dec 05 15:40:30 user nova-compute[75080]:   <name>instance-00000027</name>
Dec 05 15:40:30 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:40:30 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:40:30 user nova-compute[75080]:   <metadata>
Dec 05 15:40:30 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:40:30 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:40:30 user nova-compute[75080]:       <nova:name>tempest-ServerActionsV293TestJSON-server-388294122</nova:name>
Dec 05 15:40:30 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:40:28</nova:creationTime>
Dec 05 15:40:30 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:40:30 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:40:30 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:40:30 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:40:30 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:40:30 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:40:30 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:40:30 user nova-compute[75080]:       <nova:owner>
Dec 05 15:40:30 user nova-compute[75080]:         <nova:user uuid="2b1bbf8f0a8f44a3a5dc224bcf9e7139">tempest-ServerActionsV293TestJSON-1910922312-project-member</nova:user>
Dec 05 15:40:30 user nova-compute[75080]:         <nova:project uuid="99c63445ed4f466b8c00af6d9bc40e42">tempest-ServerActionsV293TestJSON-1910922312</nova:project>
Dec 05 15:40:30 user nova-compute[75080]:       </nova:owner>
Dec 05 15:40:30 user nova-compute[75080]:       <nova:ports>
Dec 05 15:40:30 user nova-compute[75080]:         <nova:port uuid="e6fdf36d-c77d-4dbb-94c8-61d010e00884">
Dec 05 15:40:30 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 05 15:40:30 user nova-compute[75080]:         </nova:port>
Dec 05 15:40:30 user nova-compute[75080]:       </nova:ports>
Dec 05 15:40:30 user nova-compute[75080]:     </nova:instance>
Dec 05 15:40:30 user nova-compute[75080]:   </metadata>
Dec 05 15:40:30 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:40:30 user nova-compute[75080]:     <system>
Dec 05 15:40:30 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:40:30 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:40:30 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:40:30 user nova-compute[75080]:       <entry name="serial">675f9326-411b-4d0d-921c-f5375ffec457</entry>
Dec 05 15:40:30 user nova-compute[75080]:       <entry name="uuid">675f9326-411b-4d0d-921c-f5375ffec457</entry>
Dec 05 15:40:30 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:40:30 user nova-compute[75080]:     </system>
Dec 05 15:40:30 user nova-compute[75080]:   </sysinfo>
Dec 05 15:40:30 user nova-compute[75080]:   <os>
Dec 05 15:40:30 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:40:30 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:40:30 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:40:30 user nova-compute[75080]:   </os>
Dec 05 15:40:30 user nova-compute[75080]:   <features>
Dec 05 15:40:30 user nova-compute[75080]:     <acpi/>
Dec 05 15:40:30 user nova-compute[75080]:     <apic/>
Dec 05 15:40:30 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:40:30 user nova-compute[75080]:   </features>
Dec 05 15:40:30 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:40:30 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:40:30 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:40:30 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:40:30 user nova-compute[75080]:   </clock>
Dec 05 15:40:30 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:40:30 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:40:30 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:40:30 user nova-compute[75080]:   </cpu>
Dec 05 15:40:30 user nova-compute[75080]:   <devices>
Dec 05 15:40:30 user nova-compute[75080]:     <disk type="block" device="disk">
Dec 05 15:40:30 user nova-compute[75080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:40:30 user nova-compute[75080]:       <source dev="/dev/sdc"/>
Dec 05 15:40:30 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:40:30 user nova-compute[75080]:       <serial>5e132bcf-9292-494f-bd93-f747af60818b</serial>
Dec 05 15:40:30 user nova-compute[75080]:     </disk>
Dec 05 15:40:30 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:40:30 user nova-compute[75080]:       <mac address="fa:16:3e:76:b9:75"/>
Dec 05 15:40:30 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:40:30 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:40:30 user nova-compute[75080]:       <target dev="tape6fdf36d-c7"/>
Dec 05 15:40:30 user nova-compute[75080]:     </interface>
Dec 05 15:40:30 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:40:30 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/675f9326-411b-4d0d-921c-f5375ffec457/console.log" append="off"/>
Dec 05 15:40:30 user nova-compute[75080]:     </serial>
Dec 05 15:40:30 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:40:30 user nova-compute[75080]:     <video>
Dec 05 15:40:30 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:40:30 user nova-compute[75080]:     </video>
Dec 05 15:40:30 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:40:30 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:40:30 user nova-compute[75080]:     </rng>
Dec 05 15:40:30 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:40:30 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:40:30 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:40:30 user nova-compute[75080]:     </memballoon>
Dec 05 15:40:30 user nova-compute[75080]:   </devices>
Dec 05 15:40:30 user nova-compute[75080]: </domain>
Dec 05 15:40:30 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:40:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T15:38:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-388294122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1207311612',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOHaSHjIWUzcs1FaMsetX+3Qdvz6+YCwRv1EvXdnmZXZwDLOl4AJxUX/t389zTETH0szJ2Ih2H3ox/1CCyz6EVUkTwws1K0LLBMLy8dIcwnjvHvzYMNik58gI35jDQnCw==',key_name='tempest-keypair-2048690446',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:38:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='99c63445ed4f466b8c00af6d9bc40e42',ramdisk_id='',reservation_id='r-hir48rfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1910922312',owner_user_name='tempest-ServerActionsV293TestJSON-1910922312-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:40:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b1bbf8f0a8f44a3a5dc224bcf9e7139',uuid=675f9326-411b-4d0d-921c-f5375ffec457,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6fdf36d-c77d-4dbb-94c8-61d010e00884", "address": "fa:16:3e:76:b9:75", "network": {"id": "cab219d9-2a41-4553-9030-07efee59df1b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1667827966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c63445ed4f466b8c00af6d9bc40e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fdf36d-c7", "ovs_interfaceid": "e6fdf36d-c77d-4dbb-94c8-61d010e00884", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:40:30 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Converting VIF {"id": "e6fdf36d-c77d-4dbb-94c8-61d010e00884", "address": "fa:16:3e:76:b9:75", "network": {"id": "cab219d9-2a41-4553-9030-07efee59df1b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1667827966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c63445ed4f466b8c00af6d9bc40e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fdf36d-c7", "ovs_interfaceid": "e6fdf36d-c77d-4dbb-94c8-61d010e00884", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:40:30 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:b9:75,bridge_name='br-int',has_traffic_filtering=True,id=e6fdf36d-c77d-4dbb-94c8-61d010e00884,network=Network(cab219d9-2a41-4553-9030-07efee59df1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6fdf36d-c7') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:40:30 user nova-compute[75080]: DEBUG os_vif [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:b9:75,bridge_name='br-int',has_traffic_filtering=True,id=e6fdf36d-c77d-4dbb-94c8-61d010e00884,network=Network(cab219d9-2a41-4553-9030-07efee59df1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6fdf36d-c7') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:40:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:40:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:40:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab2c16e4-a4db-5342-a5f2-29774a51f8bd', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:40:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6fdf36d-c7, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:40:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape6fdf36d-c7, col_values=(('qos', UUID('1daa96dc-6c18-4b5f-8a82-03fe96057af4')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:40:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape6fdf36d-c7, col_values=(('external_ids', {'iface-id': 'e6fdf36d-c77d-4dbb-94c8-61d010e00884', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:b9:75', 'vm-uuid': '675f9326-411b-4d0d-921c-f5375ffec457'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:40:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:40:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:30 user nova-compute[75080]: INFO os_vif [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:b9:75,bridge_name='br-int',has_traffic_filtering=True,id=e6fdf36d-c77d-4dbb-94c8-61d010e00884,network=Network(cab219d9-2a41-4553-9030-07efee59df1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6fdf36d-c7')
Dec 05 15:40:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:40:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] No VIF found with MAC fa:16:3e:76:b9:75, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:40:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:31 user nova-compute[75080]: DEBUG nova.compute.manager [req-235c00e2-a38c-46ca-9d4e-d373e53aaf9c req-bd34c4be-a6d6-4df6-b51d-105088041e64 service nova] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Received event network-vif-plugged-e6fdf36d-c77d-4dbb-94c8-61d010e00884 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:40:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-235c00e2-a38c-46ca-9d4e-d373e53aaf9c req-bd34c4be-a6d6-4df6-b51d-105088041e64 service nova] Acquiring lock "675f9326-411b-4d0d-921c-f5375ffec457-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:40:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-235c00e2-a38c-46ca-9d4e-d373e53aaf9c req-bd34c4be-a6d6-4df6-b51d-105088041e64 service nova] Lock "675f9326-411b-4d0d-921c-f5375ffec457-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:40:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-235c00e2-a38c-46ca-9d4e-d373e53aaf9c req-bd34c4be-a6d6-4df6-b51d-105088041e64 service nova] Lock "675f9326-411b-4d0d-921c-f5375ffec457-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:40:31 user nova-compute[75080]: DEBUG nova.compute.manager [req-235c00e2-a38c-46ca-9d4e-d373e53aaf9c req-bd34c4be-a6d6-4df6-b51d-105088041e64 service nova] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] No waiting events found dispatching network-vif-plugged-e6fdf36d-c77d-4dbb-94c8-61d010e00884 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:40:31 user nova-compute[75080]: WARNING nova.compute.manager [req-235c00e2-a38c-46ca-9d4e-d373e53aaf9c req-bd34c4be-a6d6-4df6-b51d-105088041e64 service nova] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Received unexpected event network-vif-plugged-e6fdf36d-c77d-4dbb-94c8-61d010e00884 for instance with vm_state active and task_state rebuild_spawning.
Dec 05 15:40:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2a6a0f80-6dcc-411e-a49b-8a93f23c560c tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "b5a4b977-1e76-45c7-bf97-b4db5fb615e2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:40:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2a6a0f80-6dcc-411e-a49b-8a93f23c560c tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "b5a4b977-1e76-45c7-bf97-b4db5fb615e2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:40:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2a6a0f80-6dcc-411e-a49b-8a93f23c560c tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "b5a4b977-1e76-45c7-bf97-b4db5fb615e2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:40:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2a6a0f80-6dcc-411e-a49b-8a93f23c560c tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "b5a4b977-1e76-45c7-bf97-b4db5fb615e2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:40:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2a6a0f80-6dcc-411e-a49b-8a93f23c560c tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "b5a4b977-1e76-45c7-bf97-b4db5fb615e2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:40:33 user nova-compute[75080]: INFO nova.compute.manager [None req-2a6a0f80-6dcc-411e-a49b-8a93f23c560c tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Terminating instance
Dec 05 15:40:33 user nova-compute[75080]: DEBUG nova.compute.manager [None req-2a6a0f80-6dcc-411e-a49b-8a93f23c560c tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:40:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:33 user nova-compute[75080]: DEBUG nova.compute.manager [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:40:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:40:33 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Instance spawned successfully.
Dec 05 15:40:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:40:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:33 user nova-compute[75080]: DEBUG nova.compute.manager [req-b7826ca4-097e-48b1-9d88-9b381e7e5efb req-766bf3b4-7a44-4839-81fa-f4c4062d5645 service nova] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Received event network-vif-plugged-e6fdf36d-c77d-4dbb-94c8-61d010e00884 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:40:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-b7826ca4-097e-48b1-9d88-9b381e7e5efb req-766bf3b4-7a44-4839-81fa-f4c4062d5645 service nova] Acquiring lock "675f9326-411b-4d0d-921c-f5375ffec457-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:40:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-b7826ca4-097e-48b1-9d88-9b381e7e5efb req-766bf3b4-7a44-4839-81fa-f4c4062d5645 service nova] Lock "675f9326-411b-4d0d-921c-f5375ffec457-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:40:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-b7826ca4-097e-48b1-9d88-9b381e7e5efb req-766bf3b4-7a44-4839-81fa-f4c4062d5645 service nova] Lock "675f9326-411b-4d0d-921c-f5375ffec457-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:40:33 user nova-compute[75080]: DEBUG nova.compute.manager [req-b7826ca4-097e-48b1-9d88-9b381e7e5efb req-766bf3b4-7a44-4839-81fa-f4c4062d5645 service nova] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] No waiting events found dispatching network-vif-plugged-e6fdf36d-c77d-4dbb-94c8-61d010e00884 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:40:33 user nova-compute[75080]: WARNING nova.compute.manager [req-b7826ca4-097e-48b1-9d88-9b381e7e5efb req-766bf3b4-7a44-4839-81fa-f4c4062d5645 service nova] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Received unexpected event network-vif-plugged-e6fdf36d-c77d-4dbb-94c8-61d010e00884 for instance with vm_state active and task_state rebuild_spawning.
Dec 05 15:40:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:40:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:40:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:40:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:40:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:40:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:40:33 user nova-compute[75080]: DEBUG nova.compute.manager [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:40:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:40:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:40:34 user nova-compute[75080]: DEBUG nova.objects.instance [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75080) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Dec 05 15:40:34 user nova-compute[75080]: DEBUG nova.compute.manager [req-d6ab5061-8b12-4672-bb77-2ed9cda71ea5 req-7bf21f19-1d67-4710-a20f-d36eabcb5d39 service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Received event network-vif-unplugged-4fcca870-3cc7-4338-b912-84e32dc7d4c0 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:40:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d6ab5061-8b12-4672-bb77-2ed9cda71ea5 req-7bf21f19-1d67-4710-a20f-d36eabcb5d39 service nova] Acquiring lock "b5a4b977-1e76-45c7-bf97-b4db5fb615e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:40:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d6ab5061-8b12-4672-bb77-2ed9cda71ea5 req-7bf21f19-1d67-4710-a20f-d36eabcb5d39 service nova] Lock "b5a4b977-1e76-45c7-bf97-b4db5fb615e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:40:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d6ab5061-8b12-4672-bb77-2ed9cda71ea5 req-7bf21f19-1d67-4710-a20f-d36eabcb5d39 service nova] Lock "b5a4b977-1e76-45c7-bf97-b4db5fb615e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:40:34 user nova-compute[75080]: DEBUG nova.compute.manager [req-d6ab5061-8b12-4672-bb77-2ed9cda71ea5 req-7bf21f19-1d67-4710-a20f-d36eabcb5d39 service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] No waiting events found dispatching network-vif-unplugged-4fcca870-3cc7-4338-b912-84e32dc7d4c0 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:40:34 user nova-compute[75080]: DEBUG nova.compute.manager [req-d6ab5061-8b12-4672-bb77-2ed9cda71ea5 req-7bf21f19-1d67-4710-a20f-d36eabcb5d39 service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Received event network-vif-unplugged-4fcca870-3cc7-4338-b912-84e32dc7d4c0 for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:40:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b2c21432-477a-4cc5-8d7e-167eff953159 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.087s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:40:34 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Instance destroyed successfully.
Dec 05 15:40:34 user nova-compute[75080]: DEBUG nova.objects.instance [None req-2a6a0f80-6dcc-411e-a49b-8a93f23c560c tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lazy-loading 'resources' on Instance uuid b5a4b977-1e76-45c7-bf97-b4db5fb615e2 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:40:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-2a6a0f80-6dcc-411e-a49b-8a93f23c560c tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T15:34:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-951113717',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-951113717',id=35,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKBO63DOhU+xhQzfzScYvd8cH7epBciaesPrZyAVqXwpkpGKTiFjE9AiOmbkLAgktbf3ya7OlNM2u5P2yMCu6Vc9LOTQMY57W9Z9bmYvYbSt+s8cBaUKdRs9xFP2gX0YQ==',key_name='tempest-keypair-331505788',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:38:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6350b8a7b0ce4af7b83a280c0c1ec3e6',ramdisk_id='',reservation_id='r-goq5cviw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-132988477',owner_user_name='tempest-AttachVolumeShelveTestJSON-132988477-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:38:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72a1c29faca44a4095dbda09561e5a91',uuid=b5a4b977-1e76-45c7-bf97-b4db5fb615e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "address": "fa:16:3e:c3:a0:3b", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fcca870-3c", "ovs_interfaceid": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:40:34 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-2a6a0f80-6dcc-411e-a49b-8a93f23c560c tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Converting VIF {"id": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "address": "fa:16:3e:c3:a0:3b", "network": {"id": "b94a6985-25b3-480e-b79f-b753c8b23fa5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1281732659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6350b8a7b0ce4af7b83a280c0c1ec3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fcca870-3c", "ovs_interfaceid": "4fcca870-3cc7-4338-b912-84e32dc7d4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:40:34 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-2a6a0f80-6dcc-411e-a49b-8a93f23c560c tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a0:3b,bridge_name='br-int',has_traffic_filtering=True,id=4fcca870-3cc7-4338-b912-84e32dc7d4c0,network=Network(b94a6985-25b3-480e-b79f-b753c8b23fa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fcca870-3c') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:40:34 user nova-compute[75080]: DEBUG os_vif [None req-2a6a0f80-6dcc-411e-a49b-8a93f23c560c tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a0:3b,bridge_name='br-int',has_traffic_filtering=True,id=4fcca870-3cc7-4338-b912-84e32dc7d4c0,network=Network(b94a6985-25b3-480e-b79f-b753c8b23fa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fcca870-3c') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:40:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4fcca870-3c, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:40:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=128334ae-a46b-48ab-a889-6b15942917c9) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:40:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:40:34 user nova-compute[75080]: INFO os_vif [None req-2a6a0f80-6dcc-411e-a49b-8a93f23c560c tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a0:3b,bridge_name='br-int',has_traffic_filtering=True,id=4fcca870-3cc7-4338-b912-84e32dc7d4c0,network=Network(b94a6985-25b3-480e-b79f-b753c8b23fa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fcca870-3c')
Dec 05 15:40:34 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-2a6a0f80-6dcc-411e-a49b-8a93f23c560c tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Deleting instance files /opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2_del
Dec 05 15:40:34 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-2a6a0f80-6dcc-411e-a49b-8a93f23c560c tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Deletion of /opt/stack/data/nova/instances/b5a4b977-1e76-45c7-bf97-b4db5fb615e2_del complete
Dec 05 15:40:34 user nova-compute[75080]: INFO nova.compute.manager [None req-2a6a0f80-6dcc-411e-a49b-8a93f23c560c tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Took 0.88 seconds to destroy the instance on the hypervisor.
Dec 05 15:40:34 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-2a6a0f80-6dcc-411e-a49b-8a93f23c560c tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:40:34 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:40:34 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:40:35 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:40:35 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Took 0.76 seconds to deallocate network for instance.
Dec 05 15:40:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2a6a0f80-6dcc-411e-a49b-8a93f23c560c tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:40:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2a6a0f80-6dcc-411e-a49b-8a93f23c560c tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:40:35 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-2a6a0f80-6dcc-411e-a49b-8a93f23c560c tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:40:35 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-2a6a0f80-6dcc-411e-a49b-8a93f23c560c tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:40:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2a6a0f80-6dcc-411e-a49b-8a93f23c560c tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:40:35 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-2a6a0f80-6dcc-411e-a49b-8a93f23c560c tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Deleted allocations for instance b5a4b977-1e76-45c7-bf97-b4db5fb615e2
Dec 05 15:40:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2a6a0f80-6dcc-411e-a49b-8a93f23c560c tempest-AttachVolumeShelveTestJSON-132988477 tempest-AttachVolumeShelveTestJSON-132988477-project-member] Lock "b5a4b977-1e76-45c7-bf97-b4db5fb615e2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.167s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:40:35 user nova-compute[75080]: DEBUG nova.compute.manager [req-1011ce07-700e-4915-947c-b1901756abbb req-6efffeb1-5e49-40e8-8667-177216ecaca8 service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Received event network-vif-deleted-4fcca870-3cc7-4338-b912-84e32dc7d4c0 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:40:36 user nova-compute[75080]: DEBUG nova.compute.manager [req-9e3fdca9-bda8-4044-935b-ef3cead98fa5 req-221264ee-2921-49a1-91e7-74cca3b21439 service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Received event network-vif-plugged-4fcca870-3cc7-4338-b912-84e32dc7d4c0 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:40:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9e3fdca9-bda8-4044-935b-ef3cead98fa5 req-221264ee-2921-49a1-91e7-74cca3b21439 service nova] Acquiring lock "b5a4b977-1e76-45c7-bf97-b4db5fb615e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:40:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9e3fdca9-bda8-4044-935b-ef3cead98fa5 req-221264ee-2921-49a1-91e7-74cca3b21439 service nova] Lock "b5a4b977-1e76-45c7-bf97-b4db5fb615e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:40:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9e3fdca9-bda8-4044-935b-ef3cead98fa5 req-221264ee-2921-49a1-91e7-74cca3b21439 service nova] Lock "b5a4b977-1e76-45c7-bf97-b4db5fb615e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:40:36 user nova-compute[75080]: DEBUG nova.compute.manager [req-9e3fdca9-bda8-4044-935b-ef3cead98fa5 req-221264ee-2921-49a1-91e7-74cca3b21439 service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] No waiting events found dispatching network-vif-plugged-4fcca870-3cc7-4338-b912-84e32dc7d4c0 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:40:36 user nova-compute[75080]: WARNING nova.compute.manager [req-9e3fdca9-bda8-4044-935b-ef3cead98fa5 req-221264ee-2921-49a1-91e7-74cca3b21439 service nova] [instance: b5a4b977-1e76-45c7-bf97-b4db5fb615e2] Received unexpected event network-vif-plugged-4fcca870-3cc7-4338-b912-84e32dc7d4c0 for instance with vm_state deleted and task_state None.
Dec 05 15:40:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:37 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-e445fc2f-5eab-495a-960d-235a1643bec5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fe780f8f-12ad-49c7-92f1-547694e4755e is timed out.
Dec 05 15:40:37 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-e445fc2f-5eab-495a-960d-235a1643bec5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Successfully detached device vdb from instance fe780f8f-12ad-49c7-92f1-547694e4755e from the live domain config.
Dec 05 15:40:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e445fc2f-5eab-495a-960d-235a1643bec5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:40:37 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e445fc2f-5eab-495a-960d-235a1643bec5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NFZsCnci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:40:37 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-e445fc2f-5eab-495a-960d-235a1643bec5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:40:37 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-e445fc2f-5eab-495a-960d-235a1643bec5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:40:37 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-e445fc2f-5eab-495a-960d-235a1643bec5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:40:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:37 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be9fcb4-e47f-4f63-a88d-9d9574216cc4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:37 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e445fc2f-5eab-495a-960d-235a1643bec5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:40:37 user nova-compute[75080]: No targets found.
Dec 05 15:40:37 user nova-compute[75080]: iSNS:
Dec 05 15:40:37 user nova-compute[75080]: No targets found.
Dec 05 15:40:37 user nova-compute[75080]: STATIC:
Dec 05 15:40:37 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399
Dec 05 15:40:37 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:40:37 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:40:37 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189
Dec 05 15:40:37 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:40:37 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:40:37 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b
Dec 05 15:40:37 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:40:37 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:40:37 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af
Dec 05 15:40:37 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:40:37 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:40:37 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14
Dec 05 15:40:37 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:40:37 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:40:37 user nova-compute[75080]: FIRMWARE:
Dec 05 15:40:37 user nova-compute[75080]: No targets found.
Dec 05 15:40:37 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:40:37 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e445fc2f-5eab-495a-960d-235a1643bec5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:40:37 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:40:37 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:40:37 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e445fc2f-5eab-495a-960d-235a1643bec5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:40:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1b51ed-bf6d-455a-b5c7-4c95928b7dc3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5293d7f6-e18b-46b2-b38a-406dfe114873]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e445fc2f-5eab-495a-960d-235a1643bec5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:40:38 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:40:38 user nova-compute[75080]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af (non-flash)
Dec 05 15:40:38 user nova-compute[75080]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 (non-flash)
Dec 05 15:40:38 user nova-compute[75080]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)
Dec 05 15:40:38 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e445fc2f-5eab-495a-960d-235a1643bec5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:40:38 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:40:38 user nova-compute[75080]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af (non-flash)
Dec 05 15:40:38 user nova-compute[75080]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 (non-flash)
Dec 05 15:40:38 user nova-compute[75080]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)
Dec 05 15:40:38 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e445fc2f-5eab-495a-960d-235a1643bec5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f665c1e0160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189'): ({'sde'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-e445fc2f-5eab-495a-960d-235a1643bec5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Removing single pathed devices sde {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[007e8a65-1dc6-490e-b48e-170b96731037]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a7874e-6957-4361-b519-0f502861acee]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-e445fc2f-5eab-495a-960d-235a1643bec5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Flushing IO for device /dev/sde {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8cafbb-f31b-44a9-9259-d74ec417da06]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-e445fc2f-5eab-495a-960d-235a1643bec5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4852915b-0258-42cd-953a-c5e81176a5f1]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-e445fc2f-5eab-495a-960d-235a1643bec5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-e445fc2f-5eab-495a-960d-235a1643bec5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] SCSI volumes sde have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e445fc2f-5eab-495a-960d-235a1643bec5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3efd978-b4fc-4f94-8acb-fe750bb6edcf]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e445fc2f-5eab-495a-960d-235a1643bec5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0246c72f-870a-43b1-95df-c2ca8ead866b]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e445fc2f-5eab-495a-960d-235a1643bec5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189, portal: 172.16.0.220,3260]
Dec 05 15:40:38 user nova-compute[75080]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189, portal: 172.16.0.220,3260] successful.
Dec 05 15:40:38 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d684ef4-e120-48fc-82d6-ff0d3e9215c2]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e445fc2f-5eab-495a-960d-235a1643bec5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-e445fc2f-5eab-495a-960d-235a1643bec5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e445fc2f-5eab-495a-960d-235a1643bec5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] <== disconnect_volume: return (326ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:40:38 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e445fc2f-5eab-495a-960d-235a1643bec5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:40:39 user nova-compute[75080]: DEBUG nova.objects.instance [None req-e445fc2f-5eab-495a-960d-235a1643bec5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lazy-loading 'flavor' on Instance uuid fe780f8f-12ad-49c7-92f1-547694e4755e {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:40:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e445fc2f-5eab-495a-960d-235a1643bec5 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "fe780f8f-12ad-49c7-92f1-547694e4755e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.887s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:40:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "fe780f8f-12ad-49c7-92f1-547694e4755e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.753s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:40:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Acquiring lock "fe780f8f-12ad-49c7-92f1-547694e4755e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:40:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "fe780f8f-12ad-49c7-92f1-547694e4755e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:40:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "fe780f8f-12ad-49c7-92f1-547694e4755e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:40:39 user nova-compute[75080]: INFO nova.compute.manager [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Terminating instance
Dec 05 15:40:39 user nova-compute[75080]: DEBUG nova.compute.manager [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:40:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:39 user nova-compute[75080]: DEBUG nova.compute.manager [req-56177af9-f69f-43cc-8997-f5a3cde70aef req-25de7773-a22f-4729-b2f1-3b3e799c9c43 service nova] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Received event network-vif-unplugged-7d7165da-a177-4c78-85bb-9e3dbda56be8 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:40:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-56177af9-f69f-43cc-8997-f5a3cde70aef req-25de7773-a22f-4729-b2f1-3b3e799c9c43 service nova] Acquiring lock "fe780f8f-12ad-49c7-92f1-547694e4755e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:40:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-56177af9-f69f-43cc-8997-f5a3cde70aef req-25de7773-a22f-4729-b2f1-3b3e799c9c43 service nova] Lock "fe780f8f-12ad-49c7-92f1-547694e4755e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:40:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-56177af9-f69f-43cc-8997-f5a3cde70aef req-25de7773-a22f-4729-b2f1-3b3e799c9c43 service nova] Lock "fe780f8f-12ad-49c7-92f1-547694e4755e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:40:39 user nova-compute[75080]: DEBUG nova.compute.manager [req-56177af9-f69f-43cc-8997-f5a3cde70aef req-25de7773-a22f-4729-b2f1-3b3e799c9c43 service nova] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] No waiting events found dispatching network-vif-unplugged-7d7165da-a177-4c78-85bb-9e3dbda56be8 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:40:39 user nova-compute[75080]: DEBUG nova.compute.manager [req-56177af9-f69f-43cc-8997-f5a3cde70aef req-25de7773-a22f-4729-b2f1-3b3e799c9c43 service nova] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Received event network-vif-unplugged-7d7165da-a177-4c78-85bb-9e3dbda56be8 for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:40:40 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Instance destroyed successfully.
Dec 05 15:40:40 user nova-compute[75080]: DEBUG nova.objects.instance [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lazy-loading 'resources' on Instance uuid fe780f8f-12ad-49c7-92f1-547694e4755e {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:40:40 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:37:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1180066338',display_name='tempest-VolumesSnapshotTestJSON-instance-1180066338',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1180066338',id=38,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPT6lOJZ49XRTEfXgfj07Gq7/EVFnXSGjIkD4RCKh5KPuwkZ8ZmVBlaYHNVajxJSwnsAV5gT71prHXcwBBNGGdNUgRe/yWJ29eFxyyZLz9UCz6xPJvikKFe8/Y0m4GBlcQ==',key_name='tempest-keypair-618590875',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:37:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e8a1b1f1ed346949ac0f633ae7e530b',ramdisk_id='',reservation_id='r-e038mnoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1567075546',owner_user_name='tempest-VolumesSnapshotTestJSON-1567075546-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:37:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='025ecd26509b46b8b0157d0abe16eec8',uuid=fe780f8f-12ad-49c7-92f1-547694e4755e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d7165da-a177-4c78-85bb-9e3dbda56be8", "address": "fa:16:3e:8f:a1:9b", "network": {"id": "eb187ccd-700a-49df-881f-c61d4b90e612", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053782949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e8a1b1f1ed346949ac0f633ae7e530b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d7165da-a1", "ovs_interfaceid": "7d7165da-a177-4c78-85bb-9e3dbda56be8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:40:40 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Converting VIF {"id": "7d7165da-a177-4c78-85bb-9e3dbda56be8", "address": "fa:16:3e:8f:a1:9b", "network": {"id": "eb187ccd-700a-49df-881f-c61d4b90e612", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053782949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e8a1b1f1ed346949ac0f633ae7e530b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d7165da-a1", "ovs_interfaceid": "7d7165da-a177-4c78-85bb-9e3dbda56be8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:40:40 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:a1:9b,bridge_name='br-int',has_traffic_filtering=True,id=7d7165da-a177-4c78-85bb-9e3dbda56be8,network=Network(eb187ccd-700a-49df-881f-c61d4b90e612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d7165da-a1') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:40:40 user nova-compute[75080]: DEBUG os_vif [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:a1:9b,bridge_name='br-int',has_traffic_filtering=True,id=7d7165da-a177-4c78-85bb-9e3dbda56be8,network=Network(eb187ccd-700a-49df-881f-c61d4b90e612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d7165da-a1') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:40:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d7165da-a1, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:40:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=273f584b-0bd2-427e-b8dc-d02473a15c6a) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:40:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:40 user nova-compute[75080]: INFO os_vif [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:a1:9b,bridge_name='br-int',has_traffic_filtering=True,id=7d7165da-a177-4c78-85bb-9e3dbda56be8,network=Network(eb187ccd-700a-49df-881f-c61d4b90e612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d7165da-a1')
Dec 05 15:40:40 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:40:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NFZsCnci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:40:40 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:40:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:40:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:40:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:40 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eed73f6-e877-4809-bc03-653fa9780639]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:40:40 user nova-compute[75080]: No targets found.
Dec 05 15:40:40 user nova-compute[75080]: iSNS:
Dec 05 15:40:40 user nova-compute[75080]: No targets found.
Dec 05 15:40:40 user nova-compute[75080]: STATIC:
Dec 05 15:40:40 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399
Dec 05 15:40:40 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:40:40 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:40:40 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b
Dec 05 15:40:40 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:40:40 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:40:40 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af
Dec 05 15:40:40 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:40:40 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:40:40 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14
Dec 05 15:40:40 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:40:40 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:40:40 user nova-compute[75080]: FIRMWARE:
Dec 05 15:40:40 user nova-compute[75080]: No targets found.
Dec 05 15:40:40 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:40:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:40:40 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:40:40 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:40:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca733344-e116-455b-a863-c20edfcbf189', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:40:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:40 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e0f6e3-ecf8-453f-962a-90101b3f60dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:40 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e5921c-fe33-4a09-b452-57d8687a092d]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:40:40 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:40:40 user nova-compute[75080]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af (non-flash)
Dec 05 15:40:40 user nova-compute[75080]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)
Dec 05 15:40:40 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:40:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:40:40 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:40:40 user nova-compute[75080]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af (non-flash)
Dec 05 15:40:40 user nova-compute[75080]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)
Dec 05 15:40:40 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:40:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6638522200>, {}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:40:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Disconnecting from: [] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:40:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:40:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] <== disconnect_volume: return (74ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:40:40 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:40:40 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Deleting instance files /opt/stack/data/nova/instances/fe780f8f-12ad-49c7-92f1-547694e4755e_del
Dec 05 15:40:40 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Deletion of /opt/stack/data/nova/instances/fe780f8f-12ad-49c7-92f1-547694e4755e_del complete
Dec 05 15:40:40 user nova-compute[75080]: INFO nova.compute.manager [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Took 0.96 seconds to destroy the instance on the hypervisor.
Dec 05 15:40:40 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:40:40 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:40:40 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:40:40 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:40:40 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:40:40 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Took 0.69 seconds to deallocate network for instance.
Dec 05 15:40:40 user nova-compute[75080]: DEBUG nova.compute.manager [req-5444face-bb4d-4e0f-99d9-5e773141a20d req-672b10cb-78b1-4ffd-864f-fa444593f0bc service nova] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Received event network-vif-deleted-7d7165da-a177-4c78-85bb-9e3dbda56be8 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:40:40 user nova-compute[75080]: INFO nova.compute.manager [req-5444face-bb4d-4e0f-99d9-5e773141a20d req-672b10cb-78b1-4ffd-864f-fa444593f0bc service nova] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Neutron deleted interface 7d7165da-a177-4c78-85bb-9e3dbda56be8; detaching it from the instance and deleting it from the info cache
Dec 05 15:40:40 user nova-compute[75080]: DEBUG nova.network.neutron [req-5444face-bb4d-4e0f-99d9-5e773141a20d req-672b10cb-78b1-4ffd-864f-fa444593f0bc service nova] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:40:40 user nova-compute[75080]: DEBUG nova.compute.manager [req-5444face-bb4d-4e0f-99d9-5e773141a20d req-672b10cb-78b1-4ffd-864f-fa444593f0bc service nova] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Detach interface failed, port_id=7d7165da-a177-4c78-85bb-9e3dbda56be8, reason: Instance fe780f8f-12ad-49c7-92f1-547694e4755e could not be found. {{(pid=75080) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 15:40:40 user nova-compute[75080]: WARNING nova.volume.cinder [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Attachment 5d5e1bd6-a1b1-4147-ade6-1b123ea5f290 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 5d5e1bd6-a1b1-4147-ade6-1b123ea5f290. (HTTP 404) (Request-ID: req-a7d90c98-802c-470d-8a77-c50a6cb715b6)
Dec 05 15:40:40 user nova-compute[75080]: INFO nova.compute.manager [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Took 0.04 seconds to detach 1 volumes for instance.
Dec 05 15:40:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:40:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:40:41 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:40:41 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:40:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.261s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:40:41 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Deleted allocations for instance fe780f8f-12ad-49c7-92f1-547694e4755e
Dec 05 15:40:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-aad12830-a787-48b0-8859-6b92a673a428 tempest-VolumesSnapshotTestJSON-1567075546 tempest-VolumesSnapshotTestJSON-1567075546-project-member] Lock "fe780f8f-12ad-49c7-92f1-547694e4755e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.117s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:40:41 user nova-compute[75080]: DEBUG nova.compute.manager [req-718d794d-c293-49bd-884a-6b82cd4782ea req-c4a17c1e-4674-4906-9991-2acc17ad0db4 service nova] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Received event network-vif-plugged-7d7165da-a177-4c78-85bb-9e3dbda56be8 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:40:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-718d794d-c293-49bd-884a-6b82cd4782ea req-c4a17c1e-4674-4906-9991-2acc17ad0db4 service nova] Acquiring lock "fe780f8f-12ad-49c7-92f1-547694e4755e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:40:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-718d794d-c293-49bd-884a-6b82cd4782ea req-c4a17c1e-4674-4906-9991-2acc17ad0db4 service nova] Lock "fe780f8f-12ad-49c7-92f1-547694e4755e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:40:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-718d794d-c293-49bd-884a-6b82cd4782ea req-c4a17c1e-4674-4906-9991-2acc17ad0db4 service nova] Lock "fe780f8f-12ad-49c7-92f1-547694e4755e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:40:41 user nova-compute[75080]: DEBUG nova.compute.manager [req-718d794d-c293-49bd-884a-6b82cd4782ea req-c4a17c1e-4674-4906-9991-2acc17ad0db4 service nova] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] No waiting events found dispatching network-vif-plugged-7d7165da-a177-4c78-85bb-9e3dbda56be8 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:40:41 user nova-compute[75080]: WARNING nova.compute.manager [req-718d794d-c293-49bd-884a-6b82cd4782ea req-c4a17c1e-4674-4906-9991-2acc17ad0db4 service nova] [instance: fe780f8f-12ad-49c7-92f1-547694e4755e] Received unexpected event network-vif-plugged-7d7165da-a177-4c78-85bb-9e3dbda56be8 for instance with vm_state deleted and task_state None.
Dec 05 15:40:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "e0331194-6106-4621-ab60-94bcf681222e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:40:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "e0331194-6106-4621-ab60-94bcf681222e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:40:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "e0331194-6106-4621-ab60-94bcf681222e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:40:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "e0331194-6106-4621-ab60-94bcf681222e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:40:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "e0331194-6106-4621-ab60-94bcf681222e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:40:43 user nova-compute[75080]: INFO nova.compute.manager [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Terminating instance
Dec 05 15:40:43 user nova-compute[75080]: DEBUG nova.compute.manager [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:40:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:43 user nova-compute[75080]: DEBUG nova.compute.manager [req-d832f420-38f9-4358-9187-7f1ece63a58a req-5698bc27-eebe-4468-a115-08b4a4c6cf7e service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] Received event network-vif-unplugged-12153aa9-8336-46dc-8491-6c28da3646a3 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:40:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d832f420-38f9-4358-9187-7f1ece63a58a req-5698bc27-eebe-4468-a115-08b4a4c6cf7e service nova] Acquiring lock "e0331194-6106-4621-ab60-94bcf681222e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:40:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d832f420-38f9-4358-9187-7f1ece63a58a req-5698bc27-eebe-4468-a115-08b4a4c6cf7e service nova] Lock "e0331194-6106-4621-ab60-94bcf681222e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:40:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d832f420-38f9-4358-9187-7f1ece63a58a req-5698bc27-eebe-4468-a115-08b4a4c6cf7e service nova] Lock "e0331194-6106-4621-ab60-94bcf681222e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:40:43 user nova-compute[75080]: DEBUG nova.compute.manager [req-d832f420-38f9-4358-9187-7f1ece63a58a req-5698bc27-eebe-4468-a115-08b4a4c6cf7e service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] No waiting events found dispatching network-vif-unplugged-12153aa9-8336-46dc-8491-6c28da3646a3 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:40:43 user nova-compute[75080]: DEBUG nova.compute.manager [req-d832f420-38f9-4358-9187-7f1ece63a58a req-5698bc27-eebe-4468-a115-08b4a4c6cf7e service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] Received event network-vif-unplugged-12153aa9-8336-46dc-8491-6c28da3646a3 for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:40:44 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: e0331194-6106-4621-ab60-94bcf681222e] Instance destroyed successfully.
Dec 05 15:40:44 user nova-compute[75080]: DEBUG nova.objects.instance [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lazy-loading 'resources' on Instance uuid e0331194-6106-4621-ab60-94bcf681222e {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:35:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1468368929',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1468368929',id=36,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:37:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97145ab79b414c4fb8772c71e9414581',ramdisk_id='',reservation_id='r-cqnwpz86',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2060228993',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:38:58Z,user_data=None,user_id='829d709c32db431199af609ddbc8b090',uuid=e0331194-6106-4621-ab60-94bcf681222e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12153aa9-8336-46dc-8491-6c28da3646a3", "address": "fa:16:3e:0d:84:cd", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12153aa9-83", "ovs_interfaceid": "12153aa9-8336-46dc-8491-6c28da3646a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Converting VIF {"id": "12153aa9-8336-46dc-8491-6c28da3646a3", "address": "fa:16:3e:0d:84:cd", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12153aa9-83", "ovs_interfaceid": "12153aa9-8336-46dc-8491-6c28da3646a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:84:cd,bridge_name='br-int',has_traffic_filtering=True,id=12153aa9-8336-46dc-8491-6c28da3646a3,network=Network(61aa968d-7e44-4ef2-955f-2e5441416f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12153aa9-83') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG os_vif [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:84:cd,bridge_name='br-int',has_traffic_filtering=True,id=12153aa9-8336-46dc-8491-6c28da3646a3,network=Network(61aa968d-7e44-4ef2-955f-2e5441416f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12153aa9-83') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap12153aa9-83, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f23a7748-438f-483c-9555-0d32d56115a4) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:44 user nova-compute[75080]: INFO os_vif [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:84:cd,bridge_name='br-int',has_traffic_filtering=True,id=12153aa9-8336-46dc-8491-6c28da3646a3,network=Network(61aa968d-7e44-4ef2-955f-2e5441416f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12153aa9-83')
Dec 05 15:40:44 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ySIZWThQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:40:44 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:40:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aaf729c-1933-4aea-b93d-74397314dee5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:40:44 user nova-compute[75080]: No targets found.
Dec 05 15:40:44 user nova-compute[75080]: iSNS:
Dec 05 15:40:44 user nova-compute[75080]: No targets found.
Dec 05 15:40:44 user nova-compute[75080]: STATIC:
Dec 05 15:40:44 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399
Dec 05 15:40:44 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:40:44 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:40:44 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b
Dec 05 15:40:44 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:40:44 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:40:44 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af
Dec 05 15:40:44 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:40:44 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:40:44 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14
Dec 05 15:40:44 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:40:44 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:40:44 user nova-compute[75080]: FIRMWARE:
Dec 05 15:40:44 user nova-compute[75080]: No targets found.
Dec 05 15:40:44 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:40:44 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:40:44 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ca4ba8-2e09-4508-9459-d3dcb8527d60]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2c38e8-aa4d-4875-8592-0a3f54d6075e]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:40:44 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:40:44 user nova-compute[75080]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af (non-flash)
Dec 05 15:40:44 user nova-compute[75080]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)
Dec 05 15:40:44 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:40:44 user nova-compute[75080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 (non-flash)
Dec 05 15:40:44 user nova-compute[75080]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af (non-flash)
Dec 05 15:40:44 user nova-compute[75080]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)
Dec 05 15:40:44 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f66384aba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14'): ({'sdb'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Removing single pathed devices sdb {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b113a67d-021b-4f8f-bb70-5abeb59b873a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f607eb-89fd-4365-99ef-c6975f805ff7]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Flushing IO for device /dev/sdb {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c226e2b-daa9-485c-b897-75aa805ac340]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[637bc622-581e-4363-a859-d2b688c2ac7c]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO72198469-2d2ec534f85cf078', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_72198469', '/dev/disk/by-id/scsi-23264326563353334') {{(pid=86242) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cc9049-f084-4993-86f8-f641f48d0bac]: (4, None) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d9a107-992a-4c28-9143-bf4d3ae832e4]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b0e324-4b61-49ae-aa50-0f09b3bffd39]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14, portal: 172.16.0.220,3260]
Dec 05 15:40:44 user nova-compute[75080]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14, portal: 172.16.0.220,3260] successful.
Dec 05 15:40:44 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:127a183f-56a0-46a7-b282-3478ffda6e14 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a5fffb-f953-4bb9-bbb3-85d27761ee2b]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] <== disconnect_volume: return (341ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:40:44 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Deleting instance files /opt/stack/data/nova/instances/e0331194-6106-4621-ab60-94bcf681222e_del
Dec 05 15:40:44 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Deletion of /opt/stack/data/nova/instances/e0331194-6106-4621-ab60-94bcf681222e_del complete
Dec 05 15:40:44 user nova-compute[75080]: INFO nova.compute.manager [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Took 1.18 seconds to destroy the instance on the hypervisor.
Dec 05 15:40:44 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: e0331194-6106-4621-ab60-94bcf681222e] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:40:44 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: e0331194-6106-4621-ab60-94bcf681222e] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:40:45 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: e0331194-6106-4621-ab60-94bcf681222e] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:40:45 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: e0331194-6106-4621-ab60-94bcf681222e] Took 0.42 seconds to deallocate network for instance.
Dec 05 15:40:46 user nova-compute[75080]: DEBUG nova.compute.manager [req-c203be20-48bf-4180-b63a-a4f83d85138c req-7710dc32-cd8e-41e5-8685-ca991d9b74db service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] Received event network-vif-plugged-12153aa9-8336-46dc-8491-6c28da3646a3 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:40:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c203be20-48bf-4180-b63a-a4f83d85138c req-7710dc32-cd8e-41e5-8685-ca991d9b74db service nova] Acquiring lock "e0331194-6106-4621-ab60-94bcf681222e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:40:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c203be20-48bf-4180-b63a-a4f83d85138c req-7710dc32-cd8e-41e5-8685-ca991d9b74db service nova] Lock "e0331194-6106-4621-ab60-94bcf681222e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:40:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c203be20-48bf-4180-b63a-a4f83d85138c req-7710dc32-cd8e-41e5-8685-ca991d9b74db service nova] Lock "e0331194-6106-4621-ab60-94bcf681222e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:40:46 user nova-compute[75080]: DEBUG nova.compute.manager [req-c203be20-48bf-4180-b63a-a4f83d85138c req-7710dc32-cd8e-41e5-8685-ca991d9b74db service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] No waiting events found dispatching network-vif-plugged-12153aa9-8336-46dc-8491-6c28da3646a3 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:40:46 user nova-compute[75080]: WARNING nova.compute.manager [req-c203be20-48bf-4180-b63a-a4f83d85138c req-7710dc32-cd8e-41e5-8685-ca991d9b74db service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] Received unexpected event network-vif-plugged-12153aa9-8336-46dc-8491-6c28da3646a3 for instance with vm_state active and task_state deleting.
Dec 05 15:40:46 user nova-compute[75080]: DEBUG nova.compute.manager [req-c203be20-48bf-4180-b63a-a4f83d85138c req-7710dc32-cd8e-41e5-8685-ca991d9b74db service nova] [instance: e0331194-6106-4621-ab60-94bcf681222e] Received event network-vif-deleted-12153aa9-8336-46dc-8491-6c28da3646a3 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:40:46 user nova-compute[75080]: INFO nova.compute.manager [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: e0331194-6106-4621-ab60-94bcf681222e] Took 0.95 seconds to detach 1 volumes for instance.
Dec 05 15:40:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:40:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:40:46 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:40:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:40:46 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:40:46 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:40:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:40:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.105s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:40:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:40:46 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:40:46 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Deleted allocations for instance e0331194-6106-4621-ab60-94bcf681222e
Dec 05 15:40:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-374f7168-711d-4cd3-9768-7b7c819e73e2 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "e0331194-6106-4621-ab60-94bcf681222e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.978s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:40:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:40:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:47 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:40:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:40:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:40:48 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:40:48 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:40:48 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:40:48 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=8243MB free_disk=24.790061950683594GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:40:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:40:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:40:48 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 07b025ff-4a9d-48a2-b950-b8f2d165f33c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:40:48 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance ab882db7-e6d7-44ca-9ea4-ae2fa68f7929 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:40:48 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance b47129e8-c02b-4107-af4f-329173dd453f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:40:48 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 1e352b3b-ee04-42f6-af53-973c3154a342 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:40:48 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 675f9326-411b-4d0d-921c-f5375ffec457 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:40:48 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:40:48 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:40:48 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:40:48 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:40:48 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:40:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:40:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.361s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:40:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:50 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:40:50 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:40:50 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Rebuilding the list of instances to heal {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 15:40:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-07b025ff-4a9d-48a2-b950-b8f2d165f33c" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:40:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-07b025ff-4a9d-48a2-b950-b8f2d165f33c" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:40:50 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 15:40:50 user nova-compute[75080]: DEBUG nova.objects.instance [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lazy-loading 'info_cache' on Instance uuid 07b025ff-4a9d-48a2-b950-b8f2d165f33c {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:40:50 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Updating instance_info_cache with network_info: [{"id": "b499a54e-2aab-4f63-a634-66c6a627bb4a", "address": "fa:16:3e:14:03:09", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb499a54e-2a", "ovs_interfaceid": "b499a54e-2aab-4f63-a634-66c6a627bb4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:40:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-07b025ff-4a9d-48a2-b950-b8f2d165f33c" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:40:50 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 15:40:50 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:40:50 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:40:50 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:40:50 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:40:52 user nova-compute[75080]: DEBUG nova.compute.manager [req-d966956c-b006-4ca4-8e78-af676b5cb366 req-b3769d05-4e49-43d9-b989-09bf2103ec93 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Received event network-changed-b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:40:52 user nova-compute[75080]: DEBUG nova.compute.manager [req-d966956c-b006-4ca4-8e78-af676b5cb366 req-b3769d05-4e49-43d9-b989-09bf2103ec93 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Refreshing instance network info cache due to event network-changed-b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:40:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d966956c-b006-4ca4-8e78-af676b5cb366 req-b3769d05-4e49-43d9-b989-09bf2103ec93 service nova] Acquiring lock "refresh_cache-1e352b3b-ee04-42f6-af53-973c3154a342" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:40:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d966956c-b006-4ca4-8e78-af676b5cb366 req-b3769d05-4e49-43d9-b989-09bf2103ec93 service nova] Acquired lock "refresh_cache-1e352b3b-ee04-42f6-af53-973c3154a342" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:40:52 user nova-compute[75080]: DEBUG nova.network.neutron [req-d966956c-b006-4ca4-8e78-af676b5cb366 req-b3769d05-4e49-43d9-b989-09bf2103ec93 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Refreshing network info cache for port b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:40:52 user nova-compute[75080]: DEBUG nova.network.neutron [req-d966956c-b006-4ca4-8e78-af676b5cb366 req-b3769d05-4e49-43d9-b989-09bf2103ec93 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Updated VIF entry in instance network info cache for port b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:40:52 user nova-compute[75080]: DEBUG nova.network.neutron [req-d966956c-b006-4ca4-8e78-af676b5cb366 req-b3769d05-4e49-43d9-b989-09bf2103ec93 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Updating instance_info_cache with network_info: [{"id": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "address": "fa:16:3e:47:d3:7c", "network": {"id": "1151f7c9-f853-4f06-93d7-74536b8b12ac", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420489370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549e67b7f2574eb38f3395452b647de7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1a68f60-ce", "ovs_interfaceid": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:40:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d966956c-b006-4ca4-8e78-af676b5cb366 req-b3769d05-4e49-43d9-b989-09bf2103ec93 service nova] Releasing lock "refresh_cache-1e352b3b-ee04-42f6-af53-973c3154a342" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:40:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:53 user nova-compute[75080]: DEBUG nova.compute.manager [req-121b8d3b-1876-4db9-aa83-ccdb983125bc req-e8aba802-e01b-4f33-a843-6ee79b021df8 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Received event network-changed-b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:40:53 user nova-compute[75080]: DEBUG nova.compute.manager [req-121b8d3b-1876-4db9-aa83-ccdb983125bc req-e8aba802-e01b-4f33-a843-6ee79b021df8 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Refreshing instance network info cache due to event network-changed-b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:40:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-121b8d3b-1876-4db9-aa83-ccdb983125bc req-e8aba802-e01b-4f33-a843-6ee79b021df8 service nova] Acquiring lock "refresh_cache-1e352b3b-ee04-42f6-af53-973c3154a342" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:40:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-121b8d3b-1876-4db9-aa83-ccdb983125bc req-e8aba802-e01b-4f33-a843-6ee79b021df8 service nova] Acquired lock "refresh_cache-1e352b3b-ee04-42f6-af53-973c3154a342" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:40:53 user nova-compute[75080]: DEBUG nova.network.neutron [req-121b8d3b-1876-4db9-aa83-ccdb983125bc req-e8aba802-e01b-4f33-a843-6ee79b021df8 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Refreshing network info cache for port b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:40:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a076888b-d9de-4bbc-b9a4-03946b3f0010 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquiring lock "1e352b3b-ee04-42f6-af53-973c3154a342" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:40:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a076888b-d9de-4bbc-b9a4-03946b3f0010 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "1e352b3b-ee04-42f6-af53-973c3154a342" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:40:53 user nova-compute[75080]: INFO nova.compute.manager [None req-a076888b-d9de-4bbc-b9a4-03946b3f0010 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Detaching volume 91cc30e8-ecf0-4547-853f-d34403b077af
Dec 05 15:40:53 user nova-compute[75080]: INFO nova.virt.block_device [None req-a076888b-d9de-4bbc-b9a4-03946b3f0010 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Attempting to driver detach volume 91cc30e8-ecf0-4547-853f-d34403b077af from mountpoint /dev/vdb
Dec 05 15:40:53 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a076888b-d9de-4bbc-b9a4-03946b3f0010 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Attempting to detach device vdb from instance 1e352b3b-ee04-42f6-af53-973c3154a342 from the persistent domain config. {{(pid=75080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 15:40:53 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-a076888b-d9de-4bbc-b9a4-03946b3f0010 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:40:53 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:40:53 user nova-compute[75080]:   <source dev="/dev/sdd"/>
Dec 05 15:40:53 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:40:53 user nova-compute[75080]:   <serial>91cc30e8-ecf0-4547-853f-d34403b077af</serial>
Dec 05 15:40:53 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 05 15:40:53 user nova-compute[75080]: </disk>
Dec 05 15:40:53 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:40:53 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-a076888b-d9de-4bbc-b9a4-03946b3f0010 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Successfully detached device vdb from instance 1e352b3b-ee04-42f6-af53-973c3154a342 from the persistent domain config.
Dec 05 15:40:53 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a076888b-d9de-4bbc-b9a4-03946b3f0010 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1e352b3b-ee04-42f6-af53-973c3154a342 from the live domain config. {{(pid=75080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 15:40:53 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-a076888b-d9de-4bbc-b9a4-03946b3f0010 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:40:53 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:40:53 user nova-compute[75080]:   <source dev="/dev/sdd"/>
Dec 05 15:40:53 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:40:53 user nova-compute[75080]:   <serial>91cc30e8-ecf0-4547-853f-d34403b077af</serial>
Dec 05 15:40:53 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 05 15:40:53 user nova-compute[75080]: </disk>
Dec 05 15:40:53 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:40:53 user nova-compute[75080]: DEBUG nova.network.neutron [req-121b8d3b-1876-4db9-aa83-ccdb983125bc req-e8aba802-e01b-4f33-a843-6ee79b021df8 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Updated VIF entry in instance network info cache for port b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:40:53 user nova-compute[75080]: DEBUG nova.network.neutron [req-121b8d3b-1876-4db9-aa83-ccdb983125bc req-e8aba802-e01b-4f33-a843-6ee79b021df8 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Updating instance_info_cache with network_info: [{"id": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "address": "fa:16:3e:47:d3:7c", "network": {"id": "1151f7c9-f853-4f06-93d7-74536b8b12ac", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420489370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549e67b7f2574eb38f3395452b647de7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1a68f60-ce", "ovs_interfaceid": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:40:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-121b8d3b-1876-4db9-aa83-ccdb983125bc req-e8aba802-e01b-4f33-a843-6ee79b021df8 service nova] Releasing lock "refresh_cache-1e352b3b-ee04-42f6-af53-973c3154a342" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:40:54 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a076888b-d9de-4bbc-b9a4-03946b3f0010 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1e352b3b-ee04-42f6-af53-973c3154a342 {{(pid=75080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 15:40:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:40:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:41:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:41:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:41:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:41:14 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-a076888b-d9de-4bbc-b9a4-03946b3f0010 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1e352b3b-ee04-42f6-af53-973c3154a342 is timed out.
Dec 05 15:41:14 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-a076888b-d9de-4bbc-b9a4-03946b3f0010 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Successfully detached device vdb from instance 1e352b3b-ee04-42f6-af53-973c3154a342 from the live domain config.
Dec 05 15:41:14 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a076888b-d9de-4bbc-b9a4-03946b3f0010 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a076888b-d9de-4bbc-b9a4-03946b3f0010 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BIKxwXhb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:41:14 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-a076888b-d9de-4bbc-b9a4-03946b3f0010 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:41:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-a076888b-d9de-4bbc-b9a4-03946b3f0010 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-a076888b-d9de-4bbc-b9a4-03946b3f0010 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bf2fde-fae5-43ab-9d58-c4515c486e15]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a076888b-d9de-4bbc-b9a4-03946b3f0010 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:41:14 user nova-compute[75080]: No targets found.
Dec 05 15:41:14 user nova-compute[75080]: iSNS:
Dec 05 15:41:14 user nova-compute[75080]: No targets found.
Dec 05 15:41:14 user nova-compute[75080]: STATIC:
Dec 05 15:41:14 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399
Dec 05 15:41:14 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:41:14 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:41:14 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b
Dec 05 15:41:14 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:41:14 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:41:14 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af
Dec 05 15:41:14 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:41:14 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:41:14 user nova-compute[75080]: FIRMWARE:
Dec 05 15:41:14 user nova-compute[75080]: No targets found.
Dec 05 15:41:14 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a076888b-d9de-4bbc-b9a4-03946b3f0010 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:41:14 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:41:14 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a076888b-d9de-4bbc-b9a4-03946b3f0010 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc44bf49-14a8-4db5-a229-88d0e7fa5c2f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee50d87-9954-46ab-8f5c-bea1a119ba8b]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a076888b-d9de-4bbc-b9a4-03946b3f0010 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:41:14 user nova-compute[75080]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af (non-flash)
Dec 05 15:41:14 user nova-compute[75080]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)
Dec 05 15:41:14 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a076888b-d9de-4bbc-b9a4-03946b3f0010 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:41:14 user nova-compute[75080]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af (non-flash)
Dec 05 15:41:14 user nova-compute[75080]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)
Dec 05 15:41:14 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a076888b-d9de-4bbc-b9a4-03946b3f0010 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f66384aa3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af'): ({'sdd'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-a076888b-d9de-4bbc-b9a4-03946b3f0010 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Removing single pathed devices sdd {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[de34d47c-9a95-4319-aa52-3489c37148db]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc61b1c-f0e1-4879-abad-7221b1a15cca]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-a076888b-d9de-4bbc-b9a4-03946b3f0010 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Flushing IO for device /dev/sdd {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[209aa362-431c-4264-888b-2c97c5134c99]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-a076888b-d9de-4bbc-b9a4-03946b3f0010 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf9ea69-f049-4abd-8a62-75776b6c377d]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-a076888b-d9de-4bbc-b9a4-03946b3f0010 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-a076888b-d9de-4bbc-b9a4-03946b3f0010 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] SCSI volumes sdd have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a076888b-d9de-4bbc-b9a4-03946b3f0010 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c885e74-9892-49f1-8464-5e3806cc6cf3]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a076888b-d9de-4bbc-b9a4-03946b3f0010 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdb52c9-ad3c-4472-9f93-42826db3f2ba]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a076888b-d9de-4bbc-b9a4-03946b3f0010 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af, portal: 172.16.0.220,3260]
Dec 05 15:41:14 user nova-compute[75080]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af, portal: 172.16.0.220,3260] successful.
Dec 05 15:41:14 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91cc30e8-ecf0-4547-853f-d34403b077af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2c1072-90d0-47f2-9003-8b41711fc998]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a076888b-d9de-4bbc-b9a4-03946b3f0010 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-a076888b-d9de-4bbc-b9a4-03946b3f0010 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a076888b-d9de-4bbc-b9a4-03946b3f0010 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] <== disconnect_volume: return (309ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a076888b-d9de-4bbc-b9a4-03946b3f0010 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:41:14 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:41:15 user nova-compute[75080]: DEBUG nova.objects.instance [None req-a076888b-d9de-4bbc-b9a4-03946b3f0010 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lazy-loading 'flavor' on Instance uuid 1e352b3b-ee04-42f6-af53-973c3154a342 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:41:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a076888b-d9de-4bbc-b9a4-03946b3f0010 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "1e352b3b-ee04-42f6-af53-973c3154a342" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.029s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:41:18 user nova-compute[75080]: DEBUG nova.compute.manager [req-5bbfd909-a211-4a42-86ec-ed6e00f1a17d req-4b586a4c-e4c6-45a9-844a-169203666838 service nova] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Received event network-changed-c66977a0-8209-4cd2-8c16-fe7819474020 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:41:18 user nova-compute[75080]: DEBUG nova.compute.manager [req-5bbfd909-a211-4a42-86ec-ed6e00f1a17d req-4b586a4c-e4c6-45a9-844a-169203666838 service nova] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Refreshing instance network info cache due to event network-changed-c66977a0-8209-4cd2-8c16-fe7819474020. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:41:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5bbfd909-a211-4a42-86ec-ed6e00f1a17d req-4b586a4c-e4c6-45a9-844a-169203666838 service nova] Acquiring lock "refresh_cache-2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:41:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5bbfd909-a211-4a42-86ec-ed6e00f1a17d req-4b586a4c-e4c6-45a9-844a-169203666838 service nova] Acquired lock "refresh_cache-2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:41:18 user nova-compute[75080]: DEBUG nova.network.neutron [req-5bbfd909-a211-4a42-86ec-ed6e00f1a17d req-4b586a4c-e4c6-45a9-844a-169203666838 service nova] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Refreshing network info cache for port c66977a0-8209-4cd2-8c16-fe7819474020 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:41:18 user nova-compute[75080]: DEBUG nova.network.neutron [req-5bbfd909-a211-4a42-86ec-ed6e00f1a17d req-4b586a4c-e4c6-45a9-844a-169203666838 service nova] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Updated VIF entry in instance network info cache for port c66977a0-8209-4cd2-8c16-fe7819474020. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:41:18 user nova-compute[75080]: DEBUG nova.network.neutron [req-5bbfd909-a211-4a42-86ec-ed6e00f1a17d req-4b586a4c-e4c6-45a9-844a-169203666838 service nova] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Updating instance_info_cache with network_info: [{"id": "c66977a0-8209-4cd2-8c16-fe7819474020", "address": "fa:16:3e:c4:b6:76", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66977a0-82", "ovs_interfaceid": "c66977a0-8209-4cd2-8c16-fe7819474020", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:41:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5bbfd909-a211-4a42-86ec-ed6e00f1a17d req-4b586a4c-e4c6-45a9-844a-169203666838 service nova] Releasing lock "refresh_cache-2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:41:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:41:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:41:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:41:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:41:23 user nova-compute[75080]: DEBUG nova.objects.instance [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lazy-loading 'flavor' on Instance uuid 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:41:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:41:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:41:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:41:23 user nova-compute[75080]: INFO nova.compute.manager [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Attaching volume accdc646-8152-435e-95b4-e826eedf2111 to /dev/vdb
Dec 05 15:41:23 user nova-compute[75080]: DEBUG os_brick.utils [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:41:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:23 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[648ce244-6d69-480c-b17f-0d70012cc4f8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:23 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2d16ee-1b9e-4d10-a644-1dd9b5e7f88f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:23 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4f5a3a-4c3e-48c1-901a-760527cf22e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:23 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40e6e54-187b-4269-9ba0-c3a6559a68fe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:41:23 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:41:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:41:23 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:41:23 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd22edc6-e700-4412-9aff-42b444ed2693]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:23 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:41:23 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:41:23 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:41:23 user nova-compute[75080]: DEBUG os_brick.utils [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:41:23 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Updating existing volume attachment record: 7da733d4-64d5-425c-b841-aabeeda6b6f9 {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:41:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:41:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:41:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:41:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:41:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3bc92b66-14aa-49cc-a30e-0dff9f0b95f4 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "b47129e8-c02b-4107-af4f-329173dd453f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:41:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3bc92b66-14aa-49cc-a30e-0dff9f0b95f4 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "b47129e8-c02b-4107-af4f-329173dd453f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:41:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3bc92b66-14aa-49cc-a30e-0dff9f0b95f4 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "b47129e8-c02b-4107-af4f-329173dd453f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:41:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3bc92b66-14aa-49cc-a30e-0dff9f0b95f4 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "b47129e8-c02b-4107-af4f-329173dd453f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:41:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3bc92b66-14aa-49cc-a30e-0dff9f0b95f4 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "b47129e8-c02b-4107-af4f-329173dd453f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:41:34 user nova-compute[75080]: INFO nova.compute.manager [None req-3bc92b66-14aa-49cc-a30e-0dff9f0b95f4 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Terminating instance
Dec 05 15:41:34 user nova-compute[75080]: DEBUG nova.compute.manager [None req-3bc92b66-14aa-49cc-a30e-0dff9f0b95f4 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:41:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:41:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:41:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:41:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:41:35 user nova-compute[75080]: DEBUG nova.compute.manager [req-d06d7ff8-13a8-4e32-a7c1-477bfe339b51 req-7884b298-7ccf-48c9-a7d8-e6c16b54347a service nova] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Received event network-vif-unplugged-c926ed6d-3eed-4727-9a0f-5a9f76c85982 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:41:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d06d7ff8-13a8-4e32-a7c1-477bfe339b51 req-7884b298-7ccf-48c9-a7d8-e6c16b54347a service nova] Acquiring lock "b47129e8-c02b-4107-af4f-329173dd453f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:41:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d06d7ff8-13a8-4e32-a7c1-477bfe339b51 req-7884b298-7ccf-48c9-a7d8-e6c16b54347a service nova] Lock "b47129e8-c02b-4107-af4f-329173dd453f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:41:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d06d7ff8-13a8-4e32-a7c1-477bfe339b51 req-7884b298-7ccf-48c9-a7d8-e6c16b54347a service nova] Lock "b47129e8-c02b-4107-af4f-329173dd453f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:41:35 user nova-compute[75080]: DEBUG nova.compute.manager [req-d06d7ff8-13a8-4e32-a7c1-477bfe339b51 req-7884b298-7ccf-48c9-a7d8-e6c16b54347a service nova] [instance: b47129e8-c02b-4107-af4f-329173dd453f] No waiting events found dispatching network-vif-unplugged-c926ed6d-3eed-4727-9a0f-5a9f76c85982 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:41:35 user nova-compute[75080]: DEBUG nova.compute.manager [req-d06d7ff8-13a8-4e32-a7c1-477bfe339b51 req-7884b298-7ccf-48c9-a7d8-e6c16b54347a service nova] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Received event network-vif-unplugged-c926ed6d-3eed-4727-9a0f-5a9f76c85982 for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:41:35 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Instance destroyed successfully.
Dec 05 15:41:35 user nova-compute[75080]: DEBUG nova.objects.instance [None req-3bc92b66-14aa-49cc-a30e-0dff9f0b95f4 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lazy-loading 'resources' on Instance uuid b47129e8-c02b-4107-af4f-329173dd453f {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:41:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-3bc92b66-14aa-49cc-a30e-0dff9f0b95f4 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:31:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1736206662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1736206662',id=31,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:31:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97145ab79b414c4fb8772c71e9414581',ramdisk_id='',reservation_id='r-6s6lrb02',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2060228993',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:33:19Z,user_data=None,user_id='829d709c32db431199af609ddbc8b090',uuid=b47129e8-c02b-4107-af4f-329173dd453f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c926ed6d-3eed-4727-9a0f-5a9f76c85982", "address": "fa:16:3e:37:91:eb", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc926ed6d-3e", "ovs_interfaceid": "c926ed6d-3eed-4727-9a0f-5a9f76c85982", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:41:35 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-3bc92b66-14aa-49cc-a30e-0dff9f0b95f4 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Converting VIF {"id": "c926ed6d-3eed-4727-9a0f-5a9f76c85982", "address": "fa:16:3e:37:91:eb", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc926ed6d-3e", "ovs_interfaceid": "c926ed6d-3eed-4727-9a0f-5a9f76c85982", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:41:35 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-3bc92b66-14aa-49cc-a30e-0dff9f0b95f4 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:91:eb,bridge_name='br-int',has_traffic_filtering=True,id=c926ed6d-3eed-4727-9a0f-5a9f76c85982,network=Network(61aa968d-7e44-4ef2-955f-2e5441416f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc926ed6d-3e') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:41:35 user nova-compute[75080]: DEBUG os_vif [None req-3bc92b66-14aa-49cc-a30e-0dff9f0b95f4 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:91:eb,bridge_name='br-int',has_traffic_filtering=True,id=c926ed6d-3eed-4727-9a0f-5a9f76c85982,network=Network(61aa968d-7e44-4ef2-955f-2e5441416f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc926ed6d-3e') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:41:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:41:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc926ed6d-3e, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:41:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:41:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:41:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4e790dec-8d65-4b33-b370-d75af2aac79c) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:41:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:41:35 user nova-compute[75080]: INFO os_vif [None req-3bc92b66-14aa-49cc-a30e-0dff9f0b95f4 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:91:eb,bridge_name='br-int',has_traffic_filtering=True,id=c926ed6d-3eed-4727-9a0f-5a9f76c85982,network=Network(61aa968d-7e44-4ef2-955f-2e5441416f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc926ed6d-3e')
Dec 05 15:41:35 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-3bc92b66-14aa-49cc-a30e-0dff9f0b95f4 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Deleting instance files /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f_del
Dec 05 15:41:35 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-3bc92b66-14aa-49cc-a30e-0dff9f0b95f4 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Deletion of /opt/stack/data/nova/instances/b47129e8-c02b-4107-af4f-329173dd453f_del complete
Dec 05 15:41:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:41:35 user nova-compute[75080]: INFO nova.compute.manager [None req-3bc92b66-14aa-49cc-a30e-0dff9f0b95f4 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Took 0.90 seconds to destroy the instance on the hypervisor.
Dec 05 15:41:35 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-3bc92b66-14aa-49cc-a30e-0dff9f0b95f4 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:41:35 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:41:35 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: b47129e8-c02b-4107-af4f-329173dd453f] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:41:35 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:41:35 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Took 0.47 seconds to deallocate network for instance.
Dec 05 15:41:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3bc92b66-14aa-49cc-a30e-0dff9f0b95f4 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:41:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3bc92b66-14aa-49cc-a30e-0dff9f0b95f4 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:41:36 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-3bc92b66-14aa-49cc-a30e-0dff9f0b95f4 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:41:36 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-3bc92b66-14aa-49cc-a30e-0dff9f0b95f4 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:41:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3bc92b66-14aa-49cc-a30e-0dff9f0b95f4 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.278s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:41:36 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-3bc92b66-14aa-49cc-a30e-0dff9f0b95f4 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Deleted allocations for instance b47129e8-c02b-4107-af4f-329173dd453f
Dec 05 15:41:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3bc92b66-14aa-49cc-a30e-0dff9f0b95f4 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "b47129e8-c02b-4107-af4f-329173dd453f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.849s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:41:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:41:37 user nova-compute[75080]: DEBUG nova.compute.manager [req-38d91725-a6a5-48e2-b5a6-f4cfd4ac2fc6 req-d2e70626-5291-42ae-ae94-1c80eaebc7cf service nova] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Received event network-vif-plugged-c926ed6d-3eed-4727-9a0f-5a9f76c85982 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:41:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-38d91725-a6a5-48e2-b5a6-f4cfd4ac2fc6 req-d2e70626-5291-42ae-ae94-1c80eaebc7cf service nova] Acquiring lock "b47129e8-c02b-4107-af4f-329173dd453f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:41:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-38d91725-a6a5-48e2-b5a6-f4cfd4ac2fc6 req-d2e70626-5291-42ae-ae94-1c80eaebc7cf service nova] Lock "b47129e8-c02b-4107-af4f-329173dd453f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:41:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-38d91725-a6a5-48e2-b5a6-f4cfd4ac2fc6 req-d2e70626-5291-42ae-ae94-1c80eaebc7cf service nova] Lock "b47129e8-c02b-4107-af4f-329173dd453f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:41:37 user nova-compute[75080]: DEBUG nova.compute.manager [req-38d91725-a6a5-48e2-b5a6-f4cfd4ac2fc6 req-d2e70626-5291-42ae-ae94-1c80eaebc7cf service nova] [instance: b47129e8-c02b-4107-af4f-329173dd453f] No waiting events found dispatching network-vif-plugged-c926ed6d-3eed-4727-9a0f-5a9f76c85982 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:41:37 user nova-compute[75080]: WARNING nova.compute.manager [req-38d91725-a6a5-48e2-b5a6-f4cfd4ac2fc6 req-d2e70626-5291-42ae-ae94-1c80eaebc7cf service nova] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Received unexpected event network-vif-plugged-c926ed6d-3eed-4727-9a0f-5a9f76c85982 for instance with vm_state deleted and task_state None.
Dec 05 15:41:37 user nova-compute[75080]: DEBUG nova.compute.manager [req-38d91725-a6a5-48e2-b5a6-f4cfd4ac2fc6 req-d2e70626-5291-42ae-ae94-1c80eaebc7cf service nova] [instance: b47129e8-c02b-4107-af4f-329173dd453f] Received event network-vif-deleted-c926ed6d-3eed-4727-9a0f-5a9f76c85982 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:41:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XpHJNTCh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:41:40 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:41:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:41:40 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:41:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:41:40 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:41:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8d1ade-b3ce-40e4-bd4a-14730796854d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:41:40 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[982f3f81-d498-47fc-9525-75b52b71d8ce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111] added
Dec 05 15:41:40 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[863dcdf2-f0cd-4065-ace8-bcff3c364a14]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.050s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cda5b7-790d-4478-8c18-f8f5e15a7ab0]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XpHJNTCh {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XpHJNTCh" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fe1dd0-b67f-452c-9ddd-ba64ca1285c5]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XpHJNTCh'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d0c3f1-868f-4bb0-8194-ec0169f8b057]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c418b7-1891-46f6-bd41-cf020ac3d9e4]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:41:40 user nova-compute[75080]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)
Dec 05 15:41:40 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:41:40 user nova-compute[75080]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)
Dec 05 15:41:40 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b95af34-ffe4-4469-afe7-3dc3357cd942]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111, portal: 172.16.0.220,3260]
Dec 05 15:41:40 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111, portal: 172.16.0.220,3260] successful.
Dec 05 15:41:40 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f77da18-18f9-4050-ac64-983f09494a52]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1796005d-0716-475b-8b48-58b0e0655ddc]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:41:40 user nova-compute[75080]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)
Dec 05 15:41:40 user nova-compute[75080]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 (non-flash)
Dec 05 15:41:40 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:41:40 user nova-compute[75080]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)
Dec 05 15:41:40 user nova-compute[75080]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 (non-flash)
Dec 05 15:41:40 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[710c75bd-e915-4c6c-b6e3-2846c9d9bfd7]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:41:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XpHJNTCh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:41:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:41:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '26137663739313837', 'path': '/dev/sdb'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:41:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137663739313837', 'path': '/dev/sdb'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:41:41 user nova-compute[75080]: DEBUG nova.objects.instance [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lazy-loading 'flavor' on Instance uuid 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:41:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 15:41:41 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:41:41 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 15:41:41 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:41:41 user nova-compute[75080]:   <serial>accdc646-8152-435e-95b4-e826eedf2111</serial>
Dec 05 15:41:41 user nova-compute[75080]: </disk>
Dec 05 15:41:41 user nova-compute[75080]:  {{(pid=75080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 15:41:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:41:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:41:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] No VIF found with MAC fa:16:3e:c4:b6:76, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:41:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-10404f08-32de-4b19-b18f-ccb40443b2b9 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.293s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:41:42 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:41:45 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:41:45 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:41:45 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:41:45 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:41:47 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:41:47 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:41:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:41:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:41:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:41:47 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:41:47 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:41:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:48 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:41:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-56fb638f-fbca-4f69-8c29-5dfcd390b7e7 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquiring lock "1e352b3b-ee04-42f6-af53-973c3154a342" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:41:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-56fb638f-fbca-4f69-8c29-5dfcd390b7e7 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "1e352b3b-ee04-42f6-af53-973c3154a342" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:41:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-56fb638f-fbca-4f69-8c29-5dfcd390b7e7 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquiring lock "1e352b3b-ee04-42f6-af53-973c3154a342-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:41:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-56fb638f-fbca-4f69-8c29-5dfcd390b7e7 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "1e352b3b-ee04-42f6-af53-973c3154a342-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:41:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-56fb638f-fbca-4f69-8c29-5dfcd390b7e7 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "1e352b3b-ee04-42f6-af53-973c3154a342-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:41:48 user nova-compute[75080]: INFO nova.compute.manager [None req-56fb638f-fbca-4f69-8c29-5dfcd390b7e7 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Terminating instance
Dec 05 15:41:48 user nova-compute[75080]: DEBUG nova.compute.manager [None req-56fb638f-fbca-4f69-8c29-5dfcd390b7e7 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:41:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:41:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:41:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:41:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:48 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:41:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG nova.compute.manager [req-a1f66675-d418-45bd-8a91-7ce1c8a7dcbf req-c11b9220-5ae5-48ed-bfd2-3b5eca884afd service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Received event network-vif-unplugged-b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a1f66675-d418-45bd-8a91-7ce1c8a7dcbf req-c11b9220-5ae5-48ed-bfd2-3b5eca884afd service nova] Acquiring lock "1e352b3b-ee04-42f6-af53-973c3154a342-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a1f66675-d418-45bd-8a91-7ce1c8a7dcbf req-c11b9220-5ae5-48ed-bfd2-3b5eca884afd service nova] Lock "1e352b3b-ee04-42f6-af53-973c3154a342-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a1f66675-d418-45bd-8a91-7ce1c8a7dcbf req-c11b9220-5ae5-48ed-bfd2-3b5eca884afd service nova] Lock "1e352b3b-ee04-42f6-af53-973c3154a342-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG nova.compute.manager [req-a1f66675-d418-45bd-8a91-7ce1c8a7dcbf req-c11b9220-5ae5-48ed-bfd2-3b5eca884afd service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] No waiting events found dispatching network-vif-unplugged-b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG nova.compute.manager [req-a1f66675-d418-45bd-8a91-7ce1c8a7dcbf req-c11b9220-5ae5-48ed-bfd2-3b5eca884afd service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Received event network-vif-unplugged-b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540 for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:41:49 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Instance destroyed successfully.
Dec 05 15:41:49 user nova-compute[75080]: DEBUG nova.objects.instance [None req-56fb638f-fbca-4f69-8c29-5dfcd390b7e7 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lazy-loading 'resources' on Instance uuid 1e352b3b-ee04-42f6-af53-973c3154a342 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:41:49 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:41:49 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:41:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=8473MB free_disk=24.911945343017578GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-56fb638f-fbca-4f69-8c29-5dfcd390b7e7 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:36:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1577552572',display_name='tempest-TestMinimumBasicScenario-server-1577552572',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1577552572',id=37,image_ref='83e7a794-d2df-4acd-be99-9f30b564a2d3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBVo56f6MpZ3G8aHK/NCskAJXqmivK9NR9tXYO7XFZF0y+subtUdlQz10O+5bsDv2J2MCK+m8HVQ7rQyVrJn+Sh0HIgj6JlsELedJ7Cd0brl0Jl9FO+4EMlr97RezQYIQ==',key_name='tempest-TestMinimumBasicScenario-1082211644',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:36:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='549e67b7f2574eb38f3395452b647de7',ramdisk_id='',reservation_id='r-p7hcs3hz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e7a794-d2df-4acd-be99-9f30b564a2d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1307764000',owner_user_name='tempest-TestMinimumBasicScenario-1307764000-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:39:08Z,user_data=None,user_id='e0cb687b9ede4bb8ac3e192766fa4f21',uuid=1e352b3b-ee04-42f6-af53-973c3154a342,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "address": "fa:16:3e:47:d3:7c", "network": {"id": "1151f7c9-f853-4f06-93d7-74536b8b12ac", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420489370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549e67b7f2574eb38f3395452b647de7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1a68f60-ce", "ovs_interfaceid": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-56fb638f-fbca-4f69-8c29-5dfcd390b7e7 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Converting VIF {"id": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "address": "fa:16:3e:47:d3:7c", "network": {"id": "1151f7c9-f853-4f06-93d7-74536b8b12ac", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420489370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549e67b7f2574eb38f3395452b647de7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1a68f60-ce", "ovs_interfaceid": "b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-56fb638f-fbca-4f69-8c29-5dfcd390b7e7 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:d3:7c,bridge_name='br-int',has_traffic_filtering=True,id=b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540,network=Network(1151f7c9-f853-4f06-93d7-74536b8b12ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1a68f60-ce') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG os_vif [None req-56fb638f-fbca-4f69-8c29-5dfcd390b7e7 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:d3:7c,bridge_name='br-int',has_traffic_filtering=True,id=b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540,network=Network(1151f7c9-f853-4f06-93d7-74536b8b12ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1a68f60-ce') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1a68f60-ce, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b5f41376-8b3f-42e3-a752-86ee62eff763) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:41:49 user nova-compute[75080]: INFO os_vif [None req-56fb638f-fbca-4f69-8c29-5dfcd390b7e7 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:d3:7c,bridge_name='br-int',has_traffic_filtering=True,id=b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540,network=Network(1151f7c9-f853-4f06-93d7-74536b8b12ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1a68f60-ce')
Dec 05 15:41:49 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-56fb638f-fbca-4f69-8c29-5dfcd390b7e7 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Deleting instance files /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342_del
Dec 05 15:41:49 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-56fb638f-fbca-4f69-8c29-5dfcd390b7e7 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Deletion of /opt/stack/data/nova/instances/1e352b3b-ee04-42f6-af53-973c3154a342_del complete
Dec 05 15:41:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Acquiring lock "675f9326-411b-4d0d-921c-f5375ffec457" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Lock "675f9326-411b-4d0d-921c-f5375ffec457" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Acquiring lock "675f9326-411b-4d0d-921c-f5375ffec457-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Lock "675f9326-411b-4d0d-921c-f5375ffec457-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Lock "675f9326-411b-4d0d-921c-f5375ffec457-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:41:49 user nova-compute[75080]: INFO nova.compute.manager [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Terminating instance
Dec 05 15:41:49 user nova-compute[75080]: INFO nova.compute.manager [None req-56fb638f-fbca-4f69-8c29-5dfcd390b7e7 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Took 0.94 seconds to destroy the instance on the hypervisor.
Dec 05 15:41:49 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-56fb638f-fbca-4f69-8c29-5dfcd390b7e7 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG nova.compute.manager [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 07b025ff-4a9d-48a2-b950-b8f2d165f33c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance ab882db7-e6d7-44ca-9ea4-ae2fa68f7929 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 1e352b3b-ee04-42f6-af53-973c3154a342 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 675f9326-411b-4d0d-921c-f5375ffec457 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:41:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.457s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG nova.compute.manager [req-8c83d54d-7abc-4b3e-9846-f29152533a8f req-663832d7-7561-4da7-89e9-aeb50bb5ccc6 service nova] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Received event network-vif-unplugged-e6fdf36d-c77d-4dbb-94c8-61d010e00884 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8c83d54d-7abc-4b3e-9846-f29152533a8f req-663832d7-7561-4da7-89e9-aeb50bb5ccc6 service nova] Acquiring lock "675f9326-411b-4d0d-921c-f5375ffec457-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8c83d54d-7abc-4b3e-9846-f29152533a8f req-663832d7-7561-4da7-89e9-aeb50bb5ccc6 service nova] Lock "675f9326-411b-4d0d-921c-f5375ffec457-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8c83d54d-7abc-4b3e-9846-f29152533a8f req-663832d7-7561-4da7-89e9-aeb50bb5ccc6 service nova] Lock "675f9326-411b-4d0d-921c-f5375ffec457-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG nova.compute.manager [req-8c83d54d-7abc-4b3e-9846-f29152533a8f req-663832d7-7561-4da7-89e9-aeb50bb5ccc6 service nova] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] No waiting events found dispatching network-vif-unplugged-e6fdf36d-c77d-4dbb-94c8-61d010e00884 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG nova.compute.manager [req-8c83d54d-7abc-4b3e-9846-f29152533a8f req-663832d7-7561-4da7-89e9-aeb50bb5ccc6 service nova] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Received event network-vif-unplugged-e6fdf36d-c77d-4dbb-94c8-61d010e00884 for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG nova.objects.instance [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lazy-loading 'flavor' on Instance uuid 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.152s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:41:50 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Instance destroyed successfully.
Dec 05 15:41:50 user nova-compute[75080]: DEBUG nova.objects.instance [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Lazy-loading 'resources' on Instance uuid 675f9326-411b-4d0d-921c-f5375ffec457 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T15:38:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-388294122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1207311612',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOHaSHjIWUzcs1FaMsetX+3Qdvz6+YCwRv1EvXdnmZXZwDLOl4AJxUX/t389zTETH0szJ2Ih2H3ox/1CCyz6EVUkTwws1K0LLBMLy8dIcwnjvHvzYMNik58gI35jDQnCw==',key_name='tempest-keypair-2048690446',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:40:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99c63445ed4f466b8c00af6d9bc40e42',ramdisk_id='',reservation_id='r-hir48rfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1910922312',owner_user_name='tempest-ServerActionsV293TestJSON-1910922312-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:40:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b1bbf8f0a8f44a3a5dc224bcf9e7139',uuid=675f9326-411b-4d0d-921c-f5375ffec457,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6fdf36d-c77d-4dbb-94c8-61d010e00884", "address": "fa:16:3e:76:b9:75", "network": {"id": "cab219d9-2a41-4553-9030-07efee59df1b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1667827966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c63445ed4f466b8c00af6d9bc40e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fdf36d-c7", "ovs_interfaceid": "e6fdf36d-c77d-4dbb-94c8-61d010e00884", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Converting VIF {"id": "e6fdf36d-c77d-4dbb-94c8-61d010e00884", "address": "fa:16:3e:76:b9:75", "network": {"id": "cab219d9-2a41-4553-9030-07efee59df1b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1667827966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99c63445ed4f466b8c00af6d9bc40e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fdf36d-c7", "ovs_interfaceid": "e6fdf36d-c77d-4dbb-94c8-61d010e00884", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:b9:75,bridge_name='br-int',has_traffic_filtering=True,id=e6fdf36d-c77d-4dbb-94c8-61d010e00884,network=Network(cab219d9-2a41-4553-9030-07efee59df1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6fdf36d-c7') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG os_vif [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:b9:75,bridge_name='br-int',has_traffic_filtering=True,id=e6fdf36d-c77d-4dbb-94c8-61d010e00884,network=Network(cab219d9-2a41-4553-9030-07efee59df1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6fdf36d-c7') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6fdf36d-c7, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1daa96dc-6c18-4b5f-8a82-03fe96057af4) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:41:50 user nova-compute[75080]: INFO os_vif [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:b9:75,bridge_name='br-int',has_traffic_filtering=True,id=e6fdf36d-c77d-4dbb-94c8-61d010e00884,network=Network(cab219d9-2a41-4553-9030-07efee59df1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6fdf36d-c7')
Dec 05 15:41:50 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OForJHUu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:41:50 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:41:50 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[444ec3a4-5f05-40dc-9e2c-f4d0b8a9bf53]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:41:50 user nova-compute[75080]: No targets found.
Dec 05 15:41:50 user nova-compute[75080]: iSNS:
Dec 05 15:41:50 user nova-compute[75080]: No targets found.
Dec 05 15:41:50 user nova-compute[75080]: STATIC:
Dec 05 15:41:50 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399
Dec 05 15:41:50 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:41:50 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:41:50 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111
Dec 05 15:41:50 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:41:50 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:41:50 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b
Dec 05 15:41:50 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:41:50 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:41:50 user nova-compute[75080]: FIRMWARE:
Dec 05 15:41:50 user nova-compute[75080]: No targets found.
Dec 05 15:41:50 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:41:50 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:41:50 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:41:50 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Took 0.84 seconds to deallocate network for instance.
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6d3154-8a04-4119-b792-ba80eea93750]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:41:50 user nova-compute[75080]: INFO nova.compute.manager [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Attaching volume a9091cd5-0fd2-4a68-89ce-a6deb89f0121 to /dev/vdc
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5c9fbd-8962-4ebf-b348-06fde92d290b]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:41:50 user nova-compute[75080]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)
Dec 05 15:41:50 user nova-compute[75080]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 (non-flash)
Dec 05 15:41:50 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:41:50 user nova-compute[75080]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b (non-flash)
Dec 05 15:41:50 user nova-compute[75080]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 (non-flash)
Dec 05 15:41:50 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f665c5ca830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b'): ({'sdc'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Removing single pathed devices sdc {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-56fb638f-fbca-4f69-8c29-5dfcd390b7e7 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-56fb638f-fbca-4f69-8c29-5dfcd390b7e7 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fa7bfa-f9ab-40da-8786-2b17b84be1ae]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e714f69-efe7-41bb-a6c4-f194d67b4299]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Flushing IO for device /dev/sdc {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dab8b9d-27d1-4388-aebe-a2e19397eb9d]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG os_brick.utils [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc86a9a-e040-40bf-99a5-3023a0ea2bcc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6640868-20ea-4520-a06d-a50268229a8d]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] SCSI volumes sdc have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_48f66dcb', '/dev/disk/by-id/scsi-23133316533333264', '/dev/disk/by-id/scsi-1SCST_BIO48f66dcb-131e332d88e3d90a') {{(pid=86242) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee051268-ca70-445d-b8c8-bb2366b3f87a]: (4, None) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[82953c33-4c1e-4090-966c-d25604ea00a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed57fa1a-7593-455b-918f-eadbece5e20e]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63dd6c5-1f96-4d37-9482-b48fb94f342e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[694ad412-8bbd-4c17-b897-4523478b4e11]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:41:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --logout" returned: 0 in 0.243s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:51 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f0027b-afc5-48d9-8fca-d6246fa671e3]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b, portal: 172.16.0.220,3260]
Dec 05 15:41:51 user nova-compute[75080]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b, portal: 172.16.0.220,3260] successful.
Dec 05 15:41:51 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:41:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:41:51 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:41:51 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5566d57c-10cd-4dfd-9e3e-3a8e11a01511]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:41:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:41:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:41:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:41:51 user nova-compute[75080]: DEBUG os_brick.utils [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] <== get_connector_properties: return (346ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:41:51 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Updating existing volume attachment record: e73017e2-293a-449b-802e-bcdcebc37925 {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:41:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e132bcf-9292-494f-bd93-f747af60818b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:41:51 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ac1a2b-e347-4e9e-9159-1d0f761d6f10]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:41:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:41:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.570s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:41:51 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] <== disconnect_volume: return (571ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:41:51 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:41:51 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Deleting instance files /opt/stack/data/nova/instances/675f9326-411b-4d0d-921c-f5375ffec457_del
Dec 05 15:41:51 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Deletion of /opt/stack/data/nova/instances/675f9326-411b-4d0d-921c-f5375ffec457_del complete
Dec 05 15:41:51 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-56fb638f-fbca-4f69-8c29-5dfcd390b7e7 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:41:51 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-56fb638f-fbca-4f69-8c29-5dfcd390b7e7 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:41:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-56fb638f-fbca-4f69-8c29-5dfcd390b7e7 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.532s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:41:51 user nova-compute[75080]: INFO nova.compute.manager [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Took 1.48 seconds to destroy the instance on the hypervisor.
Dec 05 15:41:51 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:41:51 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:41:51 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:41:51 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-56fb638f-fbca-4f69-8c29-5dfcd390b7e7 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Deleted allocations for instance 1e352b3b-ee04-42f6-af53-973c3154a342
Dec 05 15:41:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-56fb638f-fbca-4f69-8c29-5dfcd390b7e7 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "1e352b3b-ee04-42f6-af53-973c3154a342" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.571s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:41:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-83afd3d5-e9f0-4337-b1bd-caa7ee9cfda3 req-86245789-0d0c-4c57-982b-36b9fb4ec277 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Received event network-vif-plugged-b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:41:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-83afd3d5-e9f0-4337-b1bd-caa7ee9cfda3 req-86245789-0d0c-4c57-982b-36b9fb4ec277 service nova] Acquiring lock "1e352b3b-ee04-42f6-af53-973c3154a342-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:41:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-83afd3d5-e9f0-4337-b1bd-caa7ee9cfda3 req-86245789-0d0c-4c57-982b-36b9fb4ec277 service nova] Lock "1e352b3b-ee04-42f6-af53-973c3154a342-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:41:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-83afd3d5-e9f0-4337-b1bd-caa7ee9cfda3 req-86245789-0d0c-4c57-982b-36b9fb4ec277 service nova] Lock "1e352b3b-ee04-42f6-af53-973c3154a342-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:41:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-83afd3d5-e9f0-4337-b1bd-caa7ee9cfda3 req-86245789-0d0c-4c57-982b-36b9fb4ec277 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] No waiting events found dispatching network-vif-plugged-b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:41:51 user nova-compute[75080]: WARNING nova.compute.manager [req-83afd3d5-e9f0-4337-b1bd-caa7ee9cfda3 req-86245789-0d0c-4c57-982b-36b9fb4ec277 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Received unexpected event network-vif-plugged-b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540 for instance with vm_state deleted and task_state None.
Dec 05 15:41:51 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:41:51 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:41:52 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:41:52 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Took 0.87 seconds to deallocate network for instance.
Dec 05 15:41:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-ab882db7-e6d7-44ca-9ea4-ae2fa68f7929" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:41:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-ab882db7-e6d7-44ca-9ea4-ae2fa68f7929" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:41:52 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 15:41:52 user nova-compute[75080]: DEBUG nova.compute.manager [req-7ba80af4-2199-4410-a7c4-ecb49cad4a0d req-18b62ba3-4db2-44dc-a870-1c8d70358715 service nova] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Received event network-vif-plugged-e6fdf36d-c77d-4dbb-94c8-61d010e00884 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:41:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7ba80af4-2199-4410-a7c4-ecb49cad4a0d req-18b62ba3-4db2-44dc-a870-1c8d70358715 service nova] Acquiring lock "675f9326-411b-4d0d-921c-f5375ffec457-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:41:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7ba80af4-2199-4410-a7c4-ecb49cad4a0d req-18b62ba3-4db2-44dc-a870-1c8d70358715 service nova] Lock "675f9326-411b-4d0d-921c-f5375ffec457-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:41:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7ba80af4-2199-4410-a7c4-ecb49cad4a0d req-18b62ba3-4db2-44dc-a870-1c8d70358715 service nova] Lock "675f9326-411b-4d0d-921c-f5375ffec457-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:41:52 user nova-compute[75080]: DEBUG nova.compute.manager [req-7ba80af4-2199-4410-a7c4-ecb49cad4a0d req-18b62ba3-4db2-44dc-a870-1c8d70358715 service nova] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] No waiting events found dispatching network-vif-plugged-e6fdf36d-c77d-4dbb-94c8-61d010e00884 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:41:52 user nova-compute[75080]: WARNING nova.compute.manager [req-7ba80af4-2199-4410-a7c4-ecb49cad4a0d req-18b62ba3-4db2-44dc-a870-1c8d70358715 service nova] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Received unexpected event network-vif-plugged-e6fdf36d-c77d-4dbb-94c8-61d010e00884 for instance with vm_state active and task_state deleting.
Dec 05 15:41:52 user nova-compute[75080]: DEBUG nova.compute.manager [req-7ba80af4-2199-4410-a7c4-ecb49cad4a0d req-18b62ba3-4db2-44dc-a870-1c8d70358715 service nova] [instance: 1e352b3b-ee04-42f6-af53-973c3154a342] Received event network-vif-deleted-b1a68f60-ce89-4b5a-a10e-d1d3ae4cd540 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:41:52 user nova-compute[75080]: DEBUG nova.compute.manager [req-7ba80af4-2199-4410-a7c4-ecb49cad4a0d req-18b62ba3-4db2-44dc-a870-1c8d70358715 service nova] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Received event network-vif-deleted-e6fdf36d-c77d-4dbb-94c8-61d010e00884 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:41:52 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Updating instance_info_cache with network_info: [{"id": "af017697-07fb-4000-87d4-87f84dbd53bc", "address": "fa:16:3e:48:4c:fd", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf017697-07", "ovs_interfaceid": "af017697-07fb-4000-87d4-87f84dbd53bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:41:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-ab882db7-e6d7-44ca-9ea4-ae2fa68f7929" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:41:52 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 15:41:52 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:41:52 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:41:52 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:41:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:41:52 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:41:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:01 user nova-compute[75080]: INFO nova.compute.manager [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Took 9.79 seconds to detach 1 volumes for instance.
Dec 05 15:42:01 user nova-compute[75080]: DEBUG nova.compute.manager [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] [instance: 675f9326-411b-4d0d-921c-f5375ffec457] Deleting volume: 5e132bcf-9292-494f-bd93-f747af60818b {{(pid=75080) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 05 15:42:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:02 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:42:02 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:42:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.200s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:02 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Deleted allocations for instance 675f9326-411b-4d0d-921c-f5375ffec457
Dec 05 15:42:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3837a8c6-6649-47a6-9ec2-05fb32ef2998 tempest-ServerActionsV293TestJSON-1910922312 tempest-ServerActionsV293TestJSON-1910922312-project-member] Lock "675f9326-411b-4d0d-921c-f5375ffec457" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.643s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xlBSUhLj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:42:06 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:42:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:42:06 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:42:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:42:06 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:42:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121 -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcd4aba-a065-40f6-bf83-b1bafadfafb0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:42:06 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121 -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3505af4-0049-46ef-859a-9dcd559624cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121] added
Dec 05 15:42:06 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[057f2c1e-33c1-41b1-bd08-f52404cca932]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[66575a86-c535-42c4-9b7b-1ad6b6530c82]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xlBSUhLj {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xlBSUhLj" returned: 0 in 0.026s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd069bb0-5bc9-428d-af55-ad9f45890ac6]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xlBSUhLj'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7625e701-3066-4e08-a148-be116986313c]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2577dcd-238f-4b4e-8fe3-787738154b49]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:42:06 user nova-compute[75080]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 (non-flash)
Dec 05 15:42:06 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:42:06 user nova-compute[75080]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 (non-flash)
Dec 05 15:42:06 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121 -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3653dd-e7d6-42a6-b24a-4a2b882e9746]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121, portal: 172.16.0.220,3260]
Dec 05 15:42:06 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121, portal: 172.16.0.220,3260] successful.
Dec 05 15:42:06 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[266d64ce-a1f3-43a7-aa4e-c65d6dc8ca70]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95de0d6-6b79-4aca-acbb-7ee06432a864]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:42:06 user nova-compute[75080]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 (non-flash)
Dec 05 15:42:06 user nova-compute[75080]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121 (non-flash)
Dec 05 15:42:06 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:42:06 user nova-compute[75080]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 (non-flash)
Dec 05 15:42:06 user nova-compute[75080]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121 (non-flash)
Dec 05 15:42:06 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[70aed18e-6dbc-4d1e-b09e-3672c4210018]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:06 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: None {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:42:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:07 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:42:07 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xlBSUhLj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:42:07 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:42:07 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23836633337376662', 'path': '/dev/sdc'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:42:07 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836633337376662', 'path': '/dev/sdc'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:42:07 user nova-compute[75080]: DEBUG nova.objects.instance [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lazy-loading 'flavor' on Instance uuid 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:42:07 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 15:42:07 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:42:07 user nova-compute[75080]:   <source dev="/dev/sdc"/>
Dec 05 15:42:07 user nova-compute[75080]:   <target dev="vdc" bus="virtio"/>
Dec 05 15:42:07 user nova-compute[75080]:   <serial>a9091cd5-0fd2-4a68-89ce-a6deb89f0121</serial>
Dec 05 15:42:07 user nova-compute[75080]: </disk>
Dec 05 15:42:07 user nova-compute[75080]:  {{(pid=75080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 15:42:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:42:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:42:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:42:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] No VIF found with MAC fa:16:3e:c4:b6:76, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:42:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d6fb661f-7e62-482f-bf6a-5ee495d79f6e tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.362s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ad434471-f772-4af5-a767-519143c97584 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ad434471-f772-4af5-a767-519143c97584 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:09 user nova-compute[75080]: INFO nova.compute.manager [None req-ad434471-f772-4af5-a767-519143c97584 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Detaching volume accdc646-8152-435e-95b4-e826eedf2111
Dec 05 15:42:09 user nova-compute[75080]: INFO nova.virt.block_device [None req-ad434471-f772-4af5-a767-519143c97584 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Attempting to driver detach volume accdc646-8152-435e-95b4-e826eedf2111 from mountpoint /dev/vdb
Dec 05 15:42:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ad434471-f772-4af5-a767-519143c97584 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Attempting to detach device vdb from instance 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e from the persistent domain config. {{(pid=75080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 15:42:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-ad434471-f772-4af5-a767-519143c97584 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:42:09 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:42:09 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 15:42:09 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:42:09 user nova-compute[75080]:   <serial>accdc646-8152-435e-95b4-e826eedf2111</serial>
Dec 05 15:42:09 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 15:42:09 user nova-compute[75080]: </disk>
Dec 05 15:42:09 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:42:09 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-ad434471-f772-4af5-a767-519143c97584 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Successfully detached device vdb from instance 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e from the persistent domain config.
Dec 05 15:42:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ad434471-f772-4af5-a767-519143c97584 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e from the live domain config. {{(pid=75080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 15:42:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-ad434471-f772-4af5-a767-519143c97584 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:42:09 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:42:09 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 15:42:09 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:42:09 user nova-compute[75080]:   <serial>accdc646-8152-435e-95b4-e826eedf2111</serial>
Dec 05 15:42:09 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 15:42:09 user nova-compute[75080]: </disk>
Dec 05 15:42:09 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:42:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:10 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ad434471-f772-4af5-a767-519143c97584 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e {{(pid=75080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 15:42:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:11 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Acquiring lock "16868d8f-debd-4fcd-a3ad-16f99bad11d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Lock "16868d8f-debd-4fcd-a3ad-16f99bad11d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:13 user nova-compute[75080]: DEBUG nova.compute.manager [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:42:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:13 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:42:13 user nova-compute[75080]: INFO nova.compute.claims [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Claim successful on node user
Dec 05 15:42:13 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:42:13 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:42:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.342s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:14 user nova-compute[75080]: DEBUG nova.compute.manager [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:42:14 user nova-compute[75080]: DEBUG nova.compute.manager [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:42:14 user nova-compute[75080]: DEBUG nova.network.neutron [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:42:14 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:42:14 user nova-compute[75080]: DEBUG nova.compute.manager [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:42:14 user nova-compute[75080]: DEBUG nova.policy [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f8f9d10ee71a4458a571446e7ff39713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff4c097a2f04bd2b069acb5e67dc435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:42:14 user nova-compute[75080]: DEBUG nova.compute.manager [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:42:14 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:42:14 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Creating image(s)
Dec 05 15:42:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Acquiring lock "/opt/stack/data/nova/instances/16868d8f-debd-4fcd-a3ad-16f99bad11d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Lock "/opt/stack/data/nova/instances/16868d8f-debd-4fcd-a3ad-16f99bad11d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Lock "/opt/stack/data/nova/instances/16868d8f-debd-4fcd-a3ad-16f99bad11d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.177s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.176s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/16868d8f-debd-4fcd-a3ad-16f99bad11d4/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/16868d8f-debd-4fcd-a3ad-16f99bad11d4/disk 1073741824" returned: 0 in 0.053s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.192s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:14 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Checking if we can resize image /opt/stack/data/nova/instances/16868d8f-debd-4fcd-a3ad-16f99bad11d4/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 15:42:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16868d8f-debd-4fcd-a3ad-16f99bad11d4/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16868d8f-debd-4fcd-a3ad-16f99bad11d4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:15 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Cannot resize image /opt/stack/data/nova/instances/16868d8f-debd-4fcd-a3ad-16f99bad11d4/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 15:42:15 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:42:15 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Ensure instance console log exists: /opt/stack/data/nova/instances/16868d8f-debd-4fcd-a3ad-16f99bad11d4/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:42:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:15 user nova-compute[75080]: DEBUG nova.network.neutron [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Successfully created port: 11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:42:15 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:15 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG nova.network.neutron [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Successfully updated port: 11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Acquiring lock "refresh_cache-16868d8f-debd-4fcd-a3ad-16f99bad11d4" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Acquired lock "refresh_cache-16868d8f-debd-4fcd-a3ad-16f99bad11d4" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG nova.network.neutron [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG nova.compute.manager [req-b5d0289d-6f86-46a1-b3ed-5099eab69239 req-a103541d-3925-40e3-858d-8791c91b0abe service nova] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Received event network-changed-11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG nova.compute.manager [req-b5d0289d-6f86-46a1-b3ed-5099eab69239 req-a103541d-3925-40e3-858d-8791c91b0abe service nova] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Refreshing instance network info cache due to event network-changed-11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-b5d0289d-6f86-46a1-b3ed-5099eab69239 req-a103541d-3925-40e3-858d-8791c91b0abe service nova] Acquiring lock "refresh_cache-16868d8f-debd-4fcd-a3ad-16f99bad11d4" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG nova.network.neutron [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG nova.network.neutron [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Updating instance_info_cache with network_info: [{"id": "11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b", "address": "fa:16:3e:71:82:f7", "network": {"id": "1793a330-201d-4987-902e-7b57d688a8b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1839084053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ff4c097a2f04bd2b069acb5e67dc435", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d9cc59-4f", "ovs_interfaceid": "11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Releasing lock "refresh_cache-16868d8f-debd-4fcd-a3ad-16f99bad11d4" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG nova.compute.manager [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Instance network_info: |[{"id": "11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b", "address": "fa:16:3e:71:82:f7", "network": {"id": "1793a330-201d-4987-902e-7b57d688a8b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1839084053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ff4c097a2f04bd2b069acb5e67dc435", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d9cc59-4f", "ovs_interfaceid": "11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-b5d0289d-6f86-46a1-b3ed-5099eab69239 req-a103541d-3925-40e3-858d-8791c91b0abe service nova] Acquired lock "refresh_cache-16868d8f-debd-4fcd-a3ad-16f99bad11d4" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG nova.network.neutron [req-b5d0289d-6f86-46a1-b3ed-5099eab69239 req-a103541d-3925-40e3-858d-8791c91b0abe service nova] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Refreshing network info cache for port 11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Start _get_guest_xml network_info=[{"id": "11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b", "address": "fa:16:3e:71:82:f7", "network": {"id": "1793a330-201d-4987-902e-7b57d688a8b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1839084053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ff4c097a2f04bd2b069acb5e67dc435", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d9cc59-4f", "ovs_interfaceid": "11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:42:16 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:42:16 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:42:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:42:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1581587706',display_name='tempest-VolumesActionsTest-instance-1581587706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1581587706',id=41,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ff4c097a2f04bd2b069acb5e67dc435',ramdisk_id='',reservation_id='r-xri1cxn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-818319633',owner_user_name='tempest-VolumesActionsTest-818319633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:42:14Z,user_data=None,user_id='f8f9d10ee71a4458a571446e7ff39713',uuid=16868d8f-debd-4fcd-a3ad-16f99bad11d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b", "address": "fa:16:3e:71:82:f7", "network": {"id": "1793a330-201d-4987-902e-7b57d688a8b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1839084053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ff4c097a2f04bd2b069acb5e67dc435", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d9cc59-4f", "ovs_interfaceid": "11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Converting VIF {"id": "11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b", "address": "fa:16:3e:71:82:f7", "network": {"id": "1793a330-201d-4987-902e-7b57d688a8b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1839084053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ff4c097a2f04bd2b069acb5e67dc435", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d9cc59-4f", "ovs_interfaceid": "11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:82:f7,bridge_name='br-int',has_traffic_filtering=True,id=11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b,network=Network(1793a330-201d-4987-902e-7b57d688a8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11d9cc59-4f') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG nova.objects.instance [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Lazy-loading 'pci_devices' on Instance uuid 16868d8f-debd-4fcd-a3ad-16f99bad11d4 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:42:16 user nova-compute[75080]:   <uuid>16868d8f-debd-4fcd-a3ad-16f99bad11d4</uuid>
Dec 05 15:42:16 user nova-compute[75080]:   <name>instance-00000029</name>
Dec 05 15:42:16 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:42:16 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:42:16 user nova-compute[75080]:   <metadata>
Dec 05 15:42:16 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:42:16 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:42:16 user nova-compute[75080]:       <nova:name>tempest-VolumesActionsTest-instance-1581587706</nova:name>
Dec 05 15:42:16 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:42:16</nova:creationTime>
Dec 05 15:42:16 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:42:16 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:42:16 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:42:16 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:42:16 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:42:16 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:42:16 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:42:16 user nova-compute[75080]:       <nova:owner>
Dec 05 15:42:16 user nova-compute[75080]:         <nova:user uuid="f8f9d10ee71a4458a571446e7ff39713">tempest-VolumesActionsTest-818319633-project-member</nova:user>
Dec 05 15:42:16 user nova-compute[75080]:         <nova:project uuid="0ff4c097a2f04bd2b069acb5e67dc435">tempest-VolumesActionsTest-818319633</nova:project>
Dec 05 15:42:16 user nova-compute[75080]:       </nova:owner>
Dec 05 15:42:16 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:42:16 user nova-compute[75080]:       <nova:ports>
Dec 05 15:42:16 user nova-compute[75080]:         <nova:port uuid="11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b">
Dec 05 15:42:16 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 05 15:42:16 user nova-compute[75080]:         </nova:port>
Dec 05 15:42:16 user nova-compute[75080]:       </nova:ports>
Dec 05 15:42:16 user nova-compute[75080]:     </nova:instance>
Dec 05 15:42:16 user nova-compute[75080]:   </metadata>
Dec 05 15:42:16 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:42:16 user nova-compute[75080]:     <system>
Dec 05 15:42:16 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:42:16 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:42:16 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:42:16 user nova-compute[75080]:       <entry name="serial">16868d8f-debd-4fcd-a3ad-16f99bad11d4</entry>
Dec 05 15:42:16 user nova-compute[75080]:       <entry name="uuid">16868d8f-debd-4fcd-a3ad-16f99bad11d4</entry>
Dec 05 15:42:16 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:42:16 user nova-compute[75080]:     </system>
Dec 05 15:42:16 user nova-compute[75080]:   </sysinfo>
Dec 05 15:42:16 user nova-compute[75080]:   <os>
Dec 05 15:42:16 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:42:16 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:42:16 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:42:16 user nova-compute[75080]:   </os>
Dec 05 15:42:16 user nova-compute[75080]:   <features>
Dec 05 15:42:16 user nova-compute[75080]:     <acpi/>
Dec 05 15:42:16 user nova-compute[75080]:     <apic/>
Dec 05 15:42:16 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:42:16 user nova-compute[75080]:   </features>
Dec 05 15:42:16 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:42:16 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:42:16 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:42:16 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:42:16 user nova-compute[75080]:   </clock>
Dec 05 15:42:16 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:42:16 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:42:16 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:42:16 user nova-compute[75080]:   </cpu>
Dec 05 15:42:16 user nova-compute[75080]:   <devices>
Dec 05 15:42:16 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:42:16 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:42:16 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/16868d8f-debd-4fcd-a3ad-16f99bad11d4/disk"/>
Dec 05 15:42:16 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:42:16 user nova-compute[75080]:     </disk>
Dec 05 15:42:16 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:42:16 user nova-compute[75080]:       <mac address="fa:16:3e:71:82:f7"/>
Dec 05 15:42:16 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:42:16 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:42:16 user nova-compute[75080]:       <target dev="tap11d9cc59-4f"/>
Dec 05 15:42:16 user nova-compute[75080]:     </interface>
Dec 05 15:42:16 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:42:16 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/16868d8f-debd-4fcd-a3ad-16f99bad11d4/console.log" append="off"/>
Dec 05 15:42:16 user nova-compute[75080]:     </serial>
Dec 05 15:42:16 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:42:16 user nova-compute[75080]:     <video>
Dec 05 15:42:16 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:42:16 user nova-compute[75080]:     </video>
Dec 05 15:42:16 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:42:16 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:42:16 user nova-compute[75080]:     </rng>
Dec 05 15:42:16 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:42:16 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:42:16 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:42:16 user nova-compute[75080]:     </memballoon>
Dec 05 15:42:16 user nova-compute[75080]:   </devices>
Dec 05 15:42:16 user nova-compute[75080]: </domain>
Dec 05 15:42:16 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:42:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1581587706',display_name='tempest-VolumesActionsTest-instance-1581587706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1581587706',id=41,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ff4c097a2f04bd2b069acb5e67dc435',ramdisk_id='',reservation_id='r-xri1cxn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-818319633',owner_user_name='tempest-VolumesActionsTest-818319633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:42:14Z,user_data=None,user_id='f8f9d10ee71a4458a571446e7ff39713',uuid=16868d8f-debd-4fcd-a3ad-16f99bad11d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b", "address": "fa:16:3e:71:82:f7", "network": {"id": "1793a330-201d-4987-902e-7b57d688a8b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1839084053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ff4c097a2f04bd2b069acb5e67dc435", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d9cc59-4f", "ovs_interfaceid": "11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Converting VIF {"id": "11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b", "address": "fa:16:3e:71:82:f7", "network": {"id": "1793a330-201d-4987-902e-7b57d688a8b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1839084053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ff4c097a2f04bd2b069acb5e67dc435", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d9cc59-4f", "ovs_interfaceid": "11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:82:f7,bridge_name='br-int',has_traffic_filtering=True,id=11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b,network=Network(1793a330-201d-4987-902e-7b57d688a8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11d9cc59-4f') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG os_vif [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:82:f7,bridge_name='br-int',has_traffic_filtering=True,id=11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b,network=Network(1793a330-201d-4987-902e-7b57d688a8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11d9cc59-4f') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c8d86fb5-8e1c-566c-a92e-cbf3d3dc39b2', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11d9cc59-4f, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap11d9cc59-4f, col_values=(('qos', UUID('1591a6f9-0c0e-4e10-b25e-c9b27d83fd45')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap11d9cc59-4f, col_values=(('external_ids', {'iface-id': '11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:82:f7', 'vm-uuid': '16868d8f-debd-4fcd-a3ad-16f99bad11d4'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:16 user nova-compute[75080]: INFO os_vif [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:82:f7,bridge_name='br-int',has_traffic_filtering=True,id=11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b,network=Network(1793a330-201d-4987-902e-7b57d688a8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11d9cc59-4f')
Dec 05 15:42:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] No VIF found with MAC fa:16:3e:71:82:f7, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG nova.network.neutron [req-b5d0289d-6f86-46a1-b3ed-5099eab69239 req-a103541d-3925-40e3-858d-8791c91b0abe service nova] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Updated VIF entry in instance network info cache for port 11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:42:16 user nova-compute[75080]: DEBUG nova.network.neutron [req-b5d0289d-6f86-46a1-b3ed-5099eab69239 req-a103541d-3925-40e3-858d-8791c91b0abe service nova] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Updating instance_info_cache with network_info: [{"id": "11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b", "address": "fa:16:3e:71:82:f7", "network": {"id": "1793a330-201d-4987-902e-7b57d688a8b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1839084053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ff4c097a2f04bd2b069acb5e67dc435", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d9cc59-4f", "ovs_interfaceid": "11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:42:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-b5d0289d-6f86-46a1-b3ed-5099eab69239 req-a103541d-3925-40e3-858d-8791c91b0abe service nova] Releasing lock "refresh_cache-16868d8f-debd-4fcd-a3ad-16f99bad11d4" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:42:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:18 user nova-compute[75080]: DEBUG nova.compute.manager [req-8b99c3f2-b78b-40cd-bc3e-f3b8f768ff2f req-ed2bec36-e60e-44a1-8b1d-2ebdda9ea805 service nova] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Received event network-vif-plugged-11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:42:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8b99c3f2-b78b-40cd-bc3e-f3b8f768ff2f req-ed2bec36-e60e-44a1-8b1d-2ebdda9ea805 service nova] Acquiring lock "16868d8f-debd-4fcd-a3ad-16f99bad11d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8b99c3f2-b78b-40cd-bc3e-f3b8f768ff2f req-ed2bec36-e60e-44a1-8b1d-2ebdda9ea805 service nova] Lock "16868d8f-debd-4fcd-a3ad-16f99bad11d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8b99c3f2-b78b-40cd-bc3e-f3b8f768ff2f req-ed2bec36-e60e-44a1-8b1d-2ebdda9ea805 service nova] Lock "16868d8f-debd-4fcd-a3ad-16f99bad11d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:18 user nova-compute[75080]: DEBUG nova.compute.manager [req-8b99c3f2-b78b-40cd-bc3e-f3b8f768ff2f req-ed2bec36-e60e-44a1-8b1d-2ebdda9ea805 service nova] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] No waiting events found dispatching network-vif-plugged-11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:42:18 user nova-compute[75080]: WARNING nova.compute.manager [req-8b99c3f2-b78b-40cd-bc3e-f3b8f768ff2f req-ed2bec36-e60e-44a1-8b1d-2ebdda9ea805 service nova] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Received unexpected event network-vif-plugged-11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b for instance with vm_state building and task_state spawning.
Dec 05 15:42:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:20 user nova-compute[75080]: DEBUG nova.compute.manager [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:42:20 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:42:20 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Instance spawned successfully.
Dec 05 15:42:20 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:42:20 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:42:20 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:42:20 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:42:20 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:42:20 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:42:20 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:42:20 user nova-compute[75080]: DEBUG nova.compute.manager [req-935dd751-6e44-41bf-aa4a-61e8dea36f4d req-58a05b5a-84b8-490a-80d8-e2c33f30812b service nova] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Received event network-vif-plugged-11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:42:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-935dd751-6e44-41bf-aa4a-61e8dea36f4d req-58a05b5a-84b8-490a-80d8-e2c33f30812b service nova] Acquiring lock "16868d8f-debd-4fcd-a3ad-16f99bad11d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-935dd751-6e44-41bf-aa4a-61e8dea36f4d req-58a05b5a-84b8-490a-80d8-e2c33f30812b service nova] Lock "16868d8f-debd-4fcd-a3ad-16f99bad11d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-935dd751-6e44-41bf-aa4a-61e8dea36f4d req-58a05b5a-84b8-490a-80d8-e2c33f30812b service nova] Lock "16868d8f-debd-4fcd-a3ad-16f99bad11d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:20 user nova-compute[75080]: DEBUG nova.compute.manager [req-935dd751-6e44-41bf-aa4a-61e8dea36f4d req-58a05b5a-84b8-490a-80d8-e2c33f30812b service nova] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] No waiting events found dispatching network-vif-plugged-11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:42:20 user nova-compute[75080]: WARNING nova.compute.manager [req-935dd751-6e44-41bf-aa4a-61e8dea36f4d req-58a05b5a-84b8-490a-80d8-e2c33f30812b service nova] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Received unexpected event network-vif-plugged-11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b for instance with vm_state building and task_state spawning.
Dec 05 15:42:20 user nova-compute[75080]: INFO nova.compute.manager [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Took 6.08 seconds to spawn the instance on the hypervisor.
Dec 05 15:42:20 user nova-compute[75080]: DEBUG nova.compute.manager [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:42:20 user nova-compute[75080]: INFO nova.compute.manager [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Took 6.74 seconds to build instance.
Dec 05 15:42:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0592fe3e-4d32-4bac-8724-020fa7b00555 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Lock "16868d8f-debd-4fcd-a3ad-16f99bad11d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.852s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:21 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:25 user nova-compute[75080]: INFO nova.compute.manager [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Terminating instance
Dec 05 15:42:25 user nova-compute[75080]: DEBUG nova.compute.manager [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:42:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:25 user nova-compute[75080]: DEBUG nova.compute.manager [req-b2199e7d-c724-4cca-a496-441c8db57df2 req-9a56d54b-7033-46c1-9961-f251b4cf2166 service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Received event network-vif-unplugged-af017697-07fb-4000-87d4-87f84dbd53bc {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:42:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-b2199e7d-c724-4cca-a496-441c8db57df2 req-9a56d54b-7033-46c1-9961-f251b4cf2166 service nova] Acquiring lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-b2199e7d-c724-4cca-a496-441c8db57df2 req-9a56d54b-7033-46c1-9961-f251b4cf2166 service nova] Lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-b2199e7d-c724-4cca-a496-441c8db57df2 req-9a56d54b-7033-46c1-9961-f251b4cf2166 service nova] Lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:25 user nova-compute[75080]: DEBUG nova.compute.manager [req-b2199e7d-c724-4cca-a496-441c8db57df2 req-9a56d54b-7033-46c1-9961-f251b4cf2166 service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] No waiting events found dispatching network-vif-unplugged-af017697-07fb-4000-87d4-87f84dbd53bc {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:42:25 user nova-compute[75080]: DEBUG nova.compute.manager [req-b2199e7d-c724-4cca-a496-441c8db57df2 req-9a56d54b-7033-46c1-9961-f251b4cf2166 service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Received event network-vif-unplugged-af017697-07fb-4000-87d4-87f84dbd53bc for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:42:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:26 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Instance destroyed successfully.
Dec 05 15:42:26 user nova-compute[75080]: DEBUG nova.objects.instance [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lazy-loading 'resources' on Instance uuid ab882db7-e6d7-44ca-9ea4-ae2fa68f7929 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:25:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1586887461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1586887461',id=24,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:27:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97145ab79b414c4fb8772c71e9414581',ramdisk_id='',reservation_id='r-ibun0y2c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2060228993',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:29:35Z,user_data=None,user_id='829d709c32db431199af609ddbc8b090',uuid=ab882db7-e6d7-44ca-9ea4-ae2fa68f7929,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af017697-07fb-4000-87d4-87f84dbd53bc", "address": "fa:16:3e:48:4c:fd", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf017697-07", "ovs_interfaceid": "af017697-07fb-4000-87d4-87f84dbd53bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Converting VIF {"id": "af017697-07fb-4000-87d4-87f84dbd53bc", "address": "fa:16:3e:48:4c:fd", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf017697-07", "ovs_interfaceid": "af017697-07fb-4000-87d4-87f84dbd53bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:4c:fd,bridge_name='br-int',has_traffic_filtering=True,id=af017697-07fb-4000-87d4-87f84dbd53bc,network=Network(61aa968d-7e44-4ef2-955f-2e5441416f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf017697-07') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG os_vif [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:4c:fd,bridge_name='br-int',has_traffic_filtering=True,id=af017697-07fb-4000-87d4-87f84dbd53bc,network=Network(61aa968d-7e44-4ef2-955f-2e5441416f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf017697-07') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf017697-07, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=384e6236-abb0-4e83-ab9b-d786e243633d) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:26 user nova-compute[75080]: INFO os_vif [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:4c:fd,bridge_name='br-int',has_traffic_filtering=True,id=af017697-07fb-4000-87d4-87f84dbd53bc,network=Network(61aa968d-7e44-4ef2-955f-2e5441416f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf017697-07')
Dec 05 15:42:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eTtyOlSx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:42:26 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:42:26 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d98f253-4dee-4489-ad39-c8876ebd1223]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:42:26 user nova-compute[75080]: No targets found.
Dec 05 15:42:26 user nova-compute[75080]: iSNS:
Dec 05 15:42:26 user nova-compute[75080]: No targets found.
Dec 05 15:42:26 user nova-compute[75080]: STATIC:
Dec 05 15:42:26 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399
Dec 05 15:42:26 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:42:26 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:42:26 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111
Dec 05 15:42:26 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:42:26 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:42:26 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121
Dec 05 15:42:26 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:42:26 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:42:26 user nova-compute[75080]: FIRMWARE:
Dec 05 15:42:26 user nova-compute[75080]: No targets found.
Dec 05 15:42:26 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:42:26 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:42:26 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c20f66-b704-4d72-b72a-a29ffb0c7d37]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6643689-2ee7-4009-a726-2fd4815acd39]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:42:26 user nova-compute[75080]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 (non-flash)
Dec 05 15:42:26 user nova-compute[75080]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121 (non-flash)
Dec 05 15:42:26 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 (non-flash)
Dec 05 15:42:26 user nova-compute[75080]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 (non-flash)
Dec 05 15:42:26 user nova-compute[75080]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121 (non-flash)
Dec 05 15:42:26 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f665c449900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399'): ({'sdg'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Removing single pathed devices sdg {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab4f915-5b38-4c1b-8f0c-4c40ec658406]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a7f3b5-104a-4b26-a521-6ac6dd30d85e]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Flushing IO for device /dev/sdg {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee427113-5d56-4f14-8cb4-e76a8c8fa315]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.058s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db63feb-dc85-4e90-a27d-2c315668180d]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] SCSI volumes sdg have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d467989-9e5e-4829-b2c3-6dd26fe36fa2]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d9842d-7fb7-4538-80ce-e2d06f881e70]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399, portal: 172.16.0.220,3260]
Dec 05 15:42:26 user nova-compute[75080]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399, portal: 172.16.0.220,3260] successful.
Dec 05 15:42:26 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b7c6bb1-e02f-431a-97d7-ea24d61bb399 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49f25f3-136d-40f5-81a4-3973b685eb9b]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] <== disconnect_volume: return (330ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:42:26 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Deleting instance files /opt/stack/data/nova/instances/ab882db7-e6d7-44ca-9ea4-ae2fa68f7929_del
Dec 05 15:42:26 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Deletion of /opt/stack/data/nova/instances/ab882db7-e6d7-44ca-9ea4-ae2fa68f7929_del complete
Dec 05 15:42:26 user nova-compute[75080]: INFO nova.compute.manager [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Took 1.19 seconds to destroy the instance on the hypervisor.
Dec 05 15:42:26 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:42:26 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:42:27 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:42:27 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Took 0.46 seconds to deallocate network for instance.
Dec 05 15:42:27 user nova-compute[75080]: DEBUG nova.compute.manager [req-0363e4a6-e47b-4195-b392-56be2d6d7bf1 req-6eda2913-3118-4945-b68c-338b9899200c service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Received event network-vif-deleted-af017697-07fb-4000-87d4-87f84dbd53bc {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:42:27 user nova-compute[75080]: INFO nova.compute.manager [req-0363e4a6-e47b-4195-b392-56be2d6d7bf1 req-6eda2913-3118-4945-b68c-338b9899200c service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Neutron deleted interface af017697-07fb-4000-87d4-87f84dbd53bc; detaching it from the instance and deleting it from the info cache
Dec 05 15:42:27 user nova-compute[75080]: DEBUG nova.network.neutron [req-0363e4a6-e47b-4195-b392-56be2d6d7bf1 req-6eda2913-3118-4945-b68c-338b9899200c service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:42:27 user nova-compute[75080]: DEBUG nova.compute.manager [req-0363e4a6-e47b-4195-b392-56be2d6d7bf1 req-6eda2913-3118-4945-b68c-338b9899200c service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Detach interface failed, port_id=af017697-07fb-4000-87d4-87f84dbd53bc, reason: Instance ab882db7-e6d7-44ca-9ea4-ae2fa68f7929 could not be found. {{(pid=75080) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 15:42:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:27 user nova-compute[75080]: DEBUG nova.compute.manager [req-4ec4e65b-099c-4644-9723-54775100ec8d req-e02f1160-8dbe-4972-b258-a03d306aabac service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Received event network-vif-plugged-af017697-07fb-4000-87d4-87f84dbd53bc {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:42:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4ec4e65b-099c-4644-9723-54775100ec8d req-e02f1160-8dbe-4972-b258-a03d306aabac service nova] Acquiring lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4ec4e65b-099c-4644-9723-54775100ec8d req-e02f1160-8dbe-4972-b258-a03d306aabac service nova] Lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4ec4e65b-099c-4644-9723-54775100ec8d req-e02f1160-8dbe-4972-b258-a03d306aabac service nova] Lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:27 user nova-compute[75080]: DEBUG nova.compute.manager [req-4ec4e65b-099c-4644-9723-54775100ec8d req-e02f1160-8dbe-4972-b258-a03d306aabac service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] No waiting events found dispatching network-vif-plugged-af017697-07fb-4000-87d4-87f84dbd53bc {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:42:27 user nova-compute[75080]: WARNING nova.compute.manager [req-4ec4e65b-099c-4644-9723-54775100ec8d req-e02f1160-8dbe-4972-b258-a03d306aabac service nova] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Received unexpected event network-vif-plugged-af017697-07fb-4000-87d4-87f84dbd53bc for instance with vm_state active and task_state deleting.
Dec 05 15:42:27 user nova-compute[75080]: INFO nova.compute.manager [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: ab882db7-e6d7-44ca-9ea4-ae2fa68f7929] Took 0.82 seconds to detach 1 volumes for instance.
Dec 05 15:42:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:28 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:42:28 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:42:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.238s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:28 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Deleted allocations for instance ab882db7-e6d7-44ca-9ea4-ae2fa68f7929
Dec 05 15:42:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-4b2bfbb5-db42-4885-8504-6862a37d2c6e tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "ab882db7-e6d7-44ca-9ea4-ae2fa68f7929" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.892s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:30 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-ad434471-f772-4af5-a767-519143c97584 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e is timed out.
Dec 05 15:42:30 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-ad434471-f772-4af5-a767-519143c97584 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Successfully detached device vdb from instance 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e from the live domain config.
Dec 05 15:42:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad434471-f772-4af5-a767-519143c97584 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad434471-f772-4af5-a767-519143c97584 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XpHJNTCh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:42:30 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-ad434471-f772-4af5-a767-519143c97584 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:42:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-ad434471-f772-4af5-a767-519143c97584 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-ad434471-f772-4af5-a767-519143c97584 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be6691b-96b7-4555-bbac-85824565d0e1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad434471-f772-4af5-a767-519143c97584 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:42:30 user nova-compute[75080]: No targets found.
Dec 05 15:42:30 user nova-compute[75080]: iSNS:
Dec 05 15:42:30 user nova-compute[75080]: No targets found.
Dec 05 15:42:30 user nova-compute[75080]: STATIC:
Dec 05 15:42:30 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111
Dec 05 15:42:30 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:42:30 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:42:30 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121
Dec 05 15:42:30 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:42:30 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:42:30 user nova-compute[75080]: FIRMWARE:
Dec 05 15:42:30 user nova-compute[75080]: No targets found.
Dec 05 15:42:30 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad434471-f772-4af5-a767-519143c97584 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:42:30 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:42:30 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad434471-f772-4af5-a767-519143c97584 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1117cab-56b3-453f-bf38-ed0a41e0e615]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f91e720-2dd7-4c7c-8a24-b7821a54f058]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad434471-f772-4af5-a767-519143c97584 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 (non-flash)
Dec 05 15:42:30 user nova-compute[75080]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121 (non-flash)
Dec 05 15:42:30 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad434471-f772-4af5-a767-519143c97584 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 (non-flash)
Dec 05 15:42:30 user nova-compute[75080]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121 (non-flash)
Dec 05 15:42:30 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad434471-f772-4af5-a767-519143c97584 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6638315ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111'): ({'sdb'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-ad434471-f772-4af5-a767-519143c97584 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Removing single pathed devices sdb {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86f91c6-446d-4fd7-842a-d12ce7db04c4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ff0cab-2e8e-4189-af5f-07eb9cc2500e]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-ad434471-f772-4af5-a767-519143c97584 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Flushing IO for device /dev/sdb {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9350310-276b-446a-b647-487ce4563c4f]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-ad434471-f772-4af5-a767-519143c97584 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2b55a6-d9ac-4ac3-8382-1239e30adcd1]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-ad434471-f772-4af5-a767-519143c97584 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-ad434471-f772-4af5-a767-519143c97584 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad434471-f772-4af5-a767-519143c97584 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be15590-1b43-447e-958c-60bf95dba42f]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad434471-f772-4af5-a767-519143c97584 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d89b7b-e20e-4fea-b468-655cf5737ca4]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad434471-f772-4af5-a767-519143c97584 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111, portal: 172.16.0.220,3260]
Dec 05 15:42:30 user nova-compute[75080]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111, portal: 172.16.0.220,3260] successful.
Dec 05 15:42:30 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:accdc646-8152-435e-95b4-e826eedf2111 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df95804-2733-49f8-a5b5-de70452f8833]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad434471-f772-4af5-a767-519143c97584 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-ad434471-f772-4af5-a767-519143c97584 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad434471-f772-4af5-a767-519143c97584 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] <== disconnect_volume: return (281ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:42:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad434471-f772-4af5-a767-519143c97584 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:42:31 user nova-compute[75080]: DEBUG nova.objects.instance [None req-ad434471-f772-4af5-a767-519143c97584 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lazy-loading 'flavor' on Instance uuid 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:42:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ad434471-f772-4af5-a767-519143c97584 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.657s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-adc2d066-dce9-4bbd-946c-6259d73195c0 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-adc2d066-dce9-4bbd-946c-6259d73195c0 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:32 user nova-compute[75080]: INFO nova.compute.manager [None req-adc2d066-dce9-4bbd-946c-6259d73195c0 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Detaching volume a9091cd5-0fd2-4a68-89ce-a6deb89f0121
Dec 05 15:42:32 user nova-compute[75080]: INFO nova.virt.block_device [None req-adc2d066-dce9-4bbd-946c-6259d73195c0 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Attempting to driver detach volume a9091cd5-0fd2-4a68-89ce-a6deb89f0121 from mountpoint /dev/vdc
Dec 05 15:42:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-adc2d066-dce9-4bbd-946c-6259d73195c0 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Attempting to detach device vdc from instance 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e from the persistent domain config. {{(pid=75080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 15:42:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-adc2d066-dce9-4bbd-946c-6259d73195c0 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:42:32 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:42:32 user nova-compute[75080]:   <source dev="/dev/sdc"/>
Dec 05 15:42:32 user nova-compute[75080]:   <target dev="vdc" bus="virtio"/>
Dec 05 15:42:32 user nova-compute[75080]:   <serial>a9091cd5-0fd2-4a68-89ce-a6deb89f0121</serial>
Dec 05 15:42:32 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 05 15:42:32 user nova-compute[75080]: </disk>
Dec 05 15:42:32 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:42:32 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-adc2d066-dce9-4bbd-946c-6259d73195c0 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Successfully detached device vdc from instance 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e from the persistent domain config.
Dec 05 15:42:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-adc2d066-dce9-4bbd-946c-6259d73195c0 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e from the live domain config. {{(pid=75080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 15:42:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-adc2d066-dce9-4bbd-946c-6259d73195c0 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:42:32 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:42:32 user nova-compute[75080]:   <source dev="/dev/sdc"/>
Dec 05 15:42:32 user nova-compute[75080]:   <target dev="vdc" bus="virtio"/>
Dec 05 15:42:32 user nova-compute[75080]:   <serial>a9091cd5-0fd2-4a68-89ce-a6deb89f0121</serial>
Dec 05 15:42:32 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 05 15:42:32 user nova-compute[75080]: </disk>
Dec 05 15:42:32 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:42:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-adc2d066-dce9-4bbd-946c-6259d73195c0 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e {{(pid=75080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 15:42:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:42 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:42:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquiring lock "bc66525f-8802-426d-872f-5b567e05b316" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "bc66525f-8802-426d-872f-5b567e05b316" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:43 user nova-compute[75080]: DEBUG nova.compute.manager [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:42:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:43 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:42:43 user nova-compute[75080]: INFO nova.compute.claims [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Claim successful on node user
Dec 05 15:42:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:43 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:42:43 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:42:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.269s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:43 user nova-compute[75080]: DEBUG nova.compute.manager [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:42:43 user nova-compute[75080]: DEBUG nova.compute.manager [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:42:43 user nova-compute[75080]: DEBUG nova.network.neutron [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:42:43 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:42:43 user nova-compute[75080]: DEBUG nova.compute.manager [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:42:43 user nova-compute[75080]: DEBUG nova.compute.manager [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:42:43 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:42:43 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Creating image(s)
Dec 05 15:42:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc66525f-8802-426d-872f-5b567e05b316/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "/opt/stack/data/nova/instances/bc66525f-8802-426d-872f-5b567e05b316/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "/opt/stack/data/nova/instances/bc66525f-8802-426d-872f-5b567e05b316/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquiring lock "a063d7d82bff4ce73d73f3ee60fd7ac80a1dc0e3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "a063d7d82bff4ce73d73f3ee60fd7ac80a1dc0e3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:43 user nova-compute[75080]: DEBUG nova.policy [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e0cb687b9ede4bb8ac3e192766fa4f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549e67b7f2574eb38f3395452b647de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:42:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a063d7d82bff4ce73d73f3ee60fd7ac80a1dc0e3.part --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a063d7d82bff4ce73d73f3ee60fd7ac80a1dc0e3.part --force-share --output=json" returned: 0 in 0.216s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:44 user nova-compute[75080]: DEBUG nova.virt.images [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] 8117b5a8-fd25-4cb9-aa95-dda536d318a6 was qcow2, converting to raw {{(pid=75080) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 05 15:42:44 user nova-compute[75080]: DEBUG nova.privsep.utils [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75080) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 15:42:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a063d7d82bff4ce73d73f3ee60fd7ac80a1dc0e3.part /opt/stack/data/nova/instances/_base/a063d7d82bff4ce73d73f3ee60fd7ac80a1dc0e3.converted {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:44 user nova-compute[75080]: DEBUG nova.network.neutron [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Successfully created port: f5ab390a-fbf1-4384-80a6-95420f8868f9 {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:42:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a063d7d82bff4ce73d73f3ee60fd7ac80a1dc0e3.part /opt/stack/data/nova/instances/_base/a063d7d82bff4ce73d73f3ee60fd7ac80a1dc0e3.converted" returned: 0 in 0.449s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a063d7d82bff4ce73d73f3ee60fd7ac80a1dc0e3.converted --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a063d7d82bff4ce73d73f3ee60fd7ac80a1dc0e3.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "a063d7d82bff4ce73d73f3ee60fd7ac80a1dc0e3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.528s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a063d7d82bff4ce73d73f3ee60fd7ac80a1dc0e3 --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:45 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:42:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a063d7d82bff4ce73d73f3ee60fd7ac80a1dc0e3 --force-share --output=json" returned: 0 in 0.197s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquiring lock "a063d7d82bff4ce73d73f3ee60fd7ac80a1dc0e3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "a063d7d82bff4ce73d73f3ee60fd7ac80a1dc0e3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a063d7d82bff4ce73d73f3ee60fd7ac80a1dc0e3 --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:45 user nova-compute[75080]: DEBUG nova.network.neutron [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Successfully updated port: f5ab390a-fbf1-4384-80a6-95420f8868f9 {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:42:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquiring lock "refresh_cache-bc66525f-8802-426d-872f-5b567e05b316" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:42:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquired lock "refresh_cache-bc66525f-8802-426d-872f-5b567e05b316" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:42:45 user nova-compute[75080]: DEBUG nova.network.neutron [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:42:45 user nova-compute[75080]: DEBUG nova.compute.manager [req-fe3c05ee-afc1-4dbe-92f1-5f040f3b1e87 req-6856f345-098a-4788-8928-bc4bcf5d069d service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Received event network-changed-f5ab390a-fbf1-4384-80a6-95420f8868f9 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:42:45 user nova-compute[75080]: DEBUG nova.compute.manager [req-fe3c05ee-afc1-4dbe-92f1-5f040f3b1e87 req-6856f345-098a-4788-8928-bc4bcf5d069d service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Refreshing instance network info cache due to event network-changed-f5ab390a-fbf1-4384-80a6-95420f8868f9. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:42:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-fe3c05ee-afc1-4dbe-92f1-5f040f3b1e87 req-6856f345-098a-4788-8928-bc4bcf5d069d service nova] Acquiring lock "refresh_cache-bc66525f-8802-426d-872f-5b567e05b316" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:42:45 user nova-compute[75080]: DEBUG nova.network.neutron [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:42:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a063d7d82bff4ce73d73f3ee60fd7ac80a1dc0e3 --force-share --output=json" returned: 0 in 0.175s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a063d7d82bff4ce73d73f3ee60fd7ac80a1dc0e3,backing_fmt=raw /opt/stack/data/nova/instances/bc66525f-8802-426d-872f-5b567e05b316/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a063d7d82bff4ce73d73f3ee60fd7ac80a1dc0e3,backing_fmt=raw /opt/stack/data/nova/instances/bc66525f-8802-426d-872f-5b567e05b316/disk 1073741824" returned: 0 in 0.053s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "a063d7d82bff4ce73d73f3ee60fd7ac80a1dc0e3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a063d7d82bff4ce73d73f3ee60fd7ac80a1dc0e3 --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a063d7d82bff4ce73d73f3ee60fd7ac80a1dc0e3 --force-share --output=json" returned: 0 in 0.180s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:45 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc66525f-8802-426d-872f-5b567e05b316/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 15:42:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc66525f-8802-426d-872f-5b567e05b316/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG nova.network.neutron [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Updating instance_info_cache with network_info: [{"id": "f5ab390a-fbf1-4384-80a6-95420f8868f9", "address": "fa:16:3e:3f:f5:32", "network": {"id": "1151f7c9-f853-4f06-93d7-74536b8b12ac", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420489370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549e67b7f2574eb38f3395452b647de7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ab390a-fb", "ovs_interfaceid": "f5ab390a-fbf1-4384-80a6-95420f8868f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Releasing lock "refresh_cache-bc66525f-8802-426d-872f-5b567e05b316" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG nova.compute.manager [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Instance network_info: |[{"id": "f5ab390a-fbf1-4384-80a6-95420f8868f9", "address": "fa:16:3e:3f:f5:32", "network": {"id": "1151f7c9-f853-4f06-93d7-74536b8b12ac", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420489370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549e67b7f2574eb38f3395452b647de7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ab390a-fb", "ovs_interfaceid": "f5ab390a-fbf1-4384-80a6-95420f8868f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-fe3c05ee-afc1-4dbe-92f1-5f040f3b1e87 req-6856f345-098a-4788-8928-bc4bcf5d069d service nova] Acquired lock "refresh_cache-bc66525f-8802-426d-872f-5b567e05b316" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG nova.network.neutron [req-fe3c05ee-afc1-4dbe-92f1-5f040f3b1e87 req-6856f345-098a-4788-8928-bc4bcf5d069d service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Refreshing network info cache for port f5ab390a-fbf1-4384-80a6-95420f8868f9 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc66525f-8802-426d-872f-5b567e05b316/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Cannot resize image /opt/stack/data/nova/instances/bc66525f-8802-426d-872f-5b567e05b316/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Ensure instance console log exists: /opt/stack/data/nova/instances/bc66525f-8802-426d-872f-5b567e05b316/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Start _get_guest_xml network_info=[{"id": "f5ab390a-fbf1-4384-80a6-95420f8868f9", "address": "fa:16:3e:3f:f5:32", "network": {"id": "1151f7c9-f853-4f06-93d7-74536b8b12ac", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420489370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549e67b7f2574eb38f3395452b647de7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ab390a-fb", "ovs_interfaceid": "f5ab390a-fbf1-4384-80a6-95420f8868f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:42:40Z,direct_url=<?>,disk_format='qcow2',id=8117b5a8-fd25-4cb9-aa95-dda536d318a6,min_disk=0,min_ram=0,name='tempest-scenario-img--1077494764',owner='549e67b7f2574eb38f3395452b647de7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:42:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '8117b5a8-fd25-4cb9-aa95-dda536d318a6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:42:46 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:42:46 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:42:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:42:40Z,direct_url=<?>,disk_format='qcow2',id=8117b5a8-fd25-4cb9-aa95-dda536d318a6,min_disk=0,min_ram=0,name='tempest-scenario-img--1077494764',owner='549e67b7f2574eb38f3395452b647de7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:42:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:42:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2093592265',display_name='tempest-TestMinimumBasicScenario-server-2093592265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2093592265',id=42,image_ref='8117b5a8-fd25-4cb9-aa95-dda536d318a6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKe0jhR+SbXnQBb1E1WEhM00pDWOjsXIEsxHIa+sgPNadBl6GMQIj/pfRNSlnkjpDxSTorp+6p5gtZ7oyCAvxeiPzS6O835Nv5Xu+L1+zuTOKgYvUwC5/9lskCdZWYkboQ==',key_name='tempest-TestMinimumBasicScenario-311713196',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='549e67b7f2574eb38f3395452b647de7',ramdisk_id='',reservation_id='r-4t2ktdta',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8117b5a8-fd25-4cb9-aa95-dda536d318a6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1307764000',owner_user_name='tempest-TestMinimumBasicScenario-1307764000-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:42:44Z,user_data=None,user_id='e0cb687b9ede4bb8ac3e192766fa4f21',uuid=bc66525f-8802-426d-872f-5b567e05b316,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5ab390a-fbf1-4384-80a6-95420f8868f9", "address": "fa:16:3e:3f:f5:32", "network": {"id": "1151f7c9-f853-4f06-93d7-74536b8b12ac", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420489370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549e67b7f2574eb38f3395452b647de7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ab390a-fb", "ovs_interfaceid": "f5ab390a-fbf1-4384-80a6-95420f8868f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Converting VIF {"id": "f5ab390a-fbf1-4384-80a6-95420f8868f9", "address": "fa:16:3e:3f:f5:32", "network": {"id": "1151f7c9-f853-4f06-93d7-74536b8b12ac", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420489370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549e67b7f2574eb38f3395452b647de7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ab390a-fb", "ovs_interfaceid": "f5ab390a-fbf1-4384-80a6-95420f8868f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:f5:32,bridge_name='br-int',has_traffic_filtering=True,id=f5ab390a-fbf1-4384-80a6-95420f8868f9,network=Network(1151f7c9-f853-4f06-93d7-74536b8b12ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5ab390a-fb') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG nova.objects.instance [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lazy-loading 'pci_devices' on Instance uuid bc66525f-8802-426d-872f-5b567e05b316 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:42:46 user nova-compute[75080]:   <uuid>bc66525f-8802-426d-872f-5b567e05b316</uuid>
Dec 05 15:42:46 user nova-compute[75080]:   <name>instance-0000002a</name>
Dec 05 15:42:46 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:42:46 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:42:46 user nova-compute[75080]:   <metadata>
Dec 05 15:42:46 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:42:46 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:42:46 user nova-compute[75080]:       <nova:name>tempest-TestMinimumBasicScenario-server-2093592265</nova:name>
Dec 05 15:42:46 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:42:46</nova:creationTime>
Dec 05 15:42:46 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:42:46 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:42:46 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:42:46 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:42:46 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:42:46 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:42:46 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:42:46 user nova-compute[75080]:       <nova:owner>
Dec 05 15:42:46 user nova-compute[75080]:         <nova:user uuid="e0cb687b9ede4bb8ac3e192766fa4f21">tempest-TestMinimumBasicScenario-1307764000-project-member</nova:user>
Dec 05 15:42:46 user nova-compute[75080]:         <nova:project uuid="549e67b7f2574eb38f3395452b647de7">tempest-TestMinimumBasicScenario-1307764000</nova:project>
Dec 05 15:42:46 user nova-compute[75080]:       </nova:owner>
Dec 05 15:42:46 user nova-compute[75080]:       <nova:root type="image" uuid="8117b5a8-fd25-4cb9-aa95-dda536d318a6"/>
Dec 05 15:42:46 user nova-compute[75080]:       <nova:ports>
Dec 05 15:42:46 user nova-compute[75080]:         <nova:port uuid="f5ab390a-fbf1-4384-80a6-95420f8868f9">
Dec 05 15:42:46 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 05 15:42:46 user nova-compute[75080]:         </nova:port>
Dec 05 15:42:46 user nova-compute[75080]:       </nova:ports>
Dec 05 15:42:46 user nova-compute[75080]:     </nova:instance>
Dec 05 15:42:46 user nova-compute[75080]:   </metadata>
Dec 05 15:42:46 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:42:46 user nova-compute[75080]:     <system>
Dec 05 15:42:46 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:42:46 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:42:46 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:42:46 user nova-compute[75080]:       <entry name="serial">bc66525f-8802-426d-872f-5b567e05b316</entry>
Dec 05 15:42:46 user nova-compute[75080]:       <entry name="uuid">bc66525f-8802-426d-872f-5b567e05b316</entry>
Dec 05 15:42:46 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:42:46 user nova-compute[75080]:     </system>
Dec 05 15:42:46 user nova-compute[75080]:   </sysinfo>
Dec 05 15:42:46 user nova-compute[75080]:   <os>
Dec 05 15:42:46 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:42:46 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:42:46 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:42:46 user nova-compute[75080]:   </os>
Dec 05 15:42:46 user nova-compute[75080]:   <features>
Dec 05 15:42:46 user nova-compute[75080]:     <acpi/>
Dec 05 15:42:46 user nova-compute[75080]:     <apic/>
Dec 05 15:42:46 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:42:46 user nova-compute[75080]:   </features>
Dec 05 15:42:46 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:42:46 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:42:46 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:42:46 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:42:46 user nova-compute[75080]:   </clock>
Dec 05 15:42:46 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:42:46 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:42:46 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:42:46 user nova-compute[75080]:   </cpu>
Dec 05 15:42:46 user nova-compute[75080]:   <devices>
Dec 05 15:42:46 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:42:46 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:42:46 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/bc66525f-8802-426d-872f-5b567e05b316/disk"/>
Dec 05 15:42:46 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:42:46 user nova-compute[75080]:     </disk>
Dec 05 15:42:46 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:42:46 user nova-compute[75080]:       <mac address="fa:16:3e:3f:f5:32"/>
Dec 05 15:42:46 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:42:46 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:42:46 user nova-compute[75080]:       <target dev="tapf5ab390a-fb"/>
Dec 05 15:42:46 user nova-compute[75080]:     </interface>
Dec 05 15:42:46 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:42:46 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/bc66525f-8802-426d-872f-5b567e05b316/console.log" append="off"/>
Dec 05 15:42:46 user nova-compute[75080]:     </serial>
Dec 05 15:42:46 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:42:46 user nova-compute[75080]:     <video>
Dec 05 15:42:46 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:42:46 user nova-compute[75080]:     </video>
Dec 05 15:42:46 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:42:46 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:42:46 user nova-compute[75080]:     </rng>
Dec 05 15:42:46 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:42:46 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:42:46 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:42:46 user nova-compute[75080]:     </memballoon>
Dec 05 15:42:46 user nova-compute[75080]:   </devices>
Dec 05 15:42:46 user nova-compute[75080]: </domain>
Dec 05 15:42:46 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:42:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2093592265',display_name='tempest-TestMinimumBasicScenario-server-2093592265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2093592265',id=42,image_ref='8117b5a8-fd25-4cb9-aa95-dda536d318a6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKe0jhR+SbXnQBb1E1WEhM00pDWOjsXIEsxHIa+sgPNadBl6GMQIj/pfRNSlnkjpDxSTorp+6p5gtZ7oyCAvxeiPzS6O835Nv5Xu+L1+zuTOKgYvUwC5/9lskCdZWYkboQ==',key_name='tempest-TestMinimumBasicScenario-311713196',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='549e67b7f2574eb38f3395452b647de7',ramdisk_id='',reservation_id='r-4t2ktdta',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8117b5a8-fd25-4cb9-aa95-dda536d318a6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1307764000',owner_user_name='tempest-TestMinimumBasicScenario-1307764000-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:42:44Z,user_data=None,user_id='e0cb687b9ede4bb8ac3e192766fa4f21',uuid=bc66525f-8802-426d-872f-5b567e05b316,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5ab390a-fbf1-4384-80a6-95420f8868f9", "address": "fa:16:3e:3f:f5:32", "network": {"id": "1151f7c9-f853-4f06-93d7-74536b8b12ac", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420489370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549e67b7f2574eb38f3395452b647de7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ab390a-fb", "ovs_interfaceid": "f5ab390a-fbf1-4384-80a6-95420f8868f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Converting VIF {"id": "f5ab390a-fbf1-4384-80a6-95420f8868f9", "address": "fa:16:3e:3f:f5:32", "network": {"id": "1151f7c9-f853-4f06-93d7-74536b8b12ac", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420489370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549e67b7f2574eb38f3395452b647de7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ab390a-fb", "ovs_interfaceid": "f5ab390a-fbf1-4384-80a6-95420f8868f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:f5:32,bridge_name='br-int',has_traffic_filtering=True,id=f5ab390a-fbf1-4384-80a6-95420f8868f9,network=Network(1151f7c9-f853-4f06-93d7-74536b8b12ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5ab390a-fb') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG os_vif [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:f5:32,bridge_name='br-int',has_traffic_filtering=True,id=f5ab390a-fbf1-4384-80a6-95420f8868f9,network=Network(1151f7c9-f853-4f06-93d7-74536b8b12ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5ab390a-fb') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b5ca043a-578a-5cf4-8bc4-c6eb0f638c68', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5ab390a-fb, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5ab390a-fb, col_values=(('qos', UUID('5751acfc-1837-421e-9b20-c0e42d9c6ce0')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5ab390a-fb, col_values=(('external_ids', {'iface-id': 'f5ab390a-fbf1-4384-80a6-95420f8868f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:f5:32', 'vm-uuid': 'bc66525f-8802-426d-872f-5b567e05b316'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:46 user nova-compute[75080]: INFO os_vif [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:f5:32,bridge_name='br-int',has_traffic_filtering=True,id=f5ab390a-fbf1-4384-80a6-95420f8868f9,network=Network(1151f7c9-f853-4f06-93d7-74536b8b12ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5ab390a-fb')
Dec 05 15:42:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] No VIF found with MAC fa:16:3e:3f:f5:32, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG nova.network.neutron [req-fe3c05ee-afc1-4dbe-92f1-5f040f3b1e87 req-6856f345-098a-4788-8928-bc4bcf5d069d service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Updated VIF entry in instance network info cache for port f5ab390a-fbf1-4384-80a6-95420f8868f9. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG nova.network.neutron [req-fe3c05ee-afc1-4dbe-92f1-5f040f3b1e87 req-6856f345-098a-4788-8928-bc4bcf5d069d service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Updating instance_info_cache with network_info: [{"id": "f5ab390a-fbf1-4384-80a6-95420f8868f9", "address": "fa:16:3e:3f:f5:32", "network": {"id": "1151f7c9-f853-4f06-93d7-74536b8b12ac", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420489370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549e67b7f2574eb38f3395452b647de7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ab390a-fb", "ovs_interfaceid": "f5ab390a-fbf1-4384-80a6-95420f8868f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:42:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-fe3c05ee-afc1-4dbe-92f1-5f040f3b1e87 req-6856f345-098a-4788-8928-bc4bcf5d069d service nova] Releasing lock "refresh_cache-bc66525f-8802-426d-872f-5b567e05b316" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:42:47 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:42:47 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:42:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:47 user nova-compute[75080]: DEBUG nova.compute.manager [req-42e42ece-e1e7-4535-98f9-d9cc29de61c5 req-7c68eea0-f7c7-4a25-8bbc-3ee1f2abfc2d service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Received event network-vif-plugged-f5ab390a-fbf1-4384-80a6-95420f8868f9 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:42:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-42e42ece-e1e7-4535-98f9-d9cc29de61c5 req-7c68eea0-f7c7-4a25-8bbc-3ee1f2abfc2d service nova] Acquiring lock "bc66525f-8802-426d-872f-5b567e05b316-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-42e42ece-e1e7-4535-98f9-d9cc29de61c5 req-7c68eea0-f7c7-4a25-8bbc-3ee1f2abfc2d service nova] Lock "bc66525f-8802-426d-872f-5b567e05b316-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-42e42ece-e1e7-4535-98f9-d9cc29de61c5 req-7c68eea0-f7c7-4a25-8bbc-3ee1f2abfc2d service nova] Lock "bc66525f-8802-426d-872f-5b567e05b316-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:47 user nova-compute[75080]: DEBUG nova.compute.manager [req-42e42ece-e1e7-4535-98f9-d9cc29de61c5 req-7c68eea0-f7c7-4a25-8bbc-3ee1f2abfc2d service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] No waiting events found dispatching network-vif-plugged-f5ab390a-fbf1-4384-80a6-95420f8868f9 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:42:47 user nova-compute[75080]: WARNING nova.compute.manager [req-42e42ece-e1e7-4535-98f9-d9cc29de61c5 req-7c68eea0-f7c7-4a25-8bbc-3ee1f2abfc2d service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Received unexpected event network-vif-plugged-f5ab390a-fbf1-4384-80a6-95420f8868f9 for instance with vm_state building and task_state spawning.
Dec 05 15:42:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:48 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:42:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:48 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:42:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16868d8f-debd-4fcd-a3ad-16f99bad11d4/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16868d8f-debd-4fcd-a3ad-16f99bad11d4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16868d8f-debd-4fcd-a3ad-16f99bad11d4/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16868d8f-debd-4fcd-a3ad-16f99bad11d4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc66525f-8802-426d-872f-5b567e05b316/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:49 user nova-compute[75080]: DEBUG nova.compute.manager [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:42:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:42:49 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: bc66525f-8802-426d-872f-5b567e05b316] Instance spawned successfully.
Dec 05 15:42:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:42:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:42:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:42:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:42:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:42:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:42:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:42:49 user nova-compute[75080]: DEBUG nova.compute.manager [req-8c5ffda7-6576-4d1a-be70-2e5705eb52c7 req-c3558912-0d9a-4c16-8cf8-52de34b59eee service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Received event network-vif-plugged-f5ab390a-fbf1-4384-80a6-95420f8868f9 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:42:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8c5ffda7-6576-4d1a-be70-2e5705eb52c7 req-c3558912-0d9a-4c16-8cf8-52de34b59eee service nova] Acquiring lock "bc66525f-8802-426d-872f-5b567e05b316-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8c5ffda7-6576-4d1a-be70-2e5705eb52c7 req-c3558912-0d9a-4c16-8cf8-52de34b59eee service nova] Lock "bc66525f-8802-426d-872f-5b567e05b316-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8c5ffda7-6576-4d1a-be70-2e5705eb52c7 req-c3558912-0d9a-4c16-8cf8-52de34b59eee service nova] Lock "bc66525f-8802-426d-872f-5b567e05b316-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:49 user nova-compute[75080]: DEBUG nova.compute.manager [req-8c5ffda7-6576-4d1a-be70-2e5705eb52c7 req-c3558912-0d9a-4c16-8cf8-52de34b59eee service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] No waiting events found dispatching network-vif-plugged-f5ab390a-fbf1-4384-80a6-95420f8868f9 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:42:49 user nova-compute[75080]: WARNING nova.compute.manager [req-8c5ffda7-6576-4d1a-be70-2e5705eb52c7 req-c3558912-0d9a-4c16-8cf8-52de34b59eee service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Received unexpected event network-vif-plugged-f5ab390a-fbf1-4384-80a6-95420f8868f9 for instance with vm_state building and task_state spawning.
Dec 05 15:42:49 user nova-compute[75080]: INFO nova.compute.manager [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Took 6.11 seconds to spawn the instance on the hypervisor.
Dec 05 15:42:49 user nova-compute[75080]: DEBUG nova.compute.manager [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:42:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc66525f-8802-426d-872f-5b567e05b316/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc66525f-8802-426d-872f-5b567e05b316/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc66525f-8802-426d-872f-5b567e05b316/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:50 user nova-compute[75080]: INFO nova.compute.manager [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Took 6.80 seconds to build instance.
Dec 05 15:42:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-228d6a82-5c2f-4531-b5bf-3e2f36beb672 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "bc66525f-8802-426d-872f-5b567e05b316" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.892s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:50 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:42:50 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:42:50 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=8567MB free_disk=24.877681732177734GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:42:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:50 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 07b025ff-4a9d-48a2-b950-b8f2d165f33c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:42:50 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:42:50 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 16868d8f-debd-4fcd-a3ad-16f99bad11d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:42:50 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance bc66525f-8802-426d-872f-5b567e05b316 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:42:50 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:42:50 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:42:50 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:42:50 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:42:50 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:42:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.305s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:51 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:42:51 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:42:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:42:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:42:51 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 15:42:52 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Updating instance_info_cache with network_info: [{"id": "c66977a0-8209-4cd2-8c16-fe7819474020", "address": "fa:16:3e:c4:b6:76", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66977a0-82", "ovs_interfaceid": "c66977a0-8209-4cd2-8c16-fe7819474020", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:42:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:42:52 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 15:42:52 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:42:52 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:42:52 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:42:52 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:42:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:52 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-adc2d066-dce9-4bbd-946c-6259d73195c0 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e is timed out.
Dec 05 15:42:52 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-adc2d066-dce9-4bbd-946c-6259d73195c0 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Successfully detached device vdc from instance 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e from the live domain config.
Dec 05 15:42:52 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adc2d066-dce9-4bbd-946c-6259d73195c0 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:42:52 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc2d066-dce9-4bbd-946c-6259d73195c0 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xlBSUhLj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:42:52 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-adc2d066-dce9-4bbd-946c-6259d73195c0 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:42:52 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-adc2d066-dce9-4bbd-946c-6259d73195c0 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:42:52 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-adc2d066-dce9-4bbd-946c-6259d73195c0 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:42:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:52 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca6f3d8-0794-49f3-84f7-05174f0b1a1c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:52 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc2d066-dce9-4bbd-946c-6259d73195c0 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:42:52 user nova-compute[75080]: No targets found.
Dec 05 15:42:52 user nova-compute[75080]: iSNS:
Dec 05 15:42:52 user nova-compute[75080]: No targets found.
Dec 05 15:42:52 user nova-compute[75080]: STATIC:
Dec 05 15:42:52 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121
Dec 05 15:42:52 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:42:52 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:42:52 user nova-compute[75080]: FIRMWARE:
Dec 05 15:42:52 user nova-compute[75080]: No targets found.
Dec 05 15:42:52 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:42:52 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc2d066-dce9-4bbd-946c-6259d73195c0 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:42:52 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:42:52 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:42:52 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc2d066-dce9-4bbd-946c-6259d73195c0 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:42:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:52 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88228d6-45a7-4f18-b795-47b1d4609512]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:52 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2377242-1e75-4953-a63e-cc2c730a91ab]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:52 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc2d066-dce9-4bbd-946c-6259d73195c0 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121 (non-flash)
Dec 05 15:42:52 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:42:52 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc2d066-dce9-4bbd-946c-6259d73195c0 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121 (non-flash)
Dec 05 15:42:52 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:42:52 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc2d066-dce9-4bbd-946c-6259d73195c0 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f663815ac20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121'): ({'sdc'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:42:52 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-adc2d066-dce9-4bbd-946c-6259d73195c0 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Removing single pathed devices sdc {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:42:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:52 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[47186310-df9a-4a47-a122-ccab7f044593]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af0c928-7a53-4bba-9dca-609028a85765]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-adc2d066-dce9-4bbd-946c-6259d73195c0 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Flushing IO for device /dev/sdc {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef419d71-ed17-4451-8d85-4024c6dc0b12]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-adc2d066-dce9-4bbd-946c-6259d73195c0 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG nova.compute.manager [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5d7b80-23f2-4588-acff-1f491a559b66]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-adc2d066-dce9-4bbd-946c-6259d73195c0 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-adc2d066-dce9-4bbd-946c-6259d73195c0 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] SCSI volumes sdc have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc2d066-dce9-4bbd-946c-6259d73195c0 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d675f9a-df4e-4110-8f06-68fc115c88bb]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc2d066-dce9-4bbd-946c-6259d73195c0 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121 -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:42:53 user nova-compute[75080]: INFO nova.compute.claims [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Claim successful on node user
Dec 05 15:42:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[35420ff4-c496-457d-a720-4bde54c7cd6d]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc2d066-dce9-4bbd-946c-6259d73195c0 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121, portal: 172.16.0.220,3260]
Dec 05 15:42:53 user nova-compute[75080]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121, portal: 172.16.0.220,3260] successful.
Dec 05 15:42:53 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121 -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9091cd5-0fd2-4a68-89ce-a6deb89f0121 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd15594-2a64-4dd0-a239-c9ca183037fa]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc2d066-dce9-4bbd-946c-6259d73195c0 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-adc2d066-dce9-4bbd-946c-6259d73195c0 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc2d066-dce9-4bbd-946c-6259d73195c0 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] <== disconnect_volume: return (348ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adc2d066-dce9-4bbd-946c-6259d73195c0 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.318s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG nova.compute.manager [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG nova.compute.manager [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG nova.network.neutron [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:42:53 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:42:53 user nova-compute[75080]: DEBUG nova.compute.manager [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG nova.policy [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1afa4590c69f423d97f7cd485e193b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea1ac008cfd499a8df635aac9b1342d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG nova.compute.manager [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:42:53 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Creating image(s)
Dec 05 15:42:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "/opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "/opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "/opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.179s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "8608d2cf-476d-43b8-a124-c44507459a1e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "8608d2cf-476d-43b8-a124-c44507459a1e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG nova.compute.manager [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG nova.objects.instance [None req-adc2d066-dce9-4bbd-946c-6259d73195c0 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lazy-loading 'flavor' on Instance uuid 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-adc2d066-dce9-4bbd-946c-6259d73195c0 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.780s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:42:54 user nova-compute[75080]: INFO nova.compute.claims [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Claim successful on node user
Dec 05 15:42:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.208s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG nova.network.neutron [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Successfully created port: 09233cd3-602f-4eb8-a74c-7d592a1a3906 {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk 1073741824" returned: 0 in 0.061s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.185s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Checking if we can resize image /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.432s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG nova.compute.manager [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Cannot resize image /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Ensure instance console log exists: /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG nova.compute.manager [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG nova.network.neutron [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:42:54 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:42:54 user nova-compute[75080]: DEBUG nova.compute.manager [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG nova.policy [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1afa4590c69f423d97f7cd485e193b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea1ac008cfd499a8df635aac9b1342d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG nova.compute.manager [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:42:54 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Creating image(s)
Dec 05 15:42:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "/opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "/opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "/opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG nova.network.neutron [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Successfully updated port: 09233cd3-602f-4eb8-a74c-7d592a1a3906 {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "refresh_cache-db0fde77-eb40-4acb-93f7-66b5b76c8eea" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquired lock "refresh_cache-db0fde77-eb40-4acb-93f7-66b5b76c8eea" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG nova.network.neutron [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG nova.compute.manager [req-d4ef40d2-d450-4d7e-b868-3d92feb78763 req-f19e4d1b-420d-4bb0-9475-2f0eb24b6f93 service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Received event network-changed-09233cd3-602f-4eb8-a74c-7d592a1a3906 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG nova.compute.manager [req-d4ef40d2-d450-4d7e-b868-3d92feb78763 req-f19e4d1b-420d-4bb0-9475-2f0eb24b6f93 service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Refreshing instance network info cache due to event network-changed-09233cd3-602f-4eb8-a74c-7d592a1a3906. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:42:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d4ef40d2-d450-4d7e-b868-3d92feb78763 req-f19e4d1b-420d-4bb0-9475-2f0eb24b6f93 service nova] Acquiring lock "refresh_cache-db0fde77-eb40-4acb-93f7-66b5b76c8eea" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG nova.network.neutron [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.227s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.191s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG nova.network.neutron [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Updating instance_info_cache with network_info: [{"id": "09233cd3-602f-4eb8-a74c-7d592a1a3906", "address": "fa:16:3e:44:84:7c", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09233cd3-60", "ovs_interfaceid": "09233cd3-602f-4eb8-a74c-7d592a1a3906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk 1073741824" returned: 0 in 0.066s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e771b9d8-14db-4903-a7c4-5df5be269030 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e771b9d8-14db-4903-a7c4-5df5be269030 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e771b9d8-14db-4903-a7c4-5df5be269030 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e771b9d8-14db-4903-a7c4-5df5be269030 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e771b9d8-14db-4903-a7c4-5df5be269030 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Releasing lock "refresh_cache-db0fde77-eb40-4acb-93f7-66b5b76c8eea" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG nova.compute.manager [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Instance network_info: |[{"id": "09233cd3-602f-4eb8-a74c-7d592a1a3906", "address": "fa:16:3e:44:84:7c", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09233cd3-60", "ovs_interfaceid": "09233cd3-602f-4eb8-a74c-7d592a1a3906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:42:55 user nova-compute[75080]: INFO nova.compute.manager [None req-e771b9d8-14db-4903-a7c4-5df5be269030 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Terminating instance
Dec 05 15:42:55 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e771b9d8-14db-4903-a7c4-5df5be269030 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d4ef40d2-d450-4d7e-b868-3d92feb78763 req-f19e4d1b-420d-4bb0-9475-2f0eb24b6f93 service nova] Acquired lock "refresh_cache-db0fde77-eb40-4acb-93f7-66b5b76c8eea" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG nova.network.neutron [req-d4ef40d2-d450-4d7e-b868-3d92feb78763 req-f19e4d1b-420d-4bb0-9475-2f0eb24b6f93 service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Refreshing network info cache for port 09233cd3-602f-4eb8-a74c-7d592a1a3906 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Start _get_guest_xml network_info=[{"id": "09233cd3-602f-4eb8-a74c-7d592a1a3906", "address": "fa:16:3e:44:84:7c", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09233cd3-60", "ovs_interfaceid": "09233cd3-602f-4eb8-a74c-7d592a1a3906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:42:55 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:42:55 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:42:55 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:42:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-435850721',display_name='tempest-ServerRescueNegativeTestJSON-server-435850721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-435850721',id=43,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cea1ac008cfd499a8df635aac9b1342d',ramdisk_id='',reservation_id='r-p7nnlu30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1626475760',owner_user_name='tempest-ServerRescueNegativeTestJSON-1626475760-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:42:54Z,user_data=None,user_id='1afa4590c69f423d97f7cd485e193b0f',uuid=db0fde77-eb40-4acb-93f7-66b5b76c8eea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09233cd3-602f-4eb8-a74c-7d592a1a3906", "address": "fa:16:3e:44:84:7c", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09233cd3-60", "ovs_interfaceid": "09233cd3-602f-4eb8-a74c-7d592a1a3906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Converting VIF {"id": "09233cd3-602f-4eb8-a74c-7d592a1a3906", "address": "fa:16:3e:44:84:7c", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09233cd3-60", "ovs_interfaceid": "09233cd3-602f-4eb8-a74c-7d592a1a3906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:84:7c,bridge_name='br-int',has_traffic_filtering=True,id=09233cd3-602f-4eb8-a74c-7d592a1a3906,network=Network(c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09233cd3-60') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG nova.objects.instance [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lazy-loading 'pci_devices' on Instance uuid db0fde77-eb40-4acb-93f7-66b5b76c8eea {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG nova.network.neutron [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Successfully created port: 9a4d35f3-f184-49ba-b94d-5fcdd955f572 {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:42:55 user nova-compute[75080]:   <uuid>db0fde77-eb40-4acb-93f7-66b5b76c8eea</uuid>
Dec 05 15:42:55 user nova-compute[75080]:   <name>instance-0000002b</name>
Dec 05 15:42:55 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:42:55 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:42:55 user nova-compute[75080]:   <metadata>
Dec 05 15:42:55 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:42:55 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:42:55 user nova-compute[75080]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-435850721</nova:name>
Dec 05 15:42:55 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:42:55</nova:creationTime>
Dec 05 15:42:55 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:42:55 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:42:55 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:42:55 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:42:55 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:42:55 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:42:55 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:42:55 user nova-compute[75080]:       <nova:owner>
Dec 05 15:42:55 user nova-compute[75080]:         <nova:user uuid="1afa4590c69f423d97f7cd485e193b0f">tempest-ServerRescueNegativeTestJSON-1626475760-project-member</nova:user>
Dec 05 15:42:55 user nova-compute[75080]:         <nova:project uuid="cea1ac008cfd499a8df635aac9b1342d">tempest-ServerRescueNegativeTestJSON-1626475760</nova:project>
Dec 05 15:42:55 user nova-compute[75080]:       </nova:owner>
Dec 05 15:42:55 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:42:55 user nova-compute[75080]:       <nova:ports>
Dec 05 15:42:55 user nova-compute[75080]:         <nova:port uuid="09233cd3-602f-4eb8-a74c-7d592a1a3906">
Dec 05 15:42:55 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 05 15:42:55 user nova-compute[75080]:         </nova:port>
Dec 05 15:42:55 user nova-compute[75080]:       </nova:ports>
Dec 05 15:42:55 user nova-compute[75080]:     </nova:instance>
Dec 05 15:42:55 user nova-compute[75080]:   </metadata>
Dec 05 15:42:55 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:42:55 user nova-compute[75080]:     <system>
Dec 05 15:42:55 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:42:55 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:42:55 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:42:55 user nova-compute[75080]:       <entry name="serial">db0fde77-eb40-4acb-93f7-66b5b76c8eea</entry>
Dec 05 15:42:55 user nova-compute[75080]:       <entry name="uuid">db0fde77-eb40-4acb-93f7-66b5b76c8eea</entry>
Dec 05 15:42:55 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:42:55 user nova-compute[75080]:     </system>
Dec 05 15:42:55 user nova-compute[75080]:   </sysinfo>
Dec 05 15:42:55 user nova-compute[75080]:   <os>
Dec 05 15:42:55 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:42:55 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:42:55 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:42:55 user nova-compute[75080]:   </os>
Dec 05 15:42:55 user nova-compute[75080]:   <features>
Dec 05 15:42:55 user nova-compute[75080]:     <acpi/>
Dec 05 15:42:55 user nova-compute[75080]:     <apic/>
Dec 05 15:42:55 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:42:55 user nova-compute[75080]:   </features>
Dec 05 15:42:55 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:42:55 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:42:55 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:42:55 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:42:55 user nova-compute[75080]:   </clock>
Dec 05 15:42:55 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:42:55 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:42:55 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:42:55 user nova-compute[75080]:   </cpu>
Dec 05 15:42:55 user nova-compute[75080]:   <devices>
Dec 05 15:42:55 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:42:55 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:42:55 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk"/>
Dec 05 15:42:55 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:42:55 user nova-compute[75080]:     </disk>
Dec 05 15:42:55 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:42:55 user nova-compute[75080]:       <mac address="fa:16:3e:44:84:7c"/>
Dec 05 15:42:55 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:42:55 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:42:55 user nova-compute[75080]:       <target dev="tap09233cd3-60"/>
Dec 05 15:42:55 user nova-compute[75080]:     </interface>
Dec 05 15:42:55 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:42:55 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/console.log" append="off"/>
Dec 05 15:42:55 user nova-compute[75080]:     </serial>
Dec 05 15:42:55 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:42:55 user nova-compute[75080]:     <video>
Dec 05 15:42:55 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:42:55 user nova-compute[75080]:     </video>
Dec 05 15:42:55 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:42:55 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:42:55 user nova-compute[75080]:     </rng>
Dec 05 15:42:55 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:42:55 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:42:55 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:42:55 user nova-compute[75080]:     </memballoon>
Dec 05 15:42:55 user nova-compute[75080]:   </devices>
Dec 05 15:42:55 user nova-compute[75080]: </domain>
Dec 05 15:42:55 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:42:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-435850721',display_name='tempest-ServerRescueNegativeTestJSON-server-435850721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-435850721',id=43,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cea1ac008cfd499a8df635aac9b1342d',ramdisk_id='',reservation_id='r-p7nnlu30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1626475760',owner_user_name='tempest-ServerRescueNegativeTestJSON-1626475760-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:42:54Z,user_data=None,user_id='1afa4590c69f423d97f7cd485e193b0f',uuid=db0fde77-eb40-4acb-93f7-66b5b76c8eea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09233cd3-602f-4eb8-a74c-7d592a1a3906", "address": "fa:16:3e:44:84:7c", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09233cd3-60", "ovs_interfaceid": "09233cd3-602f-4eb8-a74c-7d592a1a3906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Converting VIF {"id": "09233cd3-602f-4eb8-a74c-7d592a1a3906", "address": "fa:16:3e:44:84:7c", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09233cd3-60", "ovs_interfaceid": "09233cd3-602f-4eb8-a74c-7d592a1a3906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:84:7c,bridge_name='br-int',has_traffic_filtering=True,id=09233cd3-602f-4eb8-a74c-7d592a1a3906,network=Network(c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09233cd3-60') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG os_vif [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:84:7c,bridge_name='br-int',has_traffic_filtering=True,id=09233cd3-602f-4eb8-a74c-7d592a1a3906,network=Network(c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09233cd3-60') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4d88bbb5-0f6a-5331-b009-a7e8fbe4ff86', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.206s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09233cd3-60, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap09233cd3-60, col_values=(('qos', UUID('aa7e4628-d41c-4d01-aafb-d010a734055a')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap09233cd3-60, col_values=(('external_ids', {'iface-id': '09233cd3-602f-4eb8-a74c-7d592a1a3906', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:84:7c', 'vm-uuid': 'db0fde77-eb40-4acb-93f7-66b5b76c8eea'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:55 user nova-compute[75080]: INFO os_vif [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:84:7c,bridge_name='br-int',has_traffic_filtering=True,id=09233cd3-602f-4eb8-a74c-7d592a1a3906,network=Network(c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09233cd3-60')
Dec 05 15:42:55 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] No VIF found with MAC fa:16:3e:44:84:7c, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Cannot resize image /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Ensure instance console log exists: /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG nova.network.neutron [req-d4ef40d2-d450-4d7e-b868-3d92feb78763 req-f19e4d1b-420d-4bb0-9475-2f0eb24b6f93 service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Updated VIF entry in instance network info cache for port 09233cd3-602f-4eb8-a74c-7d592a1a3906. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG nova.network.neutron [req-d4ef40d2-d450-4d7e-b868-3d92feb78763 req-f19e4d1b-420d-4bb0-9475-2f0eb24b6f93 service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Updating instance_info_cache with network_info: [{"id": "09233cd3-602f-4eb8-a74c-7d592a1a3906", "address": "fa:16:3e:44:84:7c", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09233cd3-60", "ovs_interfaceid": "09233cd3-602f-4eb8-a74c-7d592a1a3906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:42:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d4ef40d2-d450-4d7e-b868-3d92feb78763 req-f19e4d1b-420d-4bb0-9475-2f0eb24b6f93 service nova] Releasing lock "refresh_cache-db0fde77-eb40-4acb-93f7-66b5b76c8eea" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG nova.network.neutron [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Successfully updated port: 9a4d35f3-f184-49ba-b94d-5fcdd955f572 {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "refresh_cache-8608d2cf-476d-43b8-a124-c44507459a1e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquired lock "refresh_cache-8608d2cf-476d-43b8-a124-c44507459a1e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG nova.network.neutron [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG nova.compute.manager [req-17ce3583-4b6d-47be-af2d-a97d3573037a req-d55a6dfa-368e-4f29-b55e-cfa76c1b7dd2 service nova] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Received event network-changed-9a4d35f3-f184-49ba-b94d-5fcdd955f572 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG nova.compute.manager [req-17ce3583-4b6d-47be-af2d-a97d3573037a req-d55a6dfa-368e-4f29-b55e-cfa76c1b7dd2 service nova] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Refreshing instance network info cache due to event network-changed-9a4d35f3-f184-49ba-b94d-5fcdd955f572. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-17ce3583-4b6d-47be-af2d-a97d3573037a req-d55a6dfa-368e-4f29-b55e-cfa76c1b7dd2 service nova] Acquiring lock "refresh_cache-8608d2cf-476d-43b8-a124-c44507459a1e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG nova.network.neutron [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:42:56 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Instance destroyed successfully.
Dec 05 15:42:56 user nova-compute[75080]: DEBUG nova.objects.instance [None req-e771b9d8-14db-4903-a7c4-5df5be269030 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lazy-loading 'resources' on Instance uuid 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-e771b9d8-14db-4903-a7c4-5df5be269030 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:39:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2055643896',display_name='tempest-AttachVolumeTestJSON-server-2055643896',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2055643896',id=40,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIbzWBH2VpjYZ5gmgoWAk+WS06HrUFllhiEF732gV/d/ELgSBSoXH6pwoxrzvtyHYp60QglYaR11pJDGZUo/0uUkPrK+Frrzh8NjcsAQRwaXVKSfiKkoNz/3WXmyOSOPw==',key_name='tempest-keypair-1775072225',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:39:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a01b18b2a93b457c8e160447d44a673e',ramdisk_id='',reservation_id='r-f4xhzy5w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1911411330',owner_user_name='tempest-AttachVolumeTestJSON-1911411330-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:39:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a02caebbfe541209b87adcbf848ede6',uuid=2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c66977a0-8209-4cd2-8c16-fe7819474020", "address": "fa:16:3e:c4:b6:76", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66977a0-82", "ovs_interfaceid": "c66977a0-8209-4cd2-8c16-fe7819474020", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-e771b9d8-14db-4903-a7c4-5df5be269030 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Converting VIF {"id": "c66977a0-8209-4cd2-8c16-fe7819474020", "address": "fa:16:3e:c4:b6:76", "network": {"id": "3037e443-f4eb-446e-8a80-53f409b02ba6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1809206124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01b18b2a93b457c8e160447d44a673e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66977a0-82", "ovs_interfaceid": "c66977a0-8209-4cd2-8c16-fe7819474020", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-e771b9d8-14db-4903-a7c4-5df5be269030 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:b6:76,bridge_name='br-int',has_traffic_filtering=True,id=c66977a0-8209-4cd2-8c16-fe7819474020,network=Network(3037e443-f4eb-446e-8a80-53f409b02ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66977a0-82') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG os_vif [None req-e771b9d8-14db-4903-a7c4-5df5be269030 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:b6:76,bridge_name='br-int',has_traffic_filtering=True,id=c66977a0-8209-4cd2-8c16-fe7819474020,network=Network(3037e443-f4eb-446e-8a80-53f409b02ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66977a0-82') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc66977a0-82, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7949c98-10b1-4c07-8b59-467ec4e1d1ba) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:56 user nova-compute[75080]: INFO os_vif [None req-e771b9d8-14db-4903-a7c4-5df5be269030 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:b6:76,bridge_name='br-int',has_traffic_filtering=True,id=c66977a0-8209-4cd2-8c16-fe7819474020,network=Network(3037e443-f4eb-446e-8a80-53f409b02ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66977a0-82')
Dec 05 15:42:56 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-e771b9d8-14db-4903-a7c4-5df5be269030 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Deleting instance files /opt/stack/data/nova/instances/2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e_del
Dec 05 15:42:56 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-e771b9d8-14db-4903-a7c4-5df5be269030 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Deletion of /opt/stack/data/nova/instances/2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e_del complete
Dec 05 15:42:56 user nova-compute[75080]: INFO nova.compute.manager [None req-e771b9d8-14db-4903-a7c4-5df5be269030 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Took 1.46 seconds to destroy the instance on the hypervisor.
Dec 05 15:42:56 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-e771b9d8-14db-4903-a7c4-5df5be269030 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG nova.network.neutron [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Updating instance_info_cache with network_info: [{"id": "9a4d35f3-f184-49ba-b94d-5fcdd955f572", "address": "fa:16:3e:22:37:f1", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a4d35f3-f1", "ovs_interfaceid": "9a4d35f3-f184-49ba-b94d-5fcdd955f572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Releasing lock "refresh_cache-8608d2cf-476d-43b8-a124-c44507459a1e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG nova.compute.manager [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Instance network_info: |[{"id": "9a4d35f3-f184-49ba-b94d-5fcdd955f572", "address": "fa:16:3e:22:37:f1", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a4d35f3-f1", "ovs_interfaceid": "9a4d35f3-f184-49ba-b94d-5fcdd955f572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-17ce3583-4b6d-47be-af2d-a97d3573037a req-d55a6dfa-368e-4f29-b55e-cfa76c1b7dd2 service nova] Acquired lock "refresh_cache-8608d2cf-476d-43b8-a124-c44507459a1e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG nova.network.neutron [req-17ce3583-4b6d-47be-af2d-a97d3573037a req-d55a6dfa-368e-4f29-b55e-cfa76c1b7dd2 service nova] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Refreshing network info cache for port 9a4d35f3-f184-49ba-b94d-5fcdd955f572 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Start _get_guest_xml network_info=[{"id": "9a4d35f3-f184-49ba-b94d-5fcdd955f572", "address": "fa:16:3e:22:37:f1", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a4d35f3-f1", "ovs_interfaceid": "9a4d35f3-f184-49ba-b94d-5fcdd955f572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:42:56 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:42:56 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:42:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:42:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-791550701',display_name='tempest-ServerRescueNegativeTestJSON-server-791550701',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-791550701',id=44,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cea1ac008cfd499a8df635aac9b1342d',ramdisk_id='',reservation_id='r-ih68cpqu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1626475760',owner_user_name='tempest-ServerRescueNegativeTestJSON-1626475760-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:42:55Z,user_data=None,user_id='1afa4590c69f423d97f7cd485e193b0f',uuid=8608d2cf-476d-43b8-a124-c44507459a1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a4d35f3-f184-49ba-b94d-5fcdd955f572", "address": "fa:16:3e:22:37:f1", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a4d35f3-f1", "ovs_interfaceid": "9a4d35f3-f184-49ba-b94d-5fcdd955f572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Converting VIF {"id": "9a4d35f3-f184-49ba-b94d-5fcdd955f572", "address": "fa:16:3e:22:37:f1", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a4d35f3-f1", "ovs_interfaceid": "9a4d35f3-f184-49ba-b94d-5fcdd955f572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:37:f1,bridge_name='br-int',has_traffic_filtering=True,id=9a4d35f3-f184-49ba-b94d-5fcdd955f572,network=Network(c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a4d35f3-f1') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG nova.objects.instance [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lazy-loading 'pci_devices' on Instance uuid 8608d2cf-476d-43b8-a124-c44507459a1e {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:42:56 user nova-compute[75080]:   <uuid>8608d2cf-476d-43b8-a124-c44507459a1e</uuid>
Dec 05 15:42:56 user nova-compute[75080]:   <name>instance-0000002c</name>
Dec 05 15:42:56 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:42:56 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:42:56 user nova-compute[75080]:   <metadata>
Dec 05 15:42:56 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:42:56 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:42:56 user nova-compute[75080]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-791550701</nova:name>
Dec 05 15:42:56 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:42:56</nova:creationTime>
Dec 05 15:42:56 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:42:56 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:42:56 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:42:56 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:42:56 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:42:56 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:42:56 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:42:56 user nova-compute[75080]:       <nova:owner>
Dec 05 15:42:56 user nova-compute[75080]:         <nova:user uuid="1afa4590c69f423d97f7cd485e193b0f">tempest-ServerRescueNegativeTestJSON-1626475760-project-member</nova:user>
Dec 05 15:42:56 user nova-compute[75080]:         <nova:project uuid="cea1ac008cfd499a8df635aac9b1342d">tempest-ServerRescueNegativeTestJSON-1626475760</nova:project>
Dec 05 15:42:56 user nova-compute[75080]:       </nova:owner>
Dec 05 15:42:56 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:42:56 user nova-compute[75080]:       <nova:ports>
Dec 05 15:42:56 user nova-compute[75080]:         <nova:port uuid="9a4d35f3-f184-49ba-b94d-5fcdd955f572">
Dec 05 15:42:56 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 05 15:42:56 user nova-compute[75080]:         </nova:port>
Dec 05 15:42:56 user nova-compute[75080]:       </nova:ports>
Dec 05 15:42:56 user nova-compute[75080]:     </nova:instance>
Dec 05 15:42:56 user nova-compute[75080]:   </metadata>
Dec 05 15:42:56 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:42:56 user nova-compute[75080]:     <system>
Dec 05 15:42:56 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:42:56 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:42:56 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:42:56 user nova-compute[75080]:       <entry name="serial">8608d2cf-476d-43b8-a124-c44507459a1e</entry>
Dec 05 15:42:56 user nova-compute[75080]:       <entry name="uuid">8608d2cf-476d-43b8-a124-c44507459a1e</entry>
Dec 05 15:42:56 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:42:56 user nova-compute[75080]:     </system>
Dec 05 15:42:56 user nova-compute[75080]:   </sysinfo>
Dec 05 15:42:56 user nova-compute[75080]:   <os>
Dec 05 15:42:56 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:42:56 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:42:56 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:42:56 user nova-compute[75080]:   </os>
Dec 05 15:42:56 user nova-compute[75080]:   <features>
Dec 05 15:42:56 user nova-compute[75080]:     <acpi/>
Dec 05 15:42:56 user nova-compute[75080]:     <apic/>
Dec 05 15:42:56 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:42:56 user nova-compute[75080]:   </features>
Dec 05 15:42:56 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:42:56 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:42:56 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:42:56 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:42:56 user nova-compute[75080]:   </clock>
Dec 05 15:42:56 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:42:56 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:42:56 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:42:56 user nova-compute[75080]:   </cpu>
Dec 05 15:42:56 user nova-compute[75080]:   <devices>
Dec 05 15:42:56 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:42:56 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:42:56 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk"/>
Dec 05 15:42:56 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:42:56 user nova-compute[75080]:     </disk>
Dec 05 15:42:56 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:42:56 user nova-compute[75080]:       <mac address="fa:16:3e:22:37:f1"/>
Dec 05 15:42:56 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:42:56 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:42:56 user nova-compute[75080]:       <target dev="tap9a4d35f3-f1"/>
Dec 05 15:42:56 user nova-compute[75080]:     </interface>
Dec 05 15:42:56 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:42:56 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/console.log" append="off"/>
Dec 05 15:42:56 user nova-compute[75080]:     </serial>
Dec 05 15:42:56 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:42:56 user nova-compute[75080]:     <video>
Dec 05 15:42:56 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:42:56 user nova-compute[75080]:     </video>
Dec 05 15:42:56 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:42:56 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:42:56 user nova-compute[75080]:     </rng>
Dec 05 15:42:56 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:42:56 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:42:56 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:42:56 user nova-compute[75080]:     </memballoon>
Dec 05 15:42:56 user nova-compute[75080]:   </devices>
Dec 05 15:42:56 user nova-compute[75080]: </domain>
Dec 05 15:42:56 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:42:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-791550701',display_name='tempest-ServerRescueNegativeTestJSON-server-791550701',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-791550701',id=44,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cea1ac008cfd499a8df635aac9b1342d',ramdisk_id='',reservation_id='r-ih68cpqu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1626475760',owner_user_name='tempest-ServerRescueNegativeTestJSON-1626475760-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:42:55Z,user_data=None,user_id='1afa4590c69f423d97f7cd485e193b0f',uuid=8608d2cf-476d-43b8-a124-c44507459a1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a4d35f3-f184-49ba-b94d-5fcdd955f572", "address": "fa:16:3e:22:37:f1", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a4d35f3-f1", "ovs_interfaceid": "9a4d35f3-f184-49ba-b94d-5fcdd955f572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Converting VIF {"id": "9a4d35f3-f184-49ba-b94d-5fcdd955f572", "address": "fa:16:3e:22:37:f1", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a4d35f3-f1", "ovs_interfaceid": "9a4d35f3-f184-49ba-b94d-5fcdd955f572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:37:f1,bridge_name='br-int',has_traffic_filtering=True,id=9a4d35f3-f184-49ba-b94d-5fcdd955f572,network=Network(c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a4d35f3-f1') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG os_vif [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:37:f1,bridge_name='br-int',has_traffic_filtering=True,id=9a4d35f3-f184-49ba-b94d-5fcdd955f572,network=Network(c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a4d35f3-f1') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '467ff073-f317-57b0-a2ed-f91449840492', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:42:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a4d35f3-f1, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:42:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9a4d35f3-f1, col_values=(('qos', UUID('6c3d0b48-0081-4c56-9b83-0d55a0094dac')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:42:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9a4d35f3-f1, col_values=(('external_ids', {'iface-id': '9a4d35f3-f184-49ba-b94d-5fcdd955f572', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:37:f1', 'vm-uuid': '8608d2cf-476d-43b8-a124-c44507459a1e'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:42:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:42:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:57 user nova-compute[75080]: INFO os_vif [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:37:f1,bridge_name='br-int',has_traffic_filtering=True,id=9a4d35f3-f184-49ba-b94d-5fcdd955f572,network=Network(c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a4d35f3-f1')
Dec 05 15:42:57 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:42:57 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] No VIF found with MAC fa:16:3e:22:37:f1, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:42:57 user nova-compute[75080]: DEBUG nova.network.neutron [req-17ce3583-4b6d-47be-af2d-a97d3573037a req-d55a6dfa-368e-4f29-b55e-cfa76c1b7dd2 service nova] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Updated VIF entry in instance network info cache for port 9a4d35f3-f184-49ba-b94d-5fcdd955f572. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:42:57 user nova-compute[75080]: DEBUG nova.network.neutron [req-17ce3583-4b6d-47be-af2d-a97d3573037a req-d55a6dfa-368e-4f29-b55e-cfa76c1b7dd2 service nova] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Updating instance_info_cache with network_info: [{"id": "9a4d35f3-f184-49ba-b94d-5fcdd955f572", "address": "fa:16:3e:22:37:f1", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a4d35f3-f1", "ovs_interfaceid": "9a4d35f3-f184-49ba-b94d-5fcdd955f572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:42:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-17ce3583-4b6d-47be-af2d-a97d3573037a req-d55a6dfa-368e-4f29-b55e-cfa76c1b7dd2 service nova] Releasing lock "refresh_cache-8608d2cf-476d-43b8-a124-c44507459a1e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:42:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:57 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:42:57 user nova-compute[75080]: DEBUG nova.compute.manager [req-057f6648-1878-4e20-b2f6-b029737ae43a req-76ae925f-366a-4047-b8cb-d9c6f700041f service nova] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Received event network-vif-deleted-c66977a0-8209-4cd2-8c16-fe7819474020 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:42:57 user nova-compute[75080]: INFO nova.compute.manager [req-057f6648-1878-4e20-b2f6-b029737ae43a req-76ae925f-366a-4047-b8cb-d9c6f700041f service nova] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Neutron deleted interface c66977a0-8209-4cd2-8c16-fe7819474020; detaching it from the instance and deleting it from the info cache
Dec 05 15:42:57 user nova-compute[75080]: DEBUG nova.network.neutron [req-057f6648-1878-4e20-b2f6-b029737ae43a req-76ae925f-366a-4047-b8cb-d9c6f700041f service nova] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:42:57 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Took 0.75 seconds to deallocate network for instance.
Dec 05 15:42:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:57 user nova-compute[75080]: DEBUG nova.compute.manager [req-057f6648-1878-4e20-b2f6-b029737ae43a req-76ae925f-366a-4047-b8cb-d9c6f700041f service nova] [instance: 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e] Detach interface failed, port_id=c66977a0-8209-4cd2-8c16-fe7819474020, reason: Instance 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e could not be found. {{(pid=75080) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 15:42:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e771b9d8-14db-4903-a7c4-5df5be269030 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e771b9d8-14db-4903-a7c4-5df5be269030 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:57 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-e771b9d8-14db-4903-a7c4-5df5be269030 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:42:57 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-e771b9d8-14db-4903-a7c4-5df5be269030 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:42:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e771b9d8-14db-4903-a7c4-5df5be269030 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:58 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-e771b9d8-14db-4903-a7c4-5df5be269030 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Deleted allocations for instance 2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e
Dec 05 15:42:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e771b9d8-14db-4903-a7c4-5df5be269030 tempest-AttachVolumeTestJSON-1911411330 tempest-AttachVolumeTestJSON-1911411330-project-member] Lock "2092c4bf-8fdf-42fc-81e1-2ccf6b40e18e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.761s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:58 user nova-compute[75080]: DEBUG nova.compute.manager [req-184002fe-8475-4828-816d-9f2b4a1def5f req-9af17eb0-867f-4270-afc9-f27a8b0f9e87 service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Received event network-vif-plugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:42:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-184002fe-8475-4828-816d-9f2b4a1def5f req-9af17eb0-867f-4270-afc9-f27a8b0f9e87 service nova] Acquiring lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-184002fe-8475-4828-816d-9f2b4a1def5f req-9af17eb0-867f-4270-afc9-f27a8b0f9e87 service nova] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-184002fe-8475-4828-816d-9f2b4a1def5f req-9af17eb0-867f-4270-afc9-f27a8b0f9e87 service nova] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:58 user nova-compute[75080]: DEBUG nova.compute.manager [req-184002fe-8475-4828-816d-9f2b4a1def5f req-9af17eb0-867f-4270-afc9-f27a8b0f9e87 service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] No waiting events found dispatching network-vif-plugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:42:58 user nova-compute[75080]: WARNING nova.compute.manager [req-184002fe-8475-4828-816d-9f2b4a1def5f req-9af17eb0-867f-4270-afc9-f27a8b0f9e87 service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Received unexpected event network-vif-plugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 for instance with vm_state building and task_state spawning.
Dec 05 15:42:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:42:59 user nova-compute[75080]: DEBUG nova.compute.manager [req-639c0c89-5970-4759-a2f9-f9ada1da14e2 req-323178d2-3f9a-430b-9124-b00a71bc579b service nova] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Received event network-vif-plugged-9a4d35f3-f184-49ba-b94d-5fcdd955f572 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:42:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-639c0c89-5970-4759-a2f9-f9ada1da14e2 req-323178d2-3f9a-430b-9124-b00a71bc579b service nova] Acquiring lock "8608d2cf-476d-43b8-a124-c44507459a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:42:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-639c0c89-5970-4759-a2f9-f9ada1da14e2 req-323178d2-3f9a-430b-9124-b00a71bc579b service nova] Lock "8608d2cf-476d-43b8-a124-c44507459a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:42:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-639c0c89-5970-4759-a2f9-f9ada1da14e2 req-323178d2-3f9a-430b-9124-b00a71bc579b service nova] Lock "8608d2cf-476d-43b8-a124-c44507459a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:42:59 user nova-compute[75080]: DEBUG nova.compute.manager [req-639c0c89-5970-4759-a2f9-f9ada1da14e2 req-323178d2-3f9a-430b-9124-b00a71bc579b service nova] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] No waiting events found dispatching network-vif-plugged-9a4d35f3-f184-49ba-b94d-5fcdd955f572 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:42:59 user nova-compute[75080]: WARNING nova.compute.manager [req-639c0c89-5970-4759-a2f9-f9ada1da14e2 req-323178d2-3f9a-430b-9124-b00a71bc579b service nova] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Received unexpected event network-vif-plugged-9a4d35f3-f184-49ba-b94d-5fcdd955f572 for instance with vm_state building and task_state spawning.
Dec 05 15:42:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:43:00 user nova-compute[75080]: DEBUG nova.compute.manager [req-66f80987-9614-45ee-9966-328d87a5d3ba req-2d1c2d03-26d3-4941-b95f-1b631e8b2f38 service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Received event network-vif-plugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:43:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-66f80987-9614-45ee-9966-328d87a5d3ba req-2d1c2d03-26d3-4941-b95f-1b631e8b2f38 service nova] Acquiring lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:43:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-66f80987-9614-45ee-9966-328d87a5d3ba req-2d1c2d03-26d3-4941-b95f-1b631e8b2f38 service nova] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:43:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-66f80987-9614-45ee-9966-328d87a5d3ba req-2d1c2d03-26d3-4941-b95f-1b631e8b2f38 service nova] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:43:00 user nova-compute[75080]: DEBUG nova.compute.manager [req-66f80987-9614-45ee-9966-328d87a5d3ba req-2d1c2d03-26d3-4941-b95f-1b631e8b2f38 service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] No waiting events found dispatching network-vif-plugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:43:00 user nova-compute[75080]: WARNING nova.compute.manager [req-66f80987-9614-45ee-9966-328d87a5d3ba req-2d1c2d03-26d3-4941-b95f-1b631e8b2f38 service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Received unexpected event network-vif-plugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 for instance with vm_state building and task_state spawning.
Dec 05 15:43:00 user nova-compute[75080]: DEBUG nova.compute.manager [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:43:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:43:00 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Instance spawned successfully.
Dec 05 15:43:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:43:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:43:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:43:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:43:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:43:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:43:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:43:00 user nova-compute[75080]: INFO nova.compute.manager [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Took 7.18 seconds to spawn the instance on the hypervisor.
Dec 05 15:43:00 user nova-compute[75080]: DEBUG nova.compute.manager [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:43:00 user nova-compute[75080]: INFO nova.compute.manager [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Took 7.85 seconds to build instance.
Dec 05 15:43:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-346f1d37-0132-43f1-97d7-93a6258bebd2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.964s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:43:01 user nova-compute[75080]: DEBUG nova.compute.manager [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:43:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:43:01 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Instance spawned successfully.
Dec 05 15:43:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:43:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:43:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:43:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:43:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:43:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:43:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:43:01 user nova-compute[75080]: DEBUG nova.compute.manager [req-6e43f42b-5c45-458a-b054-7c8fe343e7ef req-c1a82860-a5f1-41f5-a149-dfc6b5d84ef3 service nova] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Received event network-vif-plugged-9a4d35f3-f184-49ba-b94d-5fcdd955f572 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:43:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-6e43f42b-5c45-458a-b054-7c8fe343e7ef req-c1a82860-a5f1-41f5-a149-dfc6b5d84ef3 service nova] Acquiring lock "8608d2cf-476d-43b8-a124-c44507459a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:43:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-6e43f42b-5c45-458a-b054-7c8fe343e7ef req-c1a82860-a5f1-41f5-a149-dfc6b5d84ef3 service nova] Lock "8608d2cf-476d-43b8-a124-c44507459a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:43:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-6e43f42b-5c45-458a-b054-7c8fe343e7ef req-c1a82860-a5f1-41f5-a149-dfc6b5d84ef3 service nova] Lock "8608d2cf-476d-43b8-a124-c44507459a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:43:01 user nova-compute[75080]: DEBUG nova.compute.manager [req-6e43f42b-5c45-458a-b054-7c8fe343e7ef req-c1a82860-a5f1-41f5-a149-dfc6b5d84ef3 service nova] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] No waiting events found dispatching network-vif-plugged-9a4d35f3-f184-49ba-b94d-5fcdd955f572 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:43:01 user nova-compute[75080]: WARNING nova.compute.manager [req-6e43f42b-5c45-458a-b054-7c8fe343e7ef req-c1a82860-a5f1-41f5-a149-dfc6b5d84ef3 service nova] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Received unexpected event network-vif-plugged-9a4d35f3-f184-49ba-b94d-5fcdd955f572 for instance with vm_state building and task_state spawning.
Dec 05 15:43:01 user nova-compute[75080]: INFO nova.compute.manager [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Took 6.46 seconds to spawn the instance on the hypervisor.
Dec 05 15:43:01 user nova-compute[75080]: DEBUG nova.compute.manager [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:43:01 user nova-compute[75080]: INFO nova.compute.manager [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Took 7.30 seconds to build instance.
Dec 05 15:43:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-66a8ff17-b782-4ecd-b48f-009fbd3f18a7 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "8608d2cf-476d-43b8-a124-c44507459a1e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.413s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:43:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:43:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:43:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:43:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:43:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:43:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:43:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0f5bd919-e20f-4755-91b8-5d55022cff07 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "07b025ff-4a9d-48a2-b950-b8f2d165f33c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:43:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0f5bd919-e20f-4755-91b8-5d55022cff07 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "07b025ff-4a9d-48a2-b950-b8f2d165f33c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:43:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0f5bd919-e20f-4755-91b8-5d55022cff07 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "07b025ff-4a9d-48a2-b950-b8f2d165f33c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:43:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0f5bd919-e20f-4755-91b8-5d55022cff07 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "07b025ff-4a9d-48a2-b950-b8f2d165f33c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:43:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0f5bd919-e20f-4755-91b8-5d55022cff07 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "07b025ff-4a9d-48a2-b950-b8f2d165f33c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:43:16 user nova-compute[75080]: INFO nova.compute.manager [None req-0f5bd919-e20f-4755-91b8-5d55022cff07 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Terminating instance
Dec 05 15:43:16 user nova-compute[75080]: DEBUG nova.compute.manager [None req-0f5bd919-e20f-4755-91b8-5d55022cff07 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:43:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:43:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:43:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:43:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:43:16 user nova-compute[75080]: DEBUG nova.compute.manager [req-7756167a-5f4e-4560-9ebf-5a605ca9395d req-02303f2e-94c4-496e-8190-9e6f28d73f04 service nova] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Received event network-vif-unplugged-b499a54e-2aab-4f63-a634-66c6a627bb4a {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:43:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7756167a-5f4e-4560-9ebf-5a605ca9395d req-02303f2e-94c4-496e-8190-9e6f28d73f04 service nova] Acquiring lock "07b025ff-4a9d-48a2-b950-b8f2d165f33c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:43:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7756167a-5f4e-4560-9ebf-5a605ca9395d req-02303f2e-94c4-496e-8190-9e6f28d73f04 service nova] Lock "07b025ff-4a9d-48a2-b950-b8f2d165f33c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:43:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7756167a-5f4e-4560-9ebf-5a605ca9395d req-02303f2e-94c4-496e-8190-9e6f28d73f04 service nova] Lock "07b025ff-4a9d-48a2-b950-b8f2d165f33c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:43:16 user nova-compute[75080]: DEBUG nova.compute.manager [req-7756167a-5f4e-4560-9ebf-5a605ca9395d req-02303f2e-94c4-496e-8190-9e6f28d73f04 service nova] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] No waiting events found dispatching network-vif-unplugged-b499a54e-2aab-4f63-a634-66c6a627bb4a {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:43:16 user nova-compute[75080]: DEBUG nova.compute.manager [req-7756167a-5f4e-4560-9ebf-5a605ca9395d req-02303f2e-94c4-496e-8190-9e6f28d73f04 service nova] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Received event network-vif-unplugged-b499a54e-2aab-4f63-a634-66c6a627bb4a for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:43:16 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Instance destroyed successfully.
Dec 05 15:43:16 user nova-compute[75080]: DEBUG nova.objects.instance [None req-0f5bd919-e20f-4755-91b8-5d55022cff07 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lazy-loading 'resources' on Instance uuid 07b025ff-4a9d-48a2-b950-b8f2d165f33c {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:43:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-0f5bd919-e20f-4755-91b8-5d55022cff07 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:22:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-636436384',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-636436384',id=18,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:22:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97145ab79b414c4fb8772c71e9414581',ramdisk_id='',reservation_id='r-vxqa80e6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2060228993',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:24:44Z,user_data=None,user_id='829d709c32db431199af609ddbc8b090',uuid=07b025ff-4a9d-48a2-b950-b8f2d165f33c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b499a54e-2aab-4f63-a634-66c6a627bb4a", "address": "fa:16:3e:14:03:09", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb499a54e-2a", "ovs_interfaceid": "b499a54e-2aab-4f63-a634-66c6a627bb4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:43:16 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-0f5bd919-e20f-4755-91b8-5d55022cff07 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Converting VIF {"id": "b499a54e-2aab-4f63-a634-66c6a627bb4a", "address": "fa:16:3e:14:03:09", "network": {"id": "61aa968d-7e44-4ef2-955f-2e5441416f43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1896366894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97145ab79b414c4fb8772c71e9414581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb499a54e-2a", "ovs_interfaceid": "b499a54e-2aab-4f63-a634-66c6a627bb4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:43:16 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-0f5bd919-e20f-4755-91b8-5d55022cff07 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:03:09,bridge_name='br-int',has_traffic_filtering=True,id=b499a54e-2aab-4f63-a634-66c6a627bb4a,network=Network(61aa968d-7e44-4ef2-955f-2e5441416f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb499a54e-2a') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:43:16 user nova-compute[75080]: DEBUG os_vif [None req-0f5bd919-e20f-4755-91b8-5d55022cff07 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:03:09,bridge_name='br-int',has_traffic_filtering=True,id=b499a54e-2aab-4f63-a634-66c6a627bb4a,network=Network(61aa968d-7e44-4ef2-955f-2e5441416f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb499a54e-2a') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:43:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:43:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb499a54e-2a, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:43:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:43:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:43:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3833955b-60bb-49a2-a82c-5bf8ee51db09) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:43:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:43:16 user nova-compute[75080]: INFO os_vif [None req-0f5bd919-e20f-4755-91b8-5d55022cff07 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:03:09,bridge_name='br-int',has_traffic_filtering=True,id=b499a54e-2aab-4f63-a634-66c6a627bb4a,network=Network(61aa968d-7e44-4ef2-955f-2e5441416f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb499a54e-2a')
Dec 05 15:43:16 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-0f5bd919-e20f-4755-91b8-5d55022cff07 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Deleting instance files /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c_del
Dec 05 15:43:16 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-0f5bd919-e20f-4755-91b8-5d55022cff07 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Deletion of /opt/stack/data/nova/instances/07b025ff-4a9d-48a2-b950-b8f2d165f33c_del complete
Dec 05 15:43:16 user nova-compute[75080]: INFO nova.compute.manager [None req-0f5bd919-e20f-4755-91b8-5d55022cff07 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Took 0.74 seconds to destroy the instance on the hypervisor.
Dec 05 15:43:16 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-0f5bd919-e20f-4755-91b8-5d55022cff07 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:43:16 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:43:16 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:43:17 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:43:17 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Took 0.47 seconds to deallocate network for instance.
Dec 05 15:43:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0f5bd919-e20f-4755-91b8-5d55022cff07 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:43:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0f5bd919-e20f-4755-91b8-5d55022cff07 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:43:17 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-0f5bd919-e20f-4755-91b8-5d55022cff07 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:43:17 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-0f5bd919-e20f-4755-91b8-5d55022cff07 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:43:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0f5bd919-e20f-4755-91b8-5d55022cff07 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.198s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:43:17 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-0f5bd919-e20f-4755-91b8-5d55022cff07 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Deleted allocations for instance 07b025ff-4a9d-48a2-b950-b8f2d165f33c
Dec 05 15:43:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:43:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0f5bd919-e20f-4755-91b8-5d55022cff07 tempest-ServerBootFromVolumeStableRescueTest-2060228993 tempest-ServerBootFromVolumeStableRescueTest-2060228993-project-member] Lock "07b025ff-4a9d-48a2-b950-b8f2d165f33c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.579s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:43:18 user nova-compute[75080]: DEBUG nova.compute.manager [req-e0fb8afb-8398-4cb8-9160-352fa3b62a06 req-7d7b3257-c682-43b1-ae86-5d2276d5e631 service nova] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Received event network-vif-plugged-b499a54e-2aab-4f63-a634-66c6a627bb4a {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:43:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-e0fb8afb-8398-4cb8-9160-352fa3b62a06 req-7d7b3257-c682-43b1-ae86-5d2276d5e631 service nova] Acquiring lock "07b025ff-4a9d-48a2-b950-b8f2d165f33c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:43:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-e0fb8afb-8398-4cb8-9160-352fa3b62a06 req-7d7b3257-c682-43b1-ae86-5d2276d5e631 service nova] Lock "07b025ff-4a9d-48a2-b950-b8f2d165f33c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:43:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-e0fb8afb-8398-4cb8-9160-352fa3b62a06 req-7d7b3257-c682-43b1-ae86-5d2276d5e631 service nova] Lock "07b025ff-4a9d-48a2-b950-b8f2d165f33c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:43:18 user nova-compute[75080]: DEBUG nova.compute.manager [req-e0fb8afb-8398-4cb8-9160-352fa3b62a06 req-7d7b3257-c682-43b1-ae86-5d2276d5e631 service nova] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] No waiting events found dispatching network-vif-plugged-b499a54e-2aab-4f63-a634-66c6a627bb4a {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:43:18 user nova-compute[75080]: WARNING nova.compute.manager [req-e0fb8afb-8398-4cb8-9160-352fa3b62a06 req-7d7b3257-c682-43b1-ae86-5d2276d5e631 service nova] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Received unexpected event network-vif-plugged-b499a54e-2aab-4f63-a634-66c6a627bb4a for instance with vm_state deleted and task_state None.
Dec 05 15:43:18 user nova-compute[75080]: DEBUG nova.compute.manager [req-e0fb8afb-8398-4cb8-9160-352fa3b62a06 req-7d7b3257-c682-43b1-ae86-5d2276d5e631 service nova] [instance: 07b025ff-4a9d-48a2-b950-b8f2d165f33c] Received event network-vif-deleted-b499a54e-2aab-4f63-a634-66c6a627bb4a {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:43:21 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:43:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:43:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:43:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:43:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:43:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:43:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:43:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:43:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:43:44 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:43:44 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:43:44 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75080) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 05 15:43:45 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:43:45 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:43:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:43:47 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:43:47 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:43:50 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:43:50 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:43:50 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Didn't find any instances for network info cache update. {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 15:43:50 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:43:50 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:43:50 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:43:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:43:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:43:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:43:50 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:43:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:43:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:43:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:43:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:43:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16868d8f-debd-4fcd-a3ad-16f99bad11d4/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:43:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16868d8f-debd-4fcd-a3ad-16f99bad11d4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:43:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16868d8f-debd-4fcd-a3ad-16f99bad11d4/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:43:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16868d8f-debd-4fcd-a3ad-16f99bad11d4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:43:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc66525f-8802-426d-872f-5b567e05b316/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:43:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc66525f-8802-426d-872f-5b567e05b316/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:43:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc66525f-8802-426d-872f-5b567e05b316/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:43:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:43:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc66525f-8802-426d-872f-5b567e05b316/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:43:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:43:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:43:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:43:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:43:52 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:43:52 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:43:52 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=8471MB free_disk=24.94357681274414GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:43:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:43:52 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:43:52 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 16868d8f-debd-4fcd-a3ad-16f99bad11d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:43:52 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance bc66525f-8802-426d-872f-5b567e05b316 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:43:52 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance db0fde77-eb40-4acb-93f7-66b5b76c8eea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:43:52 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 8608d2cf-476d-43b8-a124-c44507459a1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:43:52 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:43:52 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:43:52 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing inventories for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 05 15:43:52 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Updating ProviderTree inventory for provider 21b770fa-b774-46c9-9415-db26064ccd0f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 05 15:43:52 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Updating inventory in ProviderTree for provider 21b770fa-b774-46c9-9415-db26064ccd0f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 15:43:52 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing aggregate associations for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f, aggregates: None {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 05 15:43:52 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing trait associations for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f, traits: COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 05 15:43:53 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:43:53 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:43:53 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:43:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.561s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:43:53 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:43:53 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Cleaning up deleted instances {{(pid=75080) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 05 15:43:53 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] There are 0 instances to clean {{(pid=75080) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 05 15:43:55 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:43:55 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:43:55 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:43:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:43:57 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:44:01 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:06 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:11 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f392ba2c-f97c-4d98-aac0-4af6755c0fc8 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Acquiring lock "16868d8f-debd-4fcd-a3ad-16f99bad11d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:44:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f392ba2c-f97c-4d98-aac0-4af6755c0fc8 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Lock "16868d8f-debd-4fcd-a3ad-16f99bad11d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:44:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f392ba2c-f97c-4d98-aac0-4af6755c0fc8 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Acquiring lock "16868d8f-debd-4fcd-a3ad-16f99bad11d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:44:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f392ba2c-f97c-4d98-aac0-4af6755c0fc8 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Lock "16868d8f-debd-4fcd-a3ad-16f99bad11d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:44:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f392ba2c-f97c-4d98-aac0-4af6755c0fc8 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Lock "16868d8f-debd-4fcd-a3ad-16f99bad11d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:44:12 user nova-compute[75080]: INFO nova.compute.manager [None req-f392ba2c-f97c-4d98-aac0-4af6755c0fc8 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Terminating instance
Dec 05 15:44:12 user nova-compute[75080]: DEBUG nova.compute.manager [None req-f392ba2c-f97c-4d98-aac0-4af6755c0fc8 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:44:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:12 user nova-compute[75080]: DEBUG nova.compute.manager [req-4e4988e8-3e38-4121-a4dd-3790427b046e req-e6bc2b51-92ab-4360-a9c8-22fbc50260d6 service nova] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Received event network-vif-unplugged-11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:44:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4e4988e8-3e38-4121-a4dd-3790427b046e req-e6bc2b51-92ab-4360-a9c8-22fbc50260d6 service nova] Acquiring lock "16868d8f-debd-4fcd-a3ad-16f99bad11d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:44:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4e4988e8-3e38-4121-a4dd-3790427b046e req-e6bc2b51-92ab-4360-a9c8-22fbc50260d6 service nova] Lock "16868d8f-debd-4fcd-a3ad-16f99bad11d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:44:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4e4988e8-3e38-4121-a4dd-3790427b046e req-e6bc2b51-92ab-4360-a9c8-22fbc50260d6 service nova] Lock "16868d8f-debd-4fcd-a3ad-16f99bad11d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:44:12 user nova-compute[75080]: DEBUG nova.compute.manager [req-4e4988e8-3e38-4121-a4dd-3790427b046e req-e6bc2b51-92ab-4360-a9c8-22fbc50260d6 service nova] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] No waiting events found dispatching network-vif-unplugged-11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:44:12 user nova-compute[75080]: DEBUG nova.compute.manager [req-4e4988e8-3e38-4121-a4dd-3790427b046e req-e6bc2b51-92ab-4360-a9c8-22fbc50260d6 service nova] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Received event network-vif-unplugged-11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:44:12 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Instance destroyed successfully.
Dec 05 15:44:12 user nova-compute[75080]: DEBUG nova.objects.instance [None req-f392ba2c-f97c-4d98-aac0-4af6755c0fc8 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Lazy-loading 'resources' on Instance uuid 16868d8f-debd-4fcd-a3ad-16f99bad11d4 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:44:12 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-f392ba2c-f97c-4d98-aac0-4af6755c0fc8 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:42:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1581587706',display_name='tempest-VolumesActionsTest-instance-1581587706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1581587706',id=41,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:42:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ff4c097a2f04bd2b069acb5e67dc435',ramdisk_id='',reservation_id='r-xri1cxn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-818319633',owner_user_name='tempest-VolumesActionsTest-818319633-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:42:20Z,user_data=None,user_id='f8f9d10ee71a4458a571446e7ff39713',uuid=16868d8f-debd-4fcd-a3ad-16f99bad11d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b", "address": "fa:16:3e:71:82:f7", "network": {"id": "1793a330-201d-4987-902e-7b57d688a8b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1839084053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ff4c097a2f04bd2b069acb5e67dc435", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d9cc59-4f", "ovs_interfaceid": "11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:44:12 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-f392ba2c-f97c-4d98-aac0-4af6755c0fc8 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Converting VIF {"id": "11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b", "address": "fa:16:3e:71:82:f7", "network": {"id": "1793a330-201d-4987-902e-7b57d688a8b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1839084053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ff4c097a2f04bd2b069acb5e67dc435", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d9cc59-4f", "ovs_interfaceid": "11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:44:12 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-f392ba2c-f97c-4d98-aac0-4af6755c0fc8 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:82:f7,bridge_name='br-int',has_traffic_filtering=True,id=11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b,network=Network(1793a330-201d-4987-902e-7b57d688a8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11d9cc59-4f') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:44:12 user nova-compute[75080]: DEBUG os_vif [None req-f392ba2c-f97c-4d98-aac0-4af6755c0fc8 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:82:f7,bridge_name='br-int',has_traffic_filtering=True,id=11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b,network=Network(1793a330-201d-4987-902e-7b57d688a8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11d9cc59-4f') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:44:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11d9cc59-4f, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:44:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:44:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1591a6f9-0c0e-4e10-b25e-c9b27d83fd45) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:44:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:12 user nova-compute[75080]: INFO os_vif [None req-f392ba2c-f97c-4d98-aac0-4af6755c0fc8 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:82:f7,bridge_name='br-int',has_traffic_filtering=True,id=11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b,network=Network(1793a330-201d-4987-902e-7b57d688a8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11d9cc59-4f')
Dec 05 15:44:12 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-f392ba2c-f97c-4d98-aac0-4af6755c0fc8 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Deleting instance files /opt/stack/data/nova/instances/16868d8f-debd-4fcd-a3ad-16f99bad11d4_del
Dec 05 15:44:12 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-f392ba2c-f97c-4d98-aac0-4af6755c0fc8 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Deletion of /opt/stack/data/nova/instances/16868d8f-debd-4fcd-a3ad-16f99bad11d4_del complete
Dec 05 15:44:12 user nova-compute[75080]: INFO nova.compute.manager [None req-f392ba2c-f97c-4d98-aac0-4af6755c0fc8 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Took 0.90 seconds to destroy the instance on the hypervisor.
Dec 05 15:44:12 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-f392ba2c-f97c-4d98-aac0-4af6755c0fc8 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:44:12 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:44:12 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:44:13 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:44:13 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Took 0.62 seconds to deallocate network for instance.
Dec 05 15:44:13 user nova-compute[75080]: DEBUG nova.compute.manager [req-f909d3d5-6f83-4529-94c3-da62609acbc7 req-dd7a892c-9a83-4978-ae1d-7754a63ed3c2 service nova] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Received event network-vif-deleted-11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:44:13 user nova-compute[75080]: INFO nova.compute.manager [req-f909d3d5-6f83-4529-94c3-da62609acbc7 req-dd7a892c-9a83-4978-ae1d-7754a63ed3c2 service nova] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Neutron deleted interface 11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b; detaching it from the instance and deleting it from the info cache
Dec 05 15:44:13 user nova-compute[75080]: DEBUG nova.network.neutron [req-f909d3d5-6f83-4529-94c3-da62609acbc7 req-dd7a892c-9a83-4978-ae1d-7754a63ed3c2 service nova] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:44:13 user nova-compute[75080]: DEBUG nova.compute.manager [req-f909d3d5-6f83-4529-94c3-da62609acbc7 req-dd7a892c-9a83-4978-ae1d-7754a63ed3c2 service nova] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Detach interface failed, port_id=11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b, reason: Instance 16868d8f-debd-4fcd-a3ad-16f99bad11d4 could not be found. {{(pid=75080) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 15:44:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f392ba2c-f97c-4d98-aac0-4af6755c0fc8 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:44:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f392ba2c-f97c-4d98-aac0-4af6755c0fc8 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:44:13 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-f392ba2c-f97c-4d98-aac0-4af6755c0fc8 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:44:13 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-f392ba2c-f97c-4d98-aac0-4af6755c0fc8 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:44:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f392ba2c-f97c-4d98-aac0-4af6755c0fc8 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:44:13 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-f392ba2c-f97c-4d98-aac0-4af6755c0fc8 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Deleted allocations for instance 16868d8f-debd-4fcd-a3ad-16f99bad11d4
Dec 05 15:44:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-f392ba2c-f97c-4d98-aac0-4af6755c0fc8 tempest-VolumesActionsTest-818319633 tempest-VolumesActionsTest-818319633-project-member] Lock "16868d8f-debd-4fcd-a3ad-16f99bad11d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.974s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:44:14 user nova-compute[75080]: DEBUG nova.compute.manager [req-24678386-1a27-47ba-9681-1938d25f01f0 req-089e469d-409e-4b16-9f22-aa36e36925d7 service nova] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Received event network-vif-plugged-11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:44:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-24678386-1a27-47ba-9681-1938d25f01f0 req-089e469d-409e-4b16-9f22-aa36e36925d7 service nova] Acquiring lock "16868d8f-debd-4fcd-a3ad-16f99bad11d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:44:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-24678386-1a27-47ba-9681-1938d25f01f0 req-089e469d-409e-4b16-9f22-aa36e36925d7 service nova] Lock "16868d8f-debd-4fcd-a3ad-16f99bad11d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:44:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-24678386-1a27-47ba-9681-1938d25f01f0 req-089e469d-409e-4b16-9f22-aa36e36925d7 service nova] Lock "16868d8f-debd-4fcd-a3ad-16f99bad11d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:44:14 user nova-compute[75080]: DEBUG nova.compute.manager [req-24678386-1a27-47ba-9681-1938d25f01f0 req-089e469d-409e-4b16-9f22-aa36e36925d7 service nova] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] No waiting events found dispatching network-vif-plugged-11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:44:14 user nova-compute[75080]: WARNING nova.compute.manager [req-24678386-1a27-47ba-9681-1938d25f01f0 req-089e469d-409e-4b16-9f22-aa36e36925d7 service nova] [instance: 16868d8f-debd-4fcd-a3ad-16f99bad11d4] Received unexpected event network-vif-plugged-11d9cc59-4fd3-4801-b4e8-7b91e4b75d6b for instance with vm_state deleted and task_state None.
Dec 05 15:44:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:44:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 15:44:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:44:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:44:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:23 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:44:27 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:44:27 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Triggering sync for uuid bc66525f-8802-426d-872f-5b567e05b316 {{(pid=75080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 15:44:27 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Triggering sync for uuid db0fde77-eb40-4acb-93f7-66b5b76c8eea {{(pid=75080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 15:44:27 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Triggering sync for uuid 8608d2cf-476d-43b8-a124-c44507459a1e {{(pid=75080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 15:44:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "bc66525f-8802-426d-872f-5b567e05b316" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:44:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "bc66525f-8802-426d-872f-5b567e05b316" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:44:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:44:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:44:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "8608d2cf-476d-43b8-a124-c44507459a1e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:44:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "8608d2cf-476d-43b8-a124-c44507459a1e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:44:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "bc66525f-8802-426d-872f-5b567e05b316" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:44:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:44:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "8608d2cf-476d-43b8-a124-c44507459a1e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:44:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:44:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 15:44:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:44:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:44:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquiring lock "bc66525f-8802-426d-872f-5b567e05b316" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:44:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "bc66525f-8802-426d-872f-5b567e05b316" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:44:38 user nova-compute[75080]: DEBUG nova.objects.instance [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lazy-loading 'flavor' on Instance uuid bc66525f-8802-426d-872f-5b567e05b316 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:44:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "bc66525f-8802-426d-872f-5b567e05b316" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:44:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquiring lock "bc66525f-8802-426d-872f-5b567e05b316" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:44:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "bc66525f-8802-426d-872f-5b567e05b316" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:44:38 user nova-compute[75080]: INFO nova.compute.manager [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Attaching volume d33d6554-072a-49bc-9211-feaf5c29f91b to /dev/vdb
Dec 05 15:44:38 user nova-compute[75080]: DEBUG os_brick.utils [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:44:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:44:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:44:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba29c0cd-bd4b-4dcb-aedc-f79e73fd15a7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:44:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:44:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:44:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fea9240-04ed-4b6e-b6e5-2e0482f06f95]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:44:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:44:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:44:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[69af463d-3dd8-4a1f-82eb-03310af4c39a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:44:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7d1e59-2e5e-4290-89bb-3c8a78ffb76c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:44:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:44:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:44:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:44:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:44:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:44:38 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:44:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[31852963-ed23-48e2-8e93-85f432f77899]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:44:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:44:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:44:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:44:38 user nova-compute[75080]: DEBUG os_brick.utils [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:44:38 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Updating existing volume attachment record: ba06b420-daf7-4aac-8810-ec690a2c31ec {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:44:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:44 user nova-compute[75080]: INFO nova.compute.manager [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Rescuing
Dec 05 15:44:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "refresh_cache-8608d2cf-476d-43b8-a124-c44507459a1e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:44:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquired lock "refresh_cache-8608d2cf-476d-43b8-a124-c44507459a1e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:44:44 user nova-compute[75080]: DEBUG nova.network.neutron [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:44:44 user nova-compute[75080]: DEBUG nova.network.neutron [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Updating instance_info_cache with network_info: [{"id": "9a4d35f3-f184-49ba-b94d-5fcdd955f572", "address": "fa:16:3e:22:37:f1", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a4d35f3-f1", "ovs_interfaceid": "9a4d35f3-f184-49ba-b94d-5fcdd955f572", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:44:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Releasing lock "refresh_cache-8608d2cf-476d-43b8-a124-c44507459a1e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:44:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:44 user nova-compute[75080]: DEBUG nova.compute.manager [req-3231b032-d757-4357-8c9f-10eca8dde206 req-8d293443-4e16-42ea-84d8-89cee177eb4e service nova] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Received event network-vif-unplugged-9a4d35f3-f184-49ba-b94d-5fcdd955f572 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:44:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-3231b032-d757-4357-8c9f-10eca8dde206 req-8d293443-4e16-42ea-84d8-89cee177eb4e service nova] Acquiring lock "8608d2cf-476d-43b8-a124-c44507459a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:44:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-3231b032-d757-4357-8c9f-10eca8dde206 req-8d293443-4e16-42ea-84d8-89cee177eb4e service nova] Lock "8608d2cf-476d-43b8-a124-c44507459a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:44:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-3231b032-d757-4357-8c9f-10eca8dde206 req-8d293443-4e16-42ea-84d8-89cee177eb4e service nova] Lock "8608d2cf-476d-43b8-a124-c44507459a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:44:44 user nova-compute[75080]: DEBUG nova.compute.manager [req-3231b032-d757-4357-8c9f-10eca8dde206 req-8d293443-4e16-42ea-84d8-89cee177eb4e service nova] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] No waiting events found dispatching network-vif-unplugged-9a4d35f3-f184-49ba-b94d-5fcdd955f572 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:44:44 user nova-compute[75080]: WARNING nova.compute.manager [req-3231b032-d757-4357-8c9f-10eca8dde206 req-8d293443-4e16-42ea-84d8-89cee177eb4e service nova] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Received unexpected event network-vif-unplugged-9a4d35f3-f184-49ba-b94d-5fcdd955f572 for instance with vm_state active and task_state rescuing.
Dec 05 15:44:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:45 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Instance destroyed successfully.
Dec 05 15:44:45 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Attempting rescue
Dec 05 15:44:45 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75080) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Instance directory exists: not creating {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 05 15:44:45 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Creating image(s)
Dec 05 15:44:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "/opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "/opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "/opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG nova.objects.instance [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8608d2cf-476d-43b8-a124-c44507459a1e {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.181s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue" returned: 0 in 0.050s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG nova.objects.instance [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lazy-loading 'migration_context' on Instance uuid 8608d2cf-476d-43b8-a124-c44507459a1e {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG nova.objects.base [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Object Instance<8608d2cf-476d-43b8-a124-c44507459a1e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Start _get_guest_xml network_info=[{"id": "9a4d35f3-f184-49ba-b94d-5fcdd955f572", "address": "fa:16:3e:22:37:f1", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "vif_mac": "fa:16:3e:22:37:f1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a4d35f3-f1", "ovs_interfaceid": "9a4d35f3-f184-49ba-b94d-5fcdd955f572", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG nova.objects.instance [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lazy-loading 'resources' on Instance uuid 8608d2cf-476d-43b8-a124-c44507459a1e {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG nova.objects.base [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Object Instance<8608d2cf-476d-43b8-a124-c44507459a1e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG nova.objects.instance [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lazy-loading 'numa_topology' on Instance uuid 8608d2cf-476d-43b8-a124-c44507459a1e {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG nova.objects.base [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Object Instance<8608d2cf-476d-43b8-a124-c44507459a1e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:44:45 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:44:45 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:44:45 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG nova.objects.instance [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8608d2cf-476d-43b8-a124-c44507459a1e {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG nova.objects.base [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Object Instance<8608d2cf-476d-43b8-a124-c44507459a1e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:42:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-791550701',display_name='tempest-ServerRescueNegativeTestJSON-server-791550701',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-791550701',id=44,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:43:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cea1ac008cfd499a8df635aac9b1342d',ramdisk_id='',reservation_id='r-ih68cpqu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1626475760',owner_user_name='tempest-ServerRescueNegativeTestJSON-1626475760-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:43:01Z,user_data=None,user_id='1afa4590c69f423d97f7cd485e193b0f',uuid=8608d2cf-476d-43b8-a124-c44507459a1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a4d35f3-f184-49ba-b94d-5fcdd955f572", "address": "fa:16:3e:22:37:f1", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "vif_mac": "fa:16:3e:22:37:f1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a4d35f3-f1", "ovs_interfaceid": "9a4d35f3-f184-49ba-b94d-5fcdd955f572", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Converting VIF {"id": "9a4d35f3-f184-49ba-b94d-5fcdd955f572", "address": "fa:16:3e:22:37:f1", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "vif_mac": "fa:16:3e:22:37:f1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a4d35f3-f1", "ovs_interfaceid": "9a4d35f3-f184-49ba-b94d-5fcdd955f572", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:37:f1,bridge_name='br-int',has_traffic_filtering=True,id=9a4d35f3-f184-49ba-b94d-5fcdd955f572,network=Network(c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a4d35f3-f1') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG nova.objects.instance [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lazy-loading 'pci_devices' on Instance uuid 8608d2cf-476d-43b8-a124-c44507459a1e {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG nova.objects.base [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Object Instance<8608d2cf-476d-43b8-a124-c44507459a1e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:44:45 user nova-compute[75080]:   <uuid>8608d2cf-476d-43b8-a124-c44507459a1e</uuid>
Dec 05 15:44:45 user nova-compute[75080]:   <name>instance-0000002c</name>
Dec 05 15:44:45 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:44:45 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:44:45 user nova-compute[75080]:   <metadata>
Dec 05 15:44:45 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:44:45 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:44:45 user nova-compute[75080]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-791550701</nova:name>
Dec 05 15:44:45 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:44:45</nova:creationTime>
Dec 05 15:44:45 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:44:45 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:44:45 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:44:45 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:44:45 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:44:45 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:44:45 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:44:45 user nova-compute[75080]:       <nova:owner>
Dec 05 15:44:45 user nova-compute[75080]:         <nova:user uuid="1afa4590c69f423d97f7cd485e193b0f">tempest-ServerRescueNegativeTestJSON-1626475760-project-member</nova:user>
Dec 05 15:44:45 user nova-compute[75080]:         <nova:project uuid="cea1ac008cfd499a8df635aac9b1342d">tempest-ServerRescueNegativeTestJSON-1626475760</nova:project>
Dec 05 15:44:45 user nova-compute[75080]:       </nova:owner>
Dec 05 15:44:45 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:44:45 user nova-compute[75080]:       <nova:ports>
Dec 05 15:44:45 user nova-compute[75080]:         <nova:port uuid="9a4d35f3-f184-49ba-b94d-5fcdd955f572">
Dec 05 15:44:45 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 05 15:44:45 user nova-compute[75080]:         </nova:port>
Dec 05 15:44:45 user nova-compute[75080]:       </nova:ports>
Dec 05 15:44:45 user nova-compute[75080]:     </nova:instance>
Dec 05 15:44:45 user nova-compute[75080]:   </metadata>
Dec 05 15:44:45 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:44:45 user nova-compute[75080]:     <system>
Dec 05 15:44:45 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:44:45 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:44:45 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:44:45 user nova-compute[75080]:       <entry name="serial">8608d2cf-476d-43b8-a124-c44507459a1e</entry>
Dec 05 15:44:45 user nova-compute[75080]:       <entry name="uuid">8608d2cf-476d-43b8-a124-c44507459a1e</entry>
Dec 05 15:44:45 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:44:45 user nova-compute[75080]:     </system>
Dec 05 15:44:45 user nova-compute[75080]:   </sysinfo>
Dec 05 15:44:45 user nova-compute[75080]:   <os>
Dec 05 15:44:45 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:44:45 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:44:45 user nova-compute[75080]:   </os>
Dec 05 15:44:45 user nova-compute[75080]:   <features>
Dec 05 15:44:45 user nova-compute[75080]:     <acpi/>
Dec 05 15:44:45 user nova-compute[75080]:     <apic/>
Dec 05 15:44:45 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:44:45 user nova-compute[75080]:   </features>
Dec 05 15:44:45 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:44:45 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:44:45 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:44:45 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:44:45 user nova-compute[75080]:   </clock>
Dec 05 15:44:45 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:44:45 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:44:45 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:44:45 user nova-compute[75080]:   </cpu>
Dec 05 15:44:45 user nova-compute[75080]:   <devices>
Dec 05 15:44:45 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:44:45 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:44:45 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue"/>
Dec 05 15:44:45 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:44:45 user nova-compute[75080]:     </disk>
Dec 05 15:44:45 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:44:45 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:44:45 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk"/>
Dec 05 15:44:45 user nova-compute[75080]:       <target dev="vdb" bus="virtio"/>
Dec 05 15:44:45 user nova-compute[75080]:     </disk>
Dec 05 15:44:45 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:44:45 user nova-compute[75080]:       <mac address="fa:16:3e:22:37:f1"/>
Dec 05 15:44:45 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:44:45 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:44:45 user nova-compute[75080]:       <target dev="tap9a4d35f3-f1"/>
Dec 05 15:44:45 user nova-compute[75080]:     </interface>
Dec 05 15:44:45 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:44:45 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/console.log" append="off"/>
Dec 05 15:44:45 user nova-compute[75080]:     </serial>
Dec 05 15:44:45 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:44:45 user nova-compute[75080]:     <video>
Dec 05 15:44:45 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:44:45 user nova-compute[75080]:     </video>
Dec 05 15:44:45 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:44:45 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:44:45 user nova-compute[75080]:     </rng>
Dec 05 15:44:45 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:44:45 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:44:45 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:44:45 user nova-compute[75080]:     </memballoon>
Dec 05 15:44:45 user nova-compute[75080]:   </devices>
Dec 05 15:44:45 user nova-compute[75080]: </domain>
Dec 05 15:44:45 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:44:45 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Instance destroyed successfully.
Dec 05 15:44:45 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:44:45 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] No VIF found with MAC fa:16:3e:22:37:f1, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:44:46 user nova-compute[75080]: DEBUG nova.compute.manager [req-8f2fec71-d9b0-499c-9e8d-5989eb9791b0 req-21b68809-c4f6-481b-82cc-74599b62a14c service nova] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Received event network-vif-plugged-9a4d35f3-f184-49ba-b94d-5fcdd955f572 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:44:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8f2fec71-d9b0-499c-9e8d-5989eb9791b0 req-21b68809-c4f6-481b-82cc-74599b62a14c service nova] Acquiring lock "8608d2cf-476d-43b8-a124-c44507459a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:44:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8f2fec71-d9b0-499c-9e8d-5989eb9791b0 req-21b68809-c4f6-481b-82cc-74599b62a14c service nova] Lock "8608d2cf-476d-43b8-a124-c44507459a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:44:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8f2fec71-d9b0-499c-9e8d-5989eb9791b0 req-21b68809-c4f6-481b-82cc-74599b62a14c service nova] Lock "8608d2cf-476d-43b8-a124-c44507459a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:44:46 user nova-compute[75080]: DEBUG nova.compute.manager [req-8f2fec71-d9b0-499c-9e8d-5989eb9791b0 req-21b68809-c4f6-481b-82cc-74599b62a14c service nova] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] No waiting events found dispatching network-vif-plugged-9a4d35f3-f184-49ba-b94d-5fcdd955f572 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:44:46 user nova-compute[75080]: WARNING nova.compute.manager [req-8f2fec71-d9b0-499c-9e8d-5989eb9791b0 req-21b68809-c4f6-481b-82cc-74599b62a14c service nova] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Received unexpected event network-vif-plugged-9a4d35f3-f184-49ba-b94d-5fcdd955f572 for instance with vm_state active and task_state rescuing.
Dec 05 15:44:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Acquiring lock "8a97a6c4-8486-41be-b919-82ebf61771eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:44:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "8a97a6c4-8486-41be-b919-82ebf61771eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:44:47 user nova-compute[75080]: DEBUG nova.compute.manager [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:44:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:44:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:44:47 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:44:47 user nova-compute[75080]: INFO nova.compute.claims [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Claim successful on node user
Dec 05 15:44:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:47 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:44:47 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:44:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:47 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:44:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:48 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:44:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.801s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:44:48 user nova-compute[75080]: DEBUG nova.compute.manager [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:44:48 user nova-compute[75080]: DEBUG nova.compute.manager [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:44:48 user nova-compute[75080]: DEBUG nova.network.neutron [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:44:48 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:44:48 user nova-compute[75080]: DEBUG nova.compute.manager [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:44:48 user nova-compute[75080]: DEBUG nova.policy [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c312f375da424b90b954abc2617ad026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9070144481d84c98bdc9063c54a9e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:44:48 user nova-compute[75080]: DEBUG nova.compute.manager [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:44:48 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:44:48 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Creating image(s)
Dec 05 15:44:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Acquiring lock "/opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:44:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "/opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:44:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "/opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:44:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:44:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.171s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:44:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:44:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:44:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:44:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.187s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:44:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:44:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk 1073741824" returned: 0 in 0.048s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:44:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:44:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:44:48 user nova-compute[75080]: DEBUG nova.compute.manager [req-221cfb03-cf1f-402d-a320-3502bce7aa2d req-c64390be-783e-4ef7-b46d-80748bcabb15 service nova] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Received event network-vif-plugged-9a4d35f3-f184-49ba-b94d-5fcdd955f572 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:44:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-221cfb03-cf1f-402d-a320-3502bce7aa2d req-c64390be-783e-4ef7-b46d-80748bcabb15 service nova] Acquiring lock "8608d2cf-476d-43b8-a124-c44507459a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:44:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-221cfb03-cf1f-402d-a320-3502bce7aa2d req-c64390be-783e-4ef7-b46d-80748bcabb15 service nova] Lock "8608d2cf-476d-43b8-a124-c44507459a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:44:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-221cfb03-cf1f-402d-a320-3502bce7aa2d req-c64390be-783e-4ef7-b46d-80748bcabb15 service nova] Lock "8608d2cf-476d-43b8-a124-c44507459a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:44:48 user nova-compute[75080]: DEBUG nova.compute.manager [req-221cfb03-cf1f-402d-a320-3502bce7aa2d req-c64390be-783e-4ef7-b46d-80748bcabb15 service nova] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] No waiting events found dispatching network-vif-plugged-9a4d35f3-f184-49ba-b94d-5fcdd955f572 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:44:48 user nova-compute[75080]: WARNING nova.compute.manager [req-221cfb03-cf1f-402d-a320-3502bce7aa2d req-c64390be-783e-4ef7-b46d-80748bcabb15 service nova] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Received unexpected event network-vif-plugged-9a4d35f3-f184-49ba-b94d-5fcdd955f572 for instance with vm_state active and task_state rescuing.
Dec 05 15:44:48 user nova-compute[75080]: DEBUG nova.compute.manager [req-221cfb03-cf1f-402d-a320-3502bce7aa2d req-c64390be-783e-4ef7-b46d-80748bcabb15 service nova] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Received event network-vif-plugged-9a4d35f3-f184-49ba-b94d-5fcdd955f572 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:44:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-221cfb03-cf1f-402d-a320-3502bce7aa2d req-c64390be-783e-4ef7-b46d-80748bcabb15 service nova] Acquiring lock "8608d2cf-476d-43b8-a124-c44507459a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:44:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-221cfb03-cf1f-402d-a320-3502bce7aa2d req-c64390be-783e-4ef7-b46d-80748bcabb15 service nova] Lock "8608d2cf-476d-43b8-a124-c44507459a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:44:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-221cfb03-cf1f-402d-a320-3502bce7aa2d req-c64390be-783e-4ef7-b46d-80748bcabb15 service nova] Lock "8608d2cf-476d-43b8-a124-c44507459a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:44:48 user nova-compute[75080]: DEBUG nova.compute.manager [req-221cfb03-cf1f-402d-a320-3502bce7aa2d req-c64390be-783e-4ef7-b46d-80748bcabb15 service nova] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] No waiting events found dispatching network-vif-plugged-9a4d35f3-f184-49ba-b94d-5fcdd955f572 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:44:48 user nova-compute[75080]: WARNING nova.compute.manager [req-221cfb03-cf1f-402d-a320-3502bce7aa2d req-c64390be-783e-4ef7-b46d-80748bcabb15 service nova] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Received unexpected event network-vif-plugged-9a4d35f3-f184-49ba-b94d-5fcdd955f572 for instance with vm_state active and task_state rescuing.
Dec 05 15:44:48 user nova-compute[75080]: DEBUG nova.network.neutron [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Successfully created port: 0013f2c2-e337-4c3d-8885-ee027a53e8d8 {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:44:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.215s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:44:48 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 15:44:48 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Cannot resize image /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Ensure instance console log exists: /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG nova.compute.manager [None req-97921303-9633-449a-9b6e-006333d3f52b tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG nova.network.neutron [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Successfully updated port: 0013f2c2-e337-4c3d-8885-ee027a53e8d8 {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Acquiring lock "refresh_cache-8a97a6c4-8486-41be-b919-82ebf61771eb" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Acquired lock "refresh_cache-8a97a6c4-8486-41be-b919-82ebf61771eb" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG nova.network.neutron [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG nova.compute.manager [req-688738fd-81bf-458c-aeec-6370c062880d req-c8fcb4ab-316b-4267-a243-37624577bb78 service nova] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Received event network-changed-0013f2c2-e337-4c3d-8885-ee027a53e8d8 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG nova.compute.manager [req-688738fd-81bf-458c-aeec-6370c062880d req-c8fcb4ab-316b-4267-a243-37624577bb78 service nova] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Refreshing instance network info cache due to event network-changed-0013f2c2-e337-4c3d-8885-ee027a53e8d8. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-688738fd-81bf-458c-aeec-6370c062880d req-c8fcb4ab-316b-4267-a243-37624577bb78 service nova] Acquiring lock "refresh_cache-8a97a6c4-8486-41be-b919-82ebf61771eb" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG nova.network.neutron [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG nova.network.neutron [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Updating instance_info_cache with network_info: [{"id": "0013f2c2-e337-4c3d-8885-ee027a53e8d8", "address": "fa:16:3e:2f:30:8f", "network": {"id": "236ffb89-7d87-41de-8dac-e36bfb38a2d0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-187610999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9070144481d84c98bdc9063c54a9e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0013f2c2-e3", "ovs_interfaceid": "0013f2c2-e337-4c3d-8885-ee027a53e8d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Releasing lock "refresh_cache-8a97a6c4-8486-41be-b919-82ebf61771eb" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG nova.compute.manager [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Instance network_info: |[{"id": "0013f2c2-e337-4c3d-8885-ee027a53e8d8", "address": "fa:16:3e:2f:30:8f", "network": {"id": "236ffb89-7d87-41de-8dac-e36bfb38a2d0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-187610999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9070144481d84c98bdc9063c54a9e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0013f2c2-e3", "ovs_interfaceid": "0013f2c2-e337-4c3d-8885-ee027a53e8d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-688738fd-81bf-458c-aeec-6370c062880d req-c8fcb4ab-316b-4267-a243-37624577bb78 service nova] Acquired lock "refresh_cache-8a97a6c4-8486-41be-b919-82ebf61771eb" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG nova.network.neutron [req-688738fd-81bf-458c-aeec-6370c062880d req-c8fcb4ab-316b-4267-a243-37624577bb78 service nova] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Refreshing network info cache for port 0013f2c2-e337-4c3d-8885-ee027a53e8d8 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Start _get_guest_xml network_info=[{"id": "0013f2c2-e337-4c3d-8885-ee027a53e8d8", "address": "fa:16:3e:2f:30:8f", "network": {"id": "236ffb89-7d87-41de-8dac-e36bfb38a2d0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-187610999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9070144481d84c98bdc9063c54a9e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0013f2c2-e3", "ovs_interfaceid": "0013f2c2-e337-4c3d-8885-ee027a53e8d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:44:49 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:44:49 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:44:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1889405403',display_name='tempest-SnapshotDataIntegrityTests-server-1889405403',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1889405403',id=45,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZfnhv2hKs/TOeylBLMGyfZhHrnLmSE69uL3s2rYt1xM8hl3eenMxvcuMPgt+9CRciqY5uG6OpYVFS/TwHTAwXEQL2HkKTttYK56HMxoBQbjLbnzK5EuHvMCsKcign/sw==',key_name='tempest-keypair-861482726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9070144481d84c98bdc9063c54a9e5e0',ramdisk_id='',reservation_id='r-s3fcv0tt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1992304988',owner_user_name='tempest-SnapshotDataIntegrityTests-1992304988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:44:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c312f375da424b90b954abc2617ad026',uuid=8a97a6c4-8486-41be-b919-82ebf61771eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0013f2c2-e337-4c3d-8885-ee027a53e8d8", "address": "fa:16:3e:2f:30:8f", "network": {"id": "236ffb89-7d87-41de-8dac-e36bfb38a2d0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-187610999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9070144481d84c98bdc9063c54a9e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0013f2c2-e3", "ovs_interfaceid": "0013f2c2-e337-4c3d-8885-ee027a53e8d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Converting VIF {"id": "0013f2c2-e337-4c3d-8885-ee027a53e8d8", "address": "fa:16:3e:2f:30:8f", "network": {"id": "236ffb89-7d87-41de-8dac-e36bfb38a2d0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-187610999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9070144481d84c98bdc9063c54a9e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0013f2c2-e3", "ovs_interfaceid": "0013f2c2-e337-4c3d-8885-ee027a53e8d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:30:8f,bridge_name='br-int',has_traffic_filtering=True,id=0013f2c2-e337-4c3d-8885-ee027a53e8d8,network=Network(236ffb89-7d87-41de-8dac-e36bfb38a2d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0013f2c2-e3') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:44:49 user nova-compute[75080]: DEBUG nova.objects.instance [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a97a6c4-8486-41be-b919-82ebf61771eb {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:44:50 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:44:50 user nova-compute[75080]:   <uuid>8a97a6c4-8486-41be-b919-82ebf61771eb</uuid>
Dec 05 15:44:50 user nova-compute[75080]:   <name>instance-0000002d</name>
Dec 05 15:44:50 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:44:50 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:44:50 user nova-compute[75080]:   <metadata>
Dec 05 15:44:50 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:44:50 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:44:50 user nova-compute[75080]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1889405403</nova:name>
Dec 05 15:44:50 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:44:49</nova:creationTime>
Dec 05 15:44:50 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:44:50 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:44:50 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:44:50 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:44:50 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:44:50 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:44:50 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:44:50 user nova-compute[75080]:       <nova:owner>
Dec 05 15:44:50 user nova-compute[75080]:         <nova:user uuid="c312f375da424b90b954abc2617ad026">tempest-SnapshotDataIntegrityTests-1992304988-project-member</nova:user>
Dec 05 15:44:50 user nova-compute[75080]:         <nova:project uuid="9070144481d84c98bdc9063c54a9e5e0">tempest-SnapshotDataIntegrityTests-1992304988</nova:project>
Dec 05 15:44:50 user nova-compute[75080]:       </nova:owner>
Dec 05 15:44:50 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:44:50 user nova-compute[75080]:       <nova:ports>
Dec 05 15:44:50 user nova-compute[75080]:         <nova:port uuid="0013f2c2-e337-4c3d-8885-ee027a53e8d8">
Dec 05 15:44:50 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 05 15:44:50 user nova-compute[75080]:         </nova:port>
Dec 05 15:44:50 user nova-compute[75080]:       </nova:ports>
Dec 05 15:44:50 user nova-compute[75080]:     </nova:instance>
Dec 05 15:44:50 user nova-compute[75080]:   </metadata>
Dec 05 15:44:50 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:44:50 user nova-compute[75080]:     <system>
Dec 05 15:44:50 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:44:50 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:44:50 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:44:50 user nova-compute[75080]:       <entry name="serial">8a97a6c4-8486-41be-b919-82ebf61771eb</entry>
Dec 05 15:44:50 user nova-compute[75080]:       <entry name="uuid">8a97a6c4-8486-41be-b919-82ebf61771eb</entry>
Dec 05 15:44:50 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:44:50 user nova-compute[75080]:     </system>
Dec 05 15:44:50 user nova-compute[75080]:   </sysinfo>
Dec 05 15:44:50 user nova-compute[75080]:   <os>
Dec 05 15:44:50 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:44:50 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:44:50 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:44:50 user nova-compute[75080]:   </os>
Dec 05 15:44:50 user nova-compute[75080]:   <features>
Dec 05 15:44:50 user nova-compute[75080]:     <acpi/>
Dec 05 15:44:50 user nova-compute[75080]:     <apic/>
Dec 05 15:44:50 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:44:50 user nova-compute[75080]:   </features>
Dec 05 15:44:50 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:44:50 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:44:50 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:44:50 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:44:50 user nova-compute[75080]:   </clock>
Dec 05 15:44:50 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:44:50 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:44:50 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:44:50 user nova-compute[75080]:   </cpu>
Dec 05 15:44:50 user nova-compute[75080]:   <devices>
Dec 05 15:44:50 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:44:50 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:44:50 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk"/>
Dec 05 15:44:50 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:44:50 user nova-compute[75080]:     </disk>
Dec 05 15:44:50 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:44:50 user nova-compute[75080]:       <mac address="fa:16:3e:2f:30:8f"/>
Dec 05 15:44:50 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:44:50 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:44:50 user nova-compute[75080]:       <target dev="tap0013f2c2-e3"/>
Dec 05 15:44:50 user nova-compute[75080]:     </interface>
Dec 05 15:44:50 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:44:50 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/console.log" append="off"/>
Dec 05 15:44:50 user nova-compute[75080]:     </serial>
Dec 05 15:44:50 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:44:50 user nova-compute[75080]:     <video>
Dec 05 15:44:50 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:44:50 user nova-compute[75080]:     </video>
Dec 05 15:44:50 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:44:50 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:44:50 user nova-compute[75080]:     </rng>
Dec 05 15:44:50 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:44:50 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:44:50 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:44:50 user nova-compute[75080]:     </memballoon>
Dec 05 15:44:50 user nova-compute[75080]:   </devices>
Dec 05 15:44:50 user nova-compute[75080]: </domain>
Dec 05 15:44:50 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:44:50 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1889405403',display_name='tempest-SnapshotDataIntegrityTests-server-1889405403',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1889405403',id=45,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZfnhv2hKs/TOeylBLMGyfZhHrnLmSE69uL3s2rYt1xM8hl3eenMxvcuMPgt+9CRciqY5uG6OpYVFS/TwHTAwXEQL2HkKTttYK56HMxoBQbjLbnzK5EuHvMCsKcign/sw==',key_name='tempest-keypair-861482726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9070144481d84c98bdc9063c54a9e5e0',ramdisk_id='',reservation_id='r-s3fcv0tt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1992304988',owner_user_name='tempest-SnapshotDataIntegrityTests-1992304988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:44:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c312f375da424b90b954abc2617ad026',uuid=8a97a6c4-8486-41be-b919-82ebf61771eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0013f2c2-e337-4c3d-8885-ee027a53e8d8", "address": "fa:16:3e:2f:30:8f", "network": {"id": "236ffb89-7d87-41de-8dac-e36bfb38a2d0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-187610999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9070144481d84c98bdc9063c54a9e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0013f2c2-e3", "ovs_interfaceid": "0013f2c2-e337-4c3d-8885-ee027a53e8d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:44:50 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Converting VIF {"id": "0013f2c2-e337-4c3d-8885-ee027a53e8d8", "address": "fa:16:3e:2f:30:8f", "network": {"id": "236ffb89-7d87-41de-8dac-e36bfb38a2d0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-187610999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9070144481d84c98bdc9063c54a9e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0013f2c2-e3", "ovs_interfaceid": "0013f2c2-e337-4c3d-8885-ee027a53e8d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:44:50 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:30:8f,bridge_name='br-int',has_traffic_filtering=True,id=0013f2c2-e337-4c3d-8885-ee027a53e8d8,network=Network(236ffb89-7d87-41de-8dac-e36bfb38a2d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0013f2c2-e3') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:44:50 user nova-compute[75080]: DEBUG os_vif [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:30:8f,bridge_name='br-int',has_traffic_filtering=True,id=0013f2c2-e337-4c3d-8885-ee027a53e8d8,network=Network(236ffb89-7d87-41de-8dac-e36bfb38a2d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0013f2c2-e3') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:44:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:44:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:44:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cdf11cde-bab7-5193-a47e-72248932dd4e', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:44:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:44:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0013f2c2-e3, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:44:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0013f2c2-e3, col_values=(('qos', UUID('052fc22c-865c-40db-91a9-1174dd4acba3')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:44:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0013f2c2-e3, col_values=(('external_ids', {'iface-id': '0013f2c2-e337-4c3d-8885-ee027a53e8d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:30:8f', 'vm-uuid': '8a97a6c4-8486-41be-b919-82ebf61771eb'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:44:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:44:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:50 user nova-compute[75080]: INFO os_vif [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:30:8f,bridge_name='br-int',has_traffic_filtering=True,id=0013f2c2-e337-4c3d-8885-ee027a53e8d8,network=Network(236ffb89-7d87-41de-8dac-e36bfb38a2d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0013f2c2-e3')
Dec 05 15:44:50 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:44:50 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] No VIF found with MAC fa:16:3e:2f:30:8f, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:44:50 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:44:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:44:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:44:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:44:50 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:44:50 user nova-compute[75080]: DEBUG nova.network.neutron [req-688738fd-81bf-458c-aeec-6370c062880d req-c8fcb4ab-316b-4267-a243-37624577bb78 service nova] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Updated VIF entry in instance network info cache for port 0013f2c2-e337-4c3d-8885-ee027a53e8d8. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:44:50 user nova-compute[75080]: DEBUG nova.network.neutron [req-688738fd-81bf-458c-aeec-6370c062880d req-c8fcb4ab-316b-4267-a243-37624577bb78 service nova] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Updating instance_info_cache with network_info: [{"id": "0013f2c2-e337-4c3d-8885-ee027a53e8d8", "address": "fa:16:3e:2f:30:8f", "network": {"id": "236ffb89-7d87-41de-8dac-e36bfb38a2d0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-187610999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9070144481d84c98bdc9063c54a9e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0013f2c2-e3", "ovs_interfaceid": "0013f2c2-e337-4c3d-8885-ee027a53e8d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:44:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-688738fd-81bf-458c-aeec-6370c062880d req-c8fcb4ab-316b-4267-a243-37624577bb78 service nova] Releasing lock "refresh_cache-8a97a6c4-8486-41be-b919-82ebf61771eb" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:44:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-0d2332d1-8a00-4db7-98ea-221f9c0a9362 req-def77e63-0796-4089-98bb-aa6ed2a2d272 service nova] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Received event network-vif-plugged-0013f2c2-e337-4c3d-8885-ee027a53e8d8 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:44:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0d2332d1-8a00-4db7-98ea-221f9c0a9362 req-def77e63-0796-4089-98bb-aa6ed2a2d272 service nova] Acquiring lock "8a97a6c4-8486-41be-b919-82ebf61771eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:44:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0d2332d1-8a00-4db7-98ea-221f9c0a9362 req-def77e63-0796-4089-98bb-aa6ed2a2d272 service nova] Lock "8a97a6c4-8486-41be-b919-82ebf61771eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:44:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0d2332d1-8a00-4db7-98ea-221f9c0a9362 req-def77e63-0796-4089-98bb-aa6ed2a2d272 service nova] Lock "8a97a6c4-8486-41be-b919-82ebf61771eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:44:51 user nova-compute[75080]: DEBUG nova.compute.manager [req-0d2332d1-8a00-4db7-98ea-221f9c0a9362 req-def77e63-0796-4089-98bb-aa6ed2a2d272 service nova] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] No waiting events found dispatching network-vif-plugged-0013f2c2-e337-4c3d-8885-ee027a53e8d8 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:44:51 user nova-compute[75080]: WARNING nova.compute.manager [req-0d2332d1-8a00-4db7-98ea-221f9c0a9362 req-def77e63-0796-4089-98bb-aa6ed2a2d272 service nova] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Received unexpected event network-vif-plugged-0013f2c2-e337-4c3d-8885-ee027a53e8d8 for instance with vm_state building and task_state spawning.
Dec 05 15:44:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:44:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:44:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:44:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:44:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:44:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:44:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:44:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:44:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:44:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:44:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:44:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:44:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc66525f-8802-426d-872f-5b567e05b316/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:44:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc66525f-8802-426d-872f-5b567e05b316/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:44:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc66525f-8802-426d-872f-5b567e05b316/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:44:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc66525f-8802-426d-872f-5b567e05b316/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:44:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:44:53 user nova-compute[75080]: DEBUG nova.compute.manager [req-849d5e58-a6de-4c05-b16f-14d8d3e0bc79 req-c868ce45-a8eb-472d-a21e-1fe9e67f0a13 service nova] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Received event network-vif-plugged-0013f2c2-e337-4c3d-8885-ee027a53e8d8 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:44:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-849d5e58-a6de-4c05-b16f-14d8d3e0bc79 req-c868ce45-a8eb-472d-a21e-1fe9e67f0a13 service nova] Acquiring lock "8a97a6c4-8486-41be-b919-82ebf61771eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:44:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-849d5e58-a6de-4c05-b16f-14d8d3e0bc79 req-c868ce45-a8eb-472d-a21e-1fe9e67f0a13 service nova] Lock "8a97a6c4-8486-41be-b919-82ebf61771eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:44:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-849d5e58-a6de-4c05-b16f-14d8d3e0bc79 req-c868ce45-a8eb-472d-a21e-1fe9e67f0a13 service nova] Lock "8a97a6c4-8486-41be-b919-82ebf61771eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:44:53 user nova-compute[75080]: DEBUG nova.compute.manager [req-849d5e58-a6de-4c05-b16f-14d8d3e0bc79 req-c868ce45-a8eb-472d-a21e-1fe9e67f0a13 service nova] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] No waiting events found dispatching network-vif-plugged-0013f2c2-e337-4c3d-8885-ee027a53e8d8 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:44:53 user nova-compute[75080]: WARNING nova.compute.manager [req-849d5e58-a6de-4c05-b16f-14d8d3e0bc79 req-c868ce45-a8eb-472d-a21e-1fe9e67f0a13 service nova] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Received unexpected event network-vif-plugged-0013f2c2-e337-4c3d-8885-ee027a53e8d8 for instance with vm_state building and task_state spawning.
Dec 05 15:44:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:44:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:44:53 user nova-compute[75080]: DEBUG nova.compute.manager [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:44:53 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:44:53 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Instance spawned successfully.
Dec 05 15:44:53 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:44:53 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:44:53 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:44:53 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:44:53 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:44:54 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:44:54 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:44:54 user nova-compute[75080]: INFO nova.compute.manager [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Took 5.76 seconds to spawn the instance on the hypervisor.
Dec 05 15:44:54 user nova-compute[75080]: DEBUG nova.compute.manager [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:44:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:44:54 user nova-compute[75080]: INFO nova.compute.manager [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Took 7.28 seconds to build instance.
Dec 05 15:44:54 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:44:54 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:44:54 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=8617MB free_disk=24.949604034423828GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:44:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:44:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:44:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-24527b6c-392b-461c-a56d-903fbe23cc2a tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "8a97a6c4-8486-41be-b919-82ebf61771eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.405s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:44:54 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance bc66525f-8802-426d-872f-5b567e05b316 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:44:54 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance db0fde77-eb40-4acb-93f7-66b5b76c8eea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:44:54 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 8608d2cf-476d-43b8-a124-c44507459a1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:44:54 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 8a97a6c4-8486-41be-b919-82ebf61771eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:44:54 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:44:54 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:44:54 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:44:54 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:44:54 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:44:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.332s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:44:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:55 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:44:55 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:44:55 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Rebuilding the list of instances to heal {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 15:44:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-bc66525f-8802-426d-872f-5b567e05b316" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:44:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-bc66525f-8802-426d-872f-5b567e05b316" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:44:55 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: bc66525f-8802-426d-872f-5b567e05b316] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 15:44:55 user nova-compute[75080]: DEBUG nova.objects.instance [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lazy-loading 'info_cache' on Instance uuid bc66525f-8802-426d-872f-5b567e05b316 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:44:56 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: bc66525f-8802-426d-872f-5b567e05b316] Updating instance_info_cache with network_info: [{"id": "f5ab390a-fbf1-4384-80a6-95420f8868f9", "address": "fa:16:3e:3f:f5:32", "network": {"id": "1151f7c9-f853-4f06-93d7-74536b8b12ac", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420489370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549e67b7f2574eb38f3395452b647de7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ab390a-fb", "ovs_interfaceid": "f5ab390a-fbf1-4384-80a6-95420f8868f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:44:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-bc66525f-8802-426d-872f-5b567e05b316" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:44:56 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: bc66525f-8802-426d-872f-5b567e05b316] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 15:44:56 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:44:56 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:44:56 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:44:56 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:44:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:44:58 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:44:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'clINmPvp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:44:58 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:44:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:44:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:44:58 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:44:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:44:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:44:58 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:44:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:44:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:44:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[27651205-cbc5-4060-ae11-958bad467629]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:44:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:44:58 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:44:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:44:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:44:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c09b3b-0571-4b11-82d5-b83e6926089c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:44:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b] added
Dec 05 15:44:58 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:44:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:44:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:44:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2c49aa-a5de-4127-a602-60e211bffbd9]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:44:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:44:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:44:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:44:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f634169-e8df-451e-87b2-c0edd0c15f06]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:44:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:44:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v clINmPvp {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:44:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v clINmPvp" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:44:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ce9286-8a48-4abc-b6ff-b0567179fc5f]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:44:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'clINmPvp'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:44:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:44:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:44:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[86617417-4bc7-49e9-8592-513c08a93559]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:44:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:44:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:44:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:44:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91fdfd5-bca3-47a8-9ad6-7ba7795e29a0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:44:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 05 15:44:58 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:44:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 05 15:44:58 user nova-compute[75080]:  {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:44:58 user nova-compute[75080]: WARNING os_brick.initiator.connectors.iscsi [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 05 15:44:58 user nova-compute[75080]: 
Dec 05 15:44:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:44:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:44:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a330e90-9730-4fd1-82a6-bb96294396ab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:44:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b, portal: 172.16.0.220,3260]
Dec 05 15:44:58 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b, portal: 172.16.0.220,3260] successful.
Dec 05 15:44:58 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:44:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:44:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:44:59 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7309827-ee96-45c3-8968-ef8c957cee0c]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:44:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:44:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:44:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:44:59 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b22975-9700-42db-8151-4e18e698edf1]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:44:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b (non-flash)
Dec 05 15:44:59 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:44:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b (non-flash)
Dec 05 15:44:59 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:44:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:44:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:44:59 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:44:59 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:44:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:44:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:44:59 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3672f945-fd78-42c3-8e1e-e54449668760]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:44:59 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:44:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'clINmPvp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:45:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:45:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:45:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23037663539343434', 'path': '/dev/sdb'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:45:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037663539343434', 'path': '/dev/sdb'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:45:00 user nova-compute[75080]: DEBUG nova.objects.instance [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lazy-loading 'flavor' on Instance uuid bc66525f-8802-426d-872f-5b567e05b316 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:45:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 15:45:00 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:45:00 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 15:45:00 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:45:00 user nova-compute[75080]:   <serial>d33d6554-072a-49bc-9211-feaf5c29f91b</serial>
Dec 05 15:45:00 user nova-compute[75080]: </disk>
Dec 05 15:45:00 user nova-compute[75080]:  {{(pid=75080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 15:45:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:45:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:45:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] No VIF found with MAC fa:16:3e:3f:f5:32, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:45:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-40a0c4df-24c8-4d4e-9c5c-32b6e6aa6008 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "bc66525f-8802-426d-872f-5b567e05b316" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.444s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:45:03 user nova-compute[75080]: DEBUG nova.compute.manager [req-58f4720e-758a-4a7c-a7dd-baf97b9da6c5 req-fbd4e786-9664-4d81-b8fb-c7824ec37232 service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Received event network-changed-f5ab390a-fbf1-4384-80a6-95420f8868f9 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:45:03 user nova-compute[75080]: DEBUG nova.compute.manager [req-58f4720e-758a-4a7c-a7dd-baf97b9da6c5 req-fbd4e786-9664-4d81-b8fb-c7824ec37232 service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Refreshing instance network info cache due to event network-changed-f5ab390a-fbf1-4384-80a6-95420f8868f9. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:45:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-58f4720e-758a-4a7c-a7dd-baf97b9da6c5 req-fbd4e786-9664-4d81-b8fb-c7824ec37232 service nova] Acquiring lock "refresh_cache-bc66525f-8802-426d-872f-5b567e05b316" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:45:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-58f4720e-758a-4a7c-a7dd-baf97b9da6c5 req-fbd4e786-9664-4d81-b8fb-c7824ec37232 service nova] Acquired lock "refresh_cache-bc66525f-8802-426d-872f-5b567e05b316" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:45:03 user nova-compute[75080]: DEBUG nova.network.neutron [req-58f4720e-758a-4a7c-a7dd-baf97b9da6c5 req-fbd4e786-9664-4d81-b8fb-c7824ec37232 service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Refreshing network info cache for port f5ab390a-fbf1-4384-80a6-95420f8868f9 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:45:03 user nova-compute[75080]: DEBUG nova.network.neutron [req-58f4720e-758a-4a7c-a7dd-baf97b9da6c5 req-fbd4e786-9664-4d81-b8fb-c7824ec37232 service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Updated VIF entry in instance network info cache for port f5ab390a-fbf1-4384-80a6-95420f8868f9. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:45:03 user nova-compute[75080]: DEBUG nova.network.neutron [req-58f4720e-758a-4a7c-a7dd-baf97b9da6c5 req-fbd4e786-9664-4d81-b8fb-c7824ec37232 service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Updating instance_info_cache with network_info: [{"id": "f5ab390a-fbf1-4384-80a6-95420f8868f9", "address": "fa:16:3e:3f:f5:32", "network": {"id": "1151f7c9-f853-4f06-93d7-74536b8b12ac", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420489370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549e67b7f2574eb38f3395452b647de7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ab390a-fb", "ovs_interfaceid": "f5ab390a-fbf1-4384-80a6-95420f8868f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:45:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-58f4720e-758a-4a7c-a7dd-baf97b9da6c5 req-fbd4e786-9664-4d81-b8fb-c7824ec37232 service nova] Releasing lock "refresh_cache-bc66525f-8802-426d-872f-5b567e05b316" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:45:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:45:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:45:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 15:45:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:45:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:45:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:45:06 user nova-compute[75080]: DEBUG nova.compute.manager [req-4cdeacf3-4070-4aaf-b746-309c931dd6b3 req-a7b37ab7-ccaf-4360-aaca-49a9ac7356bb service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Received event network-changed-f5ab390a-fbf1-4384-80a6-95420f8868f9 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:45:06 user nova-compute[75080]: DEBUG nova.compute.manager [req-4cdeacf3-4070-4aaf-b746-309c931dd6b3 req-a7b37ab7-ccaf-4360-aaca-49a9ac7356bb service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Refreshing instance network info cache due to event network-changed-f5ab390a-fbf1-4384-80a6-95420f8868f9. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:45:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4cdeacf3-4070-4aaf-b746-309c931dd6b3 req-a7b37ab7-ccaf-4360-aaca-49a9ac7356bb service nova] Acquiring lock "refresh_cache-bc66525f-8802-426d-872f-5b567e05b316" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:45:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4cdeacf3-4070-4aaf-b746-309c931dd6b3 req-a7b37ab7-ccaf-4360-aaca-49a9ac7356bb service nova] Acquired lock "refresh_cache-bc66525f-8802-426d-872f-5b567e05b316" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:45:06 user nova-compute[75080]: DEBUG nova.network.neutron [req-4cdeacf3-4070-4aaf-b746-309c931dd6b3 req-a7b37ab7-ccaf-4360-aaca-49a9ac7356bb service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Refreshing network info cache for port f5ab390a-fbf1-4384-80a6-95420f8868f9 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:45:07 user nova-compute[75080]: DEBUG nova.network.neutron [req-4cdeacf3-4070-4aaf-b746-309c931dd6b3 req-a7b37ab7-ccaf-4360-aaca-49a9ac7356bb service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Updated VIF entry in instance network info cache for port f5ab390a-fbf1-4384-80a6-95420f8868f9. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:45:07 user nova-compute[75080]: DEBUG nova.network.neutron [req-4cdeacf3-4070-4aaf-b746-309c931dd6b3 req-a7b37ab7-ccaf-4360-aaca-49a9ac7356bb service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Updating instance_info_cache with network_info: [{"id": "f5ab390a-fbf1-4384-80a6-95420f8868f9", "address": "fa:16:3e:3f:f5:32", "network": {"id": "1151f7c9-f853-4f06-93d7-74536b8b12ac", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420489370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549e67b7f2574eb38f3395452b647de7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ab390a-fb", "ovs_interfaceid": "f5ab390a-fbf1-4384-80a6-95420f8868f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:45:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4cdeacf3-4070-4aaf-b746-309c931dd6b3 req-a7b37ab7-ccaf-4360-aaca-49a9ac7356bb service nova] Releasing lock "refresh_cache-bc66525f-8802-426d-872f-5b567e05b316" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:45:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-751510bc-b4a8-4130-96ce-812b30d529ef tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquiring lock "bc66525f-8802-426d-872f-5b567e05b316" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:45:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-751510bc-b4a8-4130-96ce-812b30d529ef tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "bc66525f-8802-426d-872f-5b567e05b316" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:45:07 user nova-compute[75080]: INFO nova.compute.manager [None req-751510bc-b4a8-4130-96ce-812b30d529ef tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Rebooting instance
Dec 05 15:45:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-751510bc-b4a8-4130-96ce-812b30d529ef tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquiring lock "refresh_cache-bc66525f-8802-426d-872f-5b567e05b316" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:45:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-751510bc-b4a8-4130-96ce-812b30d529ef tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquired lock "refresh_cache-bc66525f-8802-426d-872f-5b567e05b316" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:45:07 user nova-compute[75080]: DEBUG nova.network.neutron [None req-751510bc-b4a8-4130-96ce-812b30d529ef tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:45:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:45:08 user nova-compute[75080]: DEBUG nova.network.neutron [None req-751510bc-b4a8-4130-96ce-812b30d529ef tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Updating instance_info_cache with network_info: [{"id": "f5ab390a-fbf1-4384-80a6-95420f8868f9", "address": "fa:16:3e:3f:f5:32", "network": {"id": "1151f7c9-f853-4f06-93d7-74536b8b12ac", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420489370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549e67b7f2574eb38f3395452b647de7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ab390a-fb", "ovs_interfaceid": "f5ab390a-fbf1-4384-80a6-95420f8868f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:45:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-751510bc-b4a8-4130-96ce-812b30d529ef tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Releasing lock "refresh_cache-bc66525f-8802-426d-872f-5b567e05b316" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:45:08 user nova-compute[75080]: DEBUG nova.compute.manager [None req-751510bc-b4a8-4130-96ce-812b30d529ef tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:45:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:45:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:45:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:45:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:45:10 user nova-compute[75080]: DEBUG nova.compute.manager [req-6b394852-f169-4b98-a1fc-519ee728499b req-ad6b7321-f029-40c9-aad5-d3e8f0f39568 service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Received event network-vif-unplugged-f5ab390a-fbf1-4384-80a6-95420f8868f9 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:45:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-6b394852-f169-4b98-a1fc-519ee728499b req-ad6b7321-f029-40c9-aad5-d3e8f0f39568 service nova] Acquiring lock "bc66525f-8802-426d-872f-5b567e05b316-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:45:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-6b394852-f169-4b98-a1fc-519ee728499b req-ad6b7321-f029-40c9-aad5-d3e8f0f39568 service nova] Lock "bc66525f-8802-426d-872f-5b567e05b316-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:45:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-6b394852-f169-4b98-a1fc-519ee728499b req-ad6b7321-f029-40c9-aad5-d3e8f0f39568 service nova] Lock "bc66525f-8802-426d-872f-5b567e05b316-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:45:10 user nova-compute[75080]: DEBUG nova.compute.manager [req-6b394852-f169-4b98-a1fc-519ee728499b req-ad6b7321-f029-40c9-aad5-d3e8f0f39568 service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] No waiting events found dispatching network-vif-unplugged-f5ab390a-fbf1-4384-80a6-95420f8868f9 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:45:10 user nova-compute[75080]: WARNING nova.compute.manager [req-6b394852-f169-4b98-a1fc-519ee728499b req-ad6b7321-f029-40c9-aad5-d3e8f0f39568 service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Received unexpected event network-vif-unplugged-f5ab390a-fbf1-4384-80a6-95420f8868f9 for instance with vm_state active and task_state reboot_started.
Dec 05 15:45:11 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-751510bc-b4a8-4130-96ce-812b30d529ef tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Instance shutdown successfully.
Dec 05 15:45:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:45:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:45:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:45:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:45:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:45:12 user nova-compute[75080]: DEBUG nova.compute.manager [req-779cede8-2f01-436a-ae8e-b4c49798d9ba req-3e6ddafa-c9ee-45b4-b6ec-04e6d94c2ee9 service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Received event network-vif-plugged-f5ab390a-fbf1-4384-80a6-95420f8868f9 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:45:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-779cede8-2f01-436a-ae8e-b4c49798d9ba req-3e6ddafa-c9ee-45b4-b6ec-04e6d94c2ee9 service nova] Acquiring lock "bc66525f-8802-426d-872f-5b567e05b316-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:45:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-779cede8-2f01-436a-ae8e-b4c49798d9ba req-3e6ddafa-c9ee-45b4-b6ec-04e6d94c2ee9 service nova] Lock "bc66525f-8802-426d-872f-5b567e05b316-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:45:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-779cede8-2f01-436a-ae8e-b4c49798d9ba req-3e6ddafa-c9ee-45b4-b6ec-04e6d94c2ee9 service nova] Lock "bc66525f-8802-426d-872f-5b567e05b316-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:45:12 user nova-compute[75080]: DEBUG nova.compute.manager [req-779cede8-2f01-436a-ae8e-b4c49798d9ba req-3e6ddafa-c9ee-45b4-b6ec-04e6d94c2ee9 service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] No waiting events found dispatching network-vif-plugged-f5ab390a-fbf1-4384-80a6-95420f8868f9 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:45:12 user nova-compute[75080]: WARNING nova.compute.manager [req-779cede8-2f01-436a-ae8e-b4c49798d9ba req-3e6ddafa-c9ee-45b4-b6ec-04e6d94c2ee9 service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Received unexpected event network-vif-plugged-f5ab390a-fbf1-4384-80a6-95420f8868f9 for instance with vm_state active and task_state reboot_started.
Dec 05 15:45:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:45:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:45:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:45:14 user nova-compute[75080]: DEBUG nova.compute.manager [req-cd6d05fd-6045-4768-8f2f-3a7b8d416ccc req-0869964c-f820-469a-92c5-e1a60e726fb9 service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Received event network-vif-plugged-f5ab390a-fbf1-4384-80a6-95420f8868f9 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:45:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-cd6d05fd-6045-4768-8f2f-3a7b8d416ccc req-0869964c-f820-469a-92c5-e1a60e726fb9 service nova] Acquiring lock "bc66525f-8802-426d-872f-5b567e05b316-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:45:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-cd6d05fd-6045-4768-8f2f-3a7b8d416ccc req-0869964c-f820-469a-92c5-e1a60e726fb9 service nova] Lock "bc66525f-8802-426d-872f-5b567e05b316-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:45:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-cd6d05fd-6045-4768-8f2f-3a7b8d416ccc req-0869964c-f820-469a-92c5-e1a60e726fb9 service nova] Lock "bc66525f-8802-426d-872f-5b567e05b316-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:45:14 user nova-compute[75080]: DEBUG nova.compute.manager [req-cd6d05fd-6045-4768-8f2f-3a7b8d416ccc req-0869964c-f820-469a-92c5-e1a60e726fb9 service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] No waiting events found dispatching network-vif-plugged-f5ab390a-fbf1-4384-80a6-95420f8868f9 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:45:14 user nova-compute[75080]: WARNING nova.compute.manager [req-cd6d05fd-6045-4768-8f2f-3a7b8d416ccc req-0869964c-f820-469a-92c5-e1a60e726fb9 service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Received unexpected event network-vif-plugged-f5ab390a-fbf1-4384-80a6-95420f8868f9 for instance with vm_state active and task_state reboot_started.
Dec 05 15:45:14 user nova-compute[75080]: DEBUG nova.compute.manager [req-cd6d05fd-6045-4768-8f2f-3a7b8d416ccc req-0869964c-f820-469a-92c5-e1a60e726fb9 service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Received event network-vif-plugged-f5ab390a-fbf1-4384-80a6-95420f8868f9 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:45:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-cd6d05fd-6045-4768-8f2f-3a7b8d416ccc req-0869964c-f820-469a-92c5-e1a60e726fb9 service nova] Acquiring lock "bc66525f-8802-426d-872f-5b567e05b316-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:45:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-cd6d05fd-6045-4768-8f2f-3a7b8d416ccc req-0869964c-f820-469a-92c5-e1a60e726fb9 service nova] Lock "bc66525f-8802-426d-872f-5b567e05b316-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:45:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-cd6d05fd-6045-4768-8f2f-3a7b8d416ccc req-0869964c-f820-469a-92c5-e1a60e726fb9 service nova] Lock "bc66525f-8802-426d-872f-5b567e05b316-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:45:14 user nova-compute[75080]: DEBUG nova.compute.manager [req-cd6d05fd-6045-4768-8f2f-3a7b8d416ccc req-0869964c-f820-469a-92c5-e1a60e726fb9 service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] No waiting events found dispatching network-vif-plugged-f5ab390a-fbf1-4384-80a6-95420f8868f9 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:45:14 user nova-compute[75080]: WARNING nova.compute.manager [req-cd6d05fd-6045-4768-8f2f-3a7b8d416ccc req-0869964c-f820-469a-92c5-e1a60e726fb9 service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Received unexpected event network-vif-plugged-f5ab390a-fbf1-4384-80a6-95420f8868f9 for instance with vm_state active and task_state reboot_started.
Dec 05 15:45:14 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: bc66525f-8802-426d-872f-5b567e05b316] Instance running successfully.
Dec 05 15:45:14 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-751510bc-b4a8-4130-96ce-812b30d529ef tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Instance soft rebooted successfully.
Dec 05 15:45:14 user nova-compute[75080]: DEBUG nova.compute.manager [None req-751510bc-b4a8-4130-96ce-812b30d529ef tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:45:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-751510bc-b4a8-4130-96ce-812b30d529ef tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "bc66525f-8802-426d-872f-5b567e05b316" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.429s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:45:15 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:45:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:45:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:45:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:45:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:45:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:45:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:45:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 15:45:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:45:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:45:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:45:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:45:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:45:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:45:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:45:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:45:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:45:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:45:45 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:45:45 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:45:45 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:45:47 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:45:47 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:45:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:45:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:45:51 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:45:51 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:45:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:45:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:45:51 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:45:51 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:45:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:45:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:45:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:45:51 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:45:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:45:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:45:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:45:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json" returned: 0 in 0.225s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:45:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:45:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:45:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:45:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:45:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc66525f-8802-426d-872f-5b567e05b316/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:45:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc66525f-8802-426d-872f-5b567e05b316/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:45:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc66525f-8802-426d-872f-5b567e05b316/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:45:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc66525f-8802-426d-872f-5b567e05b316/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:45:53 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:45:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:45:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:45:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:45:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:45:54 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:45:54 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:45:54 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=8448MB free_disk=24.907894134521484GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:45:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:45:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:45:54 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance bc66525f-8802-426d-872f-5b567e05b316 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:45:54 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance db0fde77-eb40-4acb-93f7-66b5b76c8eea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:45:54 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 8608d2cf-476d-43b8-a124-c44507459a1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:45:54 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 8a97a6c4-8486-41be-b919-82ebf61771eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:45:54 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:45:54 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:45:54 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:45:54 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:45:54 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:45:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.275s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:45:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:45:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:45:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 15:45:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:45:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:45:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:45:56 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:45:56 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:45:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-db0fde77-eb40-4acb-93f7-66b5b76c8eea" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:45:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-db0fde77-eb40-4acb-93f7-66b5b76c8eea" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:45:56 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 15:45:56 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Updating instance_info_cache with network_info: [{"id": "09233cd3-602f-4eb8-a74c-7d592a1a3906", "address": "fa:16:3e:44:84:7c", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09233cd3-60", "ovs_interfaceid": "09233cd3-602f-4eb8-a74c-7d592a1a3906", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:45:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-db0fde77-eb40-4acb-93f7-66b5b76c8eea" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:45:57 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 15:45:57 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:45:57 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:45:57 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:45:59 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:46:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:46:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:46:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:46:15 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:46:15 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:46:15 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 15:46:15 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:46:15 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:46:15 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:46:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:46:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:46:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:46:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:46:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:46:38 user nova-compute[75080]: DEBUG nova.compute.manager [req-ad216694-8c18-403b-871e-479c1a907fdf req-c215ad0a-ed1c-4349-b102-81d6d431bc19 service nova] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Received event network-changed-0013f2c2-e337-4c3d-8885-ee027a53e8d8 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:46:38 user nova-compute[75080]: DEBUG nova.compute.manager [req-ad216694-8c18-403b-871e-479c1a907fdf req-c215ad0a-ed1c-4349-b102-81d6d431bc19 service nova] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Refreshing instance network info cache due to event network-changed-0013f2c2-e337-4c3d-8885-ee027a53e8d8. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:46:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-ad216694-8c18-403b-871e-479c1a907fdf req-c215ad0a-ed1c-4349-b102-81d6d431bc19 service nova] Acquiring lock "refresh_cache-8a97a6c4-8486-41be-b919-82ebf61771eb" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:46:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-ad216694-8c18-403b-871e-479c1a907fdf req-c215ad0a-ed1c-4349-b102-81d6d431bc19 service nova] Acquired lock "refresh_cache-8a97a6c4-8486-41be-b919-82ebf61771eb" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:46:38 user nova-compute[75080]: DEBUG nova.network.neutron [req-ad216694-8c18-403b-871e-479c1a907fdf req-c215ad0a-ed1c-4349-b102-81d6d431bc19 service nova] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Refreshing network info cache for port 0013f2c2-e337-4c3d-8885-ee027a53e8d8 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:46:38 user nova-compute[75080]: DEBUG nova.network.neutron [req-ad216694-8c18-403b-871e-479c1a907fdf req-c215ad0a-ed1c-4349-b102-81d6d431bc19 service nova] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Updated VIF entry in instance network info cache for port 0013f2c2-e337-4c3d-8885-ee027a53e8d8. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:46:38 user nova-compute[75080]: DEBUG nova.network.neutron [req-ad216694-8c18-403b-871e-479c1a907fdf req-c215ad0a-ed1c-4349-b102-81d6d431bc19 service nova] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Updating instance_info_cache with network_info: [{"id": "0013f2c2-e337-4c3d-8885-ee027a53e8d8", "address": "fa:16:3e:2f:30:8f", "network": {"id": "236ffb89-7d87-41de-8dac-e36bfb38a2d0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-187610999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9070144481d84c98bdc9063c54a9e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0013f2c2-e3", "ovs_interfaceid": "0013f2c2-e337-4c3d-8885-ee027a53e8d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:46:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-ad216694-8c18-403b-871e-479c1a907fdf req-c215ad0a-ed1c-4349-b102-81d6d431bc19 service nova] Releasing lock "refresh_cache-8a97a6c4-8486-41be-b919-82ebf61771eb" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:46:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:46:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Acquiring lock "8a97a6c4-8486-41be-b919-82ebf61771eb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:46:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "8a97a6c4-8486-41be-b919-82ebf61771eb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:46:42 user nova-compute[75080]: DEBUG nova.objects.instance [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lazy-loading 'flavor' on Instance uuid 8a97a6c4-8486-41be-b919-82ebf61771eb {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:46:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "8a97a6c4-8486-41be-b919-82ebf61771eb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:46:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Acquiring lock "8a97a6c4-8486-41be-b919-82ebf61771eb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:46:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "8a97a6c4-8486-41be-b919-82ebf61771eb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:46:42 user nova-compute[75080]: INFO nova.compute.manager [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Attaching volume ffd34254-e3f1-4f64-b6dc-a22c63a7b479 to /dev/vdb
Dec 05 15:46:42 user nova-compute[75080]: DEBUG os_brick.utils [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:46:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:46:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:46:42 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8460f895-3e2a-42a0-b467-d2451407081b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:46:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:46:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:46:42 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc631782-94d9-412d-9aee-556d14628970]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:46:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:46:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:46:42 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a891baaa-cae2-4757-ba87-7633662c6c96]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:46:42 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b22a8f3-e7ac-4ead-9e06-c6c28eb81a53]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:46:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:46:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:46:42 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:46:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:46:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:46:42 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:46:42 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2eb9d08-a348-4da7-ae58-64dfa6d17043]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:46:42 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:46:42 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:46:42 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:46:42 user nova-compute[75080]: DEBUG os_brick.utils [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:46:42 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Updating existing volume attachment record: bf8f65b9-aa52-416c-9e3a-78413cee4abc {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:46:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:46:45 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:46:46 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:46:47 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:46:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:46:49 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:46:49 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:46:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:46:53 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:46:53 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:46:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:46:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:46:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:46:53 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:46:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:46:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:46:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:46:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:46:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:46:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:46:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:46:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:46:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:46:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:46:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:46:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:46:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc66525f-8802-426d-872f-5b567e05b316/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:46:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc66525f-8802-426d-872f-5b567e05b316/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:46:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc66525f-8802-426d-872f-5b567e05b316/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:46:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc66525f-8802-426d-872f-5b567e05b316/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:46:55 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:46:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:46:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:46:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:46:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:46:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:46:55 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:46:55 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:46:55 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=8560MB free_disk=24.897216796875GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:46:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:46:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:46:55 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance bc66525f-8802-426d-872f-5b567e05b316 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:46:55 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance db0fde77-eb40-4acb-93f7-66b5b76c8eea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:46:55 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 8608d2cf-476d-43b8-a124-c44507459a1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:46:55 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 8a97a6c4-8486-41be-b919-82ebf61771eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:46:55 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:46:55 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:46:56 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:46:56 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:46:56 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:46:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.274s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:46:57 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:46:57 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:46:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-8608d2cf-476d-43b8-a124-c44507459a1e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:46:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-8608d2cf-476d-43b8-a124-c44507459a1e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:46:57 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 15:46:57 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Updating instance_info_cache with network_info: [{"id": "9a4d35f3-f184-49ba-b94d-5fcdd955f572", "address": "fa:16:3e:22:37:f1", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a4d35f3-f1", "ovs_interfaceid": "9a4d35f3-f184-49ba-b94d-5fcdd955f572", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:46:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-8608d2cf-476d-43b8-a124-c44507459a1e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:46:57 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 15:46:57 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:46:57 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:46:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:46:58 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:46:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfIdzFJK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:46:58 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:46:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:46:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:46:58 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:46:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:46:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:46:58 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:46:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479 -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:46:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:46:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdad90df-765a-4e8b-afee-e1edf98eefcd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:46:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:46:58 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:46:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479 -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:46:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.047s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:46:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d865a7f-77ea-4397-b7a2-90ae5e316310]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:46:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479] added
Dec 05 15:46:58 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:46:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:46:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:46:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d543b760-b627-44c7-abb0-f987df3e70d8]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:46:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:46:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:46:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:46:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd8d14f-4c4b-4cde-8935-a4b9111061e8]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:46:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:46:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HfIdzFJK {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:46:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HfIdzFJK" returned: 0 in 0.036s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:46:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5230389-e227-4073-a173-128cf58e293a]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:46:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HfIdzFJK'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:46:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:46:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:46:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5739b1b9-f016-4cdb-a127-46a472b4f04a]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:46:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:46:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:46:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:46:58 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[293795b8-2c5b-4fe6-a27d-2497a44aba96]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0eff27f-180c-467d-83dd-d902fd3b62a2 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:46:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b (non-flash)
Dec 05 15:46:58 user nova-compute[75080]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0eff27f-180c-467d-83dd-d902fd3b62a2 (non-flash)
Dec 05 15:46:58 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:46:58 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b (non-flash)
Dec 05 15:46:58 user nova-compute[75080]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0eff27f-180c-467d-83dd-d902fd3b62a2 (non-flash)
Dec 05 15:46:58 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:46:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479 -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:46:59 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:46:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479 -p 172.16.0.220:3260 --login" returned: 0 in 1.070s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:46:59 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[351fe4d4-45ca-42c9-9d58-6aad807866a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:46:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479, portal: 172.16.0.220,3260]
Dec 05 15:46:59 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479, portal: 172.16.0.220,3260] successful.
Dec 05 15:46:59 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:46:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:46:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:46:59 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[97847557-b02b-41b3-a03b-30fcfa4aa9e6]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:46:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:46:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:46:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:46:59 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e644b97c-ce32-4cdf-a0cd-7474fbde667d]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0eff27f-180c-467d-83dd-d902fd3b62a2 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:46:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b (non-flash)
Dec 05 15:46:59 user nova-compute[75080]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0eff27f-180c-467d-83dd-d902fd3b62a2 (non-flash)
Dec 05 15:46:59 user nova-compute[75080]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479 (non-flash)
Dec 05 15:46:59 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:46:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b (non-flash)
Dec 05 15:46:59 user nova-compute[75080]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0eff27f-180c-467d-83dd-d902fd3b62a2 (non-flash)
Dec 05 15:46:59 user nova-compute[75080]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479 (non-flash)
Dec 05 15:46:59 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:46:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.338s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:46:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:46:59 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:46:59 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:46:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:46:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:46:59 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91baecb-0e7d-497f-a919-b2f614cbc79c]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:46:59 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:46:59 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfIdzFJK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:46:59 user nova-compute[75080]: DEBUG nova.compute.manager [req-c29eba95-51c5-4a4e-9a5a-1d7cb9969d55 req-0620b3f0-a6c9-457b-9f5e-d3296f11c6d1 service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Received event network-changed-f5ab390a-fbf1-4384-80a6-95420f8868f9 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:46:59 user nova-compute[75080]: DEBUG nova.compute.manager [req-c29eba95-51c5-4a4e-9a5a-1d7cb9969d55 req-0620b3f0-a6c9-457b-9f5e-d3296f11c6d1 service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Refreshing instance network info cache due to event network-changed-f5ab390a-fbf1-4384-80a6-95420f8868f9. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:46:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c29eba95-51c5-4a4e-9a5a-1d7cb9969d55 req-0620b3f0-a6c9-457b-9f5e-d3296f11c6d1 service nova] Acquiring lock "refresh_cache-bc66525f-8802-426d-872f-5b567e05b316" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:46:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c29eba95-51c5-4a4e-9a5a-1d7cb9969d55 req-0620b3f0-a6c9-457b-9f5e-d3296f11c6d1 service nova] Acquired lock "refresh_cache-bc66525f-8802-426d-872f-5b567e05b316" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:46:59 user nova-compute[75080]: DEBUG nova.network.neutron [req-c29eba95-51c5-4a4e-9a5a-1d7cb9969d55 req-0620b3f0-a6c9-457b-9f5e-d3296f11c6d1 service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Refreshing network info cache for port f5ab390a-fbf1-4384-80a6-95420f8868f9 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:47:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:00 user nova-compute[75080]: DEBUG nova.network.neutron [req-c29eba95-51c5-4a4e-9a5a-1d7cb9969d55 req-0620b3f0-a6c9-457b-9f5e-d3296f11c6d1 service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Updated VIF entry in instance network info cache for port f5ab390a-fbf1-4384-80a6-95420f8868f9. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:47:00 user nova-compute[75080]: DEBUG nova.network.neutron [req-c29eba95-51c5-4a4e-9a5a-1d7cb9969d55 req-0620b3f0-a6c9-457b-9f5e-d3296f11c6d1 service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Updating instance_info_cache with network_info: [{"id": "f5ab390a-fbf1-4384-80a6-95420f8868f9", "address": "fa:16:3e:3f:f5:32", "network": {"id": "1151f7c9-f853-4f06-93d7-74536b8b12ac", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420489370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549e67b7f2574eb38f3395452b647de7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ab390a-fb", "ovs_interfaceid": "f5ab390a-fbf1-4384-80a6-95420f8868f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:47:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c29eba95-51c5-4a4e-9a5a-1d7cb9969d55 req-0620b3f0-a6c9-457b-9f5e-d3296f11c6d1 service nova] Releasing lock "refresh_cache-bc66525f-8802-426d-872f-5b567e05b316" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:47:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.377s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:47:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] <== connect_volume: return (2378ms) {'type': 'block', 'scsi_wwn': '23235333462353637', 'path': '/dev/sdd'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:47:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235333462353637', 'path': '/dev/sdd'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:47:00 user nova-compute[75080]: DEBUG nova.objects.instance [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lazy-loading 'flavor' on Instance uuid 8a97a6c4-8486-41be-b919-82ebf61771eb {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:47:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 15:47:00 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:47:00 user nova-compute[75080]:   <source dev="/dev/sdd"/>
Dec 05 15:47:00 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:47:00 user nova-compute[75080]:   <serial>ffd34254-e3f1-4f64-b6dc-a22c63a7b479</serial>
Dec 05 15:47:00 user nova-compute[75080]: </disk>
Dec 05 15:47:00 user nova-compute[75080]:  {{(pid=75080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 15:47:00 user nova-compute[75080]: DEBUG nova.compute.manager [req-006c843f-6a99-4e01-be84-27da33926907 req-da809b1c-a9c0-40b8-8935-57c126061ebc service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Received event network-changed-f5ab390a-fbf1-4384-80a6-95420f8868f9 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:47:00 user nova-compute[75080]: DEBUG nova.compute.manager [req-006c843f-6a99-4e01-be84-27da33926907 req-da809b1c-a9c0-40b8-8935-57c126061ebc service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Refreshing instance network info cache due to event network-changed-f5ab390a-fbf1-4384-80a6-95420f8868f9. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:47:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-006c843f-6a99-4e01-be84-27da33926907 req-da809b1c-a9c0-40b8-8935-57c126061ebc service nova] Acquiring lock "refresh_cache-bc66525f-8802-426d-872f-5b567e05b316" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:47:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-006c843f-6a99-4e01-be84-27da33926907 req-da809b1c-a9c0-40b8-8935-57c126061ebc service nova] Acquired lock "refresh_cache-bc66525f-8802-426d-872f-5b567e05b316" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:47:00 user nova-compute[75080]: DEBUG nova.network.neutron [req-006c843f-6a99-4e01-be84-27da33926907 req-da809b1c-a9c0-40b8-8935-57c126061ebc service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Refreshing network info cache for port f5ab390a-fbf1-4384-80a6-95420f8868f9 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:47:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ddd8fae2-2cee-40c0-a750-a7ab6b06e6e3 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquiring lock "bc66525f-8802-426d-872f-5b567e05b316" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:47:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ddd8fae2-2cee-40c0-a750-a7ab6b06e6e3 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "bc66525f-8802-426d-872f-5b567e05b316" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:47:01 user nova-compute[75080]: INFO nova.compute.manager [None req-ddd8fae2-2cee-40c0-a750-a7ab6b06e6e3 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Detaching volume d33d6554-072a-49bc-9211-feaf5c29f91b
Dec 05 15:47:01 user nova-compute[75080]: INFO nova.virt.block_device [None req-ddd8fae2-2cee-40c0-a750-a7ab6b06e6e3 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Attempting to driver detach volume d33d6554-072a-49bc-9211-feaf5c29f91b from mountpoint /dev/vdb
Dec 05 15:47:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ddd8fae2-2cee-40c0-a750-a7ab6b06e6e3 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Attempting to detach device vdb from instance bc66525f-8802-426d-872f-5b567e05b316 from the persistent domain config. {{(pid=75080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 15:47:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-ddd8fae2-2cee-40c0-a750-a7ab6b06e6e3 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:47:01 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:47:01 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 15:47:01 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:47:01 user nova-compute[75080]:   <serial>d33d6554-072a-49bc-9211-feaf5c29f91b</serial>
Dec 05 15:47:01 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 15:47:01 user nova-compute[75080]: </disk>
Dec 05 15:47:01 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:47:01 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-ddd8fae2-2cee-40c0-a750-a7ab6b06e6e3 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Successfully detached device vdb from instance bc66525f-8802-426d-872f-5b567e05b316 from the persistent domain config.
Dec 05 15:47:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ddd8fae2-2cee-40c0-a750-a7ab6b06e6e3 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bc66525f-8802-426d-872f-5b567e05b316 from the live domain config. {{(pid=75080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 15:47:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-ddd8fae2-2cee-40c0-a750-a7ab6b06e6e3 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:47:01 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:47:01 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 15:47:01 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:47:01 user nova-compute[75080]:   <serial>d33d6554-072a-49bc-9211-feaf5c29f91b</serial>
Dec 05 15:47:01 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 15:47:01 user nova-compute[75080]: </disk>
Dec 05 15:47:01 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:47:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:47:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:47:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] No VIF found with MAC fa:16:3e:2f:30:8f, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:47:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ddc51cd8-a937-4795-ae18-7a98f65448b6 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "8a97a6c4-8486-41be-b919-82ebf61771eb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.050s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:47:01 user nova-compute[75080]: DEBUG nova.network.neutron [req-006c843f-6a99-4e01-be84-27da33926907 req-da809b1c-a9c0-40b8-8935-57c126061ebc service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Updated VIF entry in instance network info cache for port f5ab390a-fbf1-4384-80a6-95420f8868f9. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:47:01 user nova-compute[75080]: DEBUG nova.network.neutron [req-006c843f-6a99-4e01-be84-27da33926907 req-da809b1c-a9c0-40b8-8935-57c126061ebc service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Updating instance_info_cache with network_info: [{"id": "f5ab390a-fbf1-4384-80a6-95420f8868f9", "address": "fa:16:3e:3f:f5:32", "network": {"id": "1151f7c9-f853-4f06-93d7-74536b8b12ac", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420489370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549e67b7f2574eb38f3395452b647de7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ab390a-fb", "ovs_interfaceid": "f5ab390a-fbf1-4384-80a6-95420f8868f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:47:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-006c843f-6a99-4e01-be84-27da33926907 req-da809b1c-a9c0-40b8-8935-57c126061ebc service nova] Releasing lock "refresh_cache-bc66525f-8802-426d-872f-5b567e05b316" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:47:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ddd8fae2-2cee-40c0-a750-a7ab6b06e6e3 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bc66525f-8802-426d-872f-5b567e05b316 {{(pid=75080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 15:47:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:15 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e06e3df3-c216-47a9-8b81-b9b15b8aa5fb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Acquiring lock "8a97a6c4-8486-41be-b919-82ebf61771eb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:47:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e06e3df3-c216-47a9-8b81-b9b15b8aa5fb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "8a97a6c4-8486-41be-b919-82ebf61771eb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:47:20 user nova-compute[75080]: INFO nova.compute.manager [None req-e06e3df3-c216-47a9-8b81-b9b15b8aa5fb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Detaching volume ffd34254-e3f1-4f64-b6dc-a22c63a7b479
Dec 05 15:47:20 user nova-compute[75080]: INFO nova.virt.block_device [None req-e06e3df3-c216-47a9-8b81-b9b15b8aa5fb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Attempting to driver detach volume ffd34254-e3f1-4f64-b6dc-a22c63a7b479 from mountpoint /dev/vdb
Dec 05 15:47:20 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e06e3df3-c216-47a9-8b81-b9b15b8aa5fb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Attempting to detach device vdb from instance 8a97a6c4-8486-41be-b919-82ebf61771eb from the persistent domain config. {{(pid=75080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 15:47:20 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-e06e3df3-c216-47a9-8b81-b9b15b8aa5fb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:47:20 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:47:20 user nova-compute[75080]:   <source dev="/dev/sdd"/>
Dec 05 15:47:20 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:47:20 user nova-compute[75080]:   <serial>ffd34254-e3f1-4f64-b6dc-a22c63a7b479</serial>
Dec 05 15:47:20 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 15:47:20 user nova-compute[75080]: </disk>
Dec 05 15:47:20 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:47:20 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-e06e3df3-c216-47a9-8b81-b9b15b8aa5fb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Successfully detached device vdb from instance 8a97a6c4-8486-41be-b919-82ebf61771eb from the persistent domain config.
Dec 05 15:47:20 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e06e3df3-c216-47a9-8b81-b9b15b8aa5fb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8a97a6c4-8486-41be-b919-82ebf61771eb from the live domain config. {{(pid=75080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 15:47:20 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-e06e3df3-c216-47a9-8b81-b9b15b8aa5fb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:47:20 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:47:20 user nova-compute[75080]:   <source dev="/dev/sdd"/>
Dec 05 15:47:20 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:47:20 user nova-compute[75080]:   <serial>ffd34254-e3f1-4f64-b6dc-a22c63a7b479</serial>
Dec 05 15:47:20 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 15:47:20 user nova-compute[75080]: </disk>
Dec 05 15:47:20 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:47:20 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e06e3df3-c216-47a9-8b81-b9b15b8aa5fb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8a97a6c4-8486-41be-b919-82ebf61771eb {{(pid=75080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 15:47:21 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-ddd8fae2-2cee-40c0-a750-a7ab6b06e6e3 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bc66525f-8802-426d-872f-5b567e05b316 is timed out.
Dec 05 15:47:21 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-ddd8fae2-2cee-40c0-a750-a7ab6b06e6e3 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Successfully detached device vdb from instance bc66525f-8802-426d-872f-5b567e05b316 from the live domain config.
Dec 05 15:47:21 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddd8fae2-2cee-40c0-a750-a7ab6b06e6e3 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd8fae2-2cee-40c0-a750-a7ab6b06e6e3 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'clINmPvp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:47:21 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-ddd8fae2-2cee-40c0-a750-a7ab6b06e6e3 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:47:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-ddd8fae2-2cee-40c0-a750-a7ab6b06e6e3 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-ddd8fae2-2cee-40c0-a750-a7ab6b06e6e3 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa197967-5ffb-4502-82b1-38d45f16bdf7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94feca32-8d57-41e8-b247-2a97aabea281\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd8fae2-2cee-40c0-a750-a7ab6b06e6e3 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:47:21 user nova-compute[75080]: No targets found.
Dec 05 15:47:21 user nova-compute[75080]: iSNS:
Dec 05 15:47:21 user nova-compute[75080]: No targets found.
Dec 05 15:47:21 user nova-compute[75080]: STATIC:
Dec 05 15:47:21 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479
Dec 05 15:47:21 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:47:21 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:47:21 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:94feca32-8d57-41e8-b247-2a97aabea281
Dec 05 15:47:21 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:47:21 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:47:21 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b
Dec 05 15:47:21 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:47:21 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:47:21 user nova-compute[75080]: FIRMWARE:
Dec 05 15:47:21 user nova-compute[75080]: No targets found.
Dec 05 15:47:21 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd8fae2-2cee-40c0-a750-a7ab6b06e6e3 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:47:21 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:47:21 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd8fae2-2cee-40c0-a750-a7ab6b06e6e3 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec59783-b289-412b-9966-6c00b875ccc9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94feca32-8d57-41e8-b247-2a97aabea281\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8a34b1-e68c-405f-9690-dfc8bc75a0c9]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94feca32-8d57-41e8-b247-2a97aabea281 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd8fae2-2cee-40c0-a750-a7ab6b06e6e3 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b (non-flash)
Dec 05 15:47:21 user nova-compute[75080]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479 (non-flash)
Dec 05 15:47:21 user nova-compute[75080]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94feca32-8d57-41e8-b247-2a97aabea281 (non-flash)
Dec 05 15:47:21 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd8fae2-2cee-40c0-a750-a7ab6b06e6e3 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b (non-flash)
Dec 05 15:47:21 user nova-compute[75080]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479 (non-flash)
Dec 05 15:47:21 user nova-compute[75080]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94feca32-8d57-41e8-b247-2a97aabea281 (non-flash)
Dec 05 15:47:21 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd8fae2-2cee-40c0-a750-a7ab6b06e6e3 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6638311fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b'): ({'sdb'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-ddd8fae2-2cee-40c0-a750-a7ab6b06e6e3 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Removing single pathed devices sdb {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5842a125-4c95-4404-99ef-403e301ad0b3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da8d086-6742-4934-83a7-da50e8869cbc]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-ddd8fae2-2cee-40c0-a750-a7ab6b06e6e3 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Flushing IO for device /dev/sdb {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3e0420-7085-41f4-94a9-2f314798187c]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-ddd8fae2-2cee-40c0-a750-a7ab6b06e6e3 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[336d9816-b3cd-48fb-8f64-03f3cf494d2b]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-ddd8fae2-2cee-40c0-a750-a7ab6b06e6e3 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-ddd8fae2-2cee-40c0-a750-a7ab6b06e6e3 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd8fae2-2cee-40c0-a750-a7ab6b06e6e3 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8a7540-c9f0-42c5-8c57-5926a0abe277]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd8fae2-2cee-40c0-a750-a7ab6b06e6e3 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66deb0a-4025-4b5e-b76a-492eb16adbf1]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd8fae2-2cee-40c0-a750-a7ab6b06e6e3 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b, portal: 172.16.0.220,3260]
Dec 05 15:47:21 user nova-compute[75080]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b, portal: 172.16.0.220,3260] successful.
Dec 05 15:47:21 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d33d6554-072a-49bc-9211-feaf5c29f91b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[10646523-54ec-4f15-8b0d-fc5fd36010a3]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd8fae2-2cee-40c0-a750-a7ab6b06e6e3 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-ddd8fae2-2cee-40c0-a750-a7ab6b06e6e3 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd8fae2-2cee-40c0-a750-a7ab6b06e6e3 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] <== disconnect_volume: return (310ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:47:21 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddd8fae2-2cee-40c0-a750-a7ab6b06e6e3 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:47:22 user nova-compute[75080]: DEBUG nova.objects.instance [None req-ddd8fae2-2cee-40c0-a750-a7ab6b06e6e3 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lazy-loading 'flavor' on Instance uuid bc66525f-8802-426d-872f-5b567e05b316 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:47:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ddd8fae2-2cee-40c0-a750-a7ab6b06e6e3 tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "bc66525f-8802-426d-872f-5b567e05b316" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.700s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:47:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:47:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 15:47:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:47:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:47:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:37 user nova-compute[75080]: INFO nova.compute.manager [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Rescuing
Dec 05 15:47:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "refresh_cache-db0fde77-eb40-4acb-93f7-66b5b76c8eea" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:47:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquired lock "refresh_cache-db0fde77-eb40-4acb-93f7-66b5b76c8eea" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:47:37 user nova-compute[75080]: DEBUG nova.network.neutron [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:47:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:37 user nova-compute[75080]: DEBUG nova.network.neutron [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Updating instance_info_cache with network_info: [{"id": "09233cd3-602f-4eb8-a74c-7d592a1a3906", "address": "fa:16:3e:44:84:7c", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09233cd3-60", "ovs_interfaceid": "09233cd3-602f-4eb8-a74c-7d592a1a3906", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:47:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Releasing lock "refresh_cache-db0fde77-eb40-4acb-93f7-66b5b76c8eea" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:47:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:38 user nova-compute[75080]: DEBUG nova.compute.manager [req-eadf56b9-5249-4458-8578-300de96e3be2 req-0cd54a36-8c61-427d-9f93-5c13420e4ece service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Received event network-vif-unplugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:47:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-eadf56b9-5249-4458-8578-300de96e3be2 req-0cd54a36-8c61-427d-9f93-5c13420e4ece service nova] Acquiring lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:47:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-eadf56b9-5249-4458-8578-300de96e3be2 req-0cd54a36-8c61-427d-9f93-5c13420e4ece service nova] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:47:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-eadf56b9-5249-4458-8578-300de96e3be2 req-0cd54a36-8c61-427d-9f93-5c13420e4ece service nova] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:47:38 user nova-compute[75080]: DEBUG nova.compute.manager [req-eadf56b9-5249-4458-8578-300de96e3be2 req-0cd54a36-8c61-427d-9f93-5c13420e4ece service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] No waiting events found dispatching network-vif-unplugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:47:38 user nova-compute[75080]: WARNING nova.compute.manager [req-eadf56b9-5249-4458-8578-300de96e3be2 req-0cd54a36-8c61-427d-9f93-5c13420e4ece service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Received unexpected event network-vif-unplugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 for instance with vm_state active and task_state rescuing.
Dec 05 15:47:38 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Instance destroyed successfully.
Dec 05 15:47:38 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Attempting rescue
Dec 05 15:47:38 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75080) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 05 15:47:38 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Instance directory exists: not creating {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 05 15:47:38 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Creating image(s)
Dec 05 15:47:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "/opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:47:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "/opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:47:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "/opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:47:38 user nova-compute[75080]: DEBUG nova.objects.instance [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lazy-loading 'trusted_certs' on Instance uuid db0fde77-eb40-4acb-93f7-66b5b76c8eea {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:47:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:47:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:47:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.198s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk.rescue {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk.rescue" returned: 0 in 0.050s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:47:39 user nova-compute[75080]: DEBUG nova.objects.instance [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lazy-loading 'migration_context' on Instance uuid db0fde77-eb40-4acb-93f7-66b5b76c8eea {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:47:39 user nova-compute[75080]: DEBUG nova.objects.base [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Object Instance<db0fde77-eb40-4acb-93f7-66b5b76c8eea> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:47:39 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:47:39 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Start _get_guest_xml network_info=[{"id": "09233cd3-602f-4eb8-a74c-7d592a1a3906", "address": "fa:16:3e:44:84:7c", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "vif_mac": "fa:16:3e:44:84:7c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09233cd3-60", "ovs_interfaceid": "09233cd3-602f-4eb8-a74c-7d592a1a3906", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:47:39 user nova-compute[75080]: DEBUG nova.objects.instance [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lazy-loading 'resources' on Instance uuid db0fde77-eb40-4acb-93f7-66b5b76c8eea {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:47:39 user nova-compute[75080]: DEBUG nova.objects.base [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Object Instance<db0fde77-eb40-4acb-93f7-66b5b76c8eea> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:47:39 user nova-compute[75080]: DEBUG nova.objects.instance [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lazy-loading 'numa_topology' on Instance uuid db0fde77-eb40-4acb-93f7-66b5b76c8eea {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:47:39 user nova-compute[75080]: DEBUG nova.objects.base [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Object Instance<db0fde77-eb40-4acb-93f7-66b5b76c8eea> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:47:39 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:47:39 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:47:39 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:47:39 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:47:39 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:47:39 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:47:39 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:47:39 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:47:39 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:47:39 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:47:39 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:47:39 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:47:39 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:47:39 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:47:39 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:47:39 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:47:39 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:47:39 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:47:39 user nova-compute[75080]: DEBUG nova.objects.instance [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lazy-loading 'vcpu_model' on Instance uuid db0fde77-eb40-4acb-93f7-66b5b76c8eea {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:47:39 user nova-compute[75080]: DEBUG nova.objects.base [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Object Instance<db0fde77-eb40-4acb-93f7-66b5b76c8eea> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:47:39 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:42:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-435850721',display_name='tempest-ServerRescueNegativeTestJSON-server-435850721',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-435850721',id=43,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:43:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cea1ac008cfd499a8df635aac9b1342d',ramdisk_id='',reservation_id='r-p7nnlu30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1626475760',owner_user_name='tempest-ServerRescueNegativeTestJSON-1626475760-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:43:01Z,user_data=None,user_id='1afa4590c69f423d97f7cd485e193b0f',uuid=db0fde77-eb40-4acb-93f7-66b5b76c8eea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09233cd3-602f-4eb8-a74c-7d592a1a3906", "address": "fa:16:3e:44:84:7c", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "vif_mac": "fa:16:3e:44:84:7c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09233cd3-60", "ovs_interfaceid": "09233cd3-602f-4eb8-a74c-7d592a1a3906", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:47:39 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Converting VIF {"id": "09233cd3-602f-4eb8-a74c-7d592a1a3906", "address": "fa:16:3e:44:84:7c", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "vif_mac": "fa:16:3e:44:84:7c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09233cd3-60", "ovs_interfaceid": "09233cd3-602f-4eb8-a74c-7d592a1a3906", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:47:39 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:84:7c,bridge_name='br-int',has_traffic_filtering=True,id=09233cd3-602f-4eb8-a74c-7d592a1a3906,network=Network(c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09233cd3-60') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:47:39 user nova-compute[75080]: DEBUG nova.objects.instance [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lazy-loading 'pci_devices' on Instance uuid db0fde77-eb40-4acb-93f7-66b5b76c8eea {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:47:39 user nova-compute[75080]: DEBUG nova.objects.base [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Object Instance<db0fde77-eb40-4acb-93f7-66b5b76c8eea> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:47:39 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:47:39 user nova-compute[75080]:   <uuid>db0fde77-eb40-4acb-93f7-66b5b76c8eea</uuid>
Dec 05 15:47:39 user nova-compute[75080]:   <name>instance-0000002b</name>
Dec 05 15:47:39 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:47:39 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:47:39 user nova-compute[75080]:   <metadata>
Dec 05 15:47:39 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:47:39 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:47:39 user nova-compute[75080]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-435850721</nova:name>
Dec 05 15:47:39 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:47:39</nova:creationTime>
Dec 05 15:47:39 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:47:39 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:47:39 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:47:39 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:47:39 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:47:39 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:47:39 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:47:39 user nova-compute[75080]:       <nova:owner>
Dec 05 15:47:39 user nova-compute[75080]:         <nova:user uuid="1afa4590c69f423d97f7cd485e193b0f">tempest-ServerRescueNegativeTestJSON-1626475760-project-member</nova:user>
Dec 05 15:47:39 user nova-compute[75080]:         <nova:project uuid="cea1ac008cfd499a8df635aac9b1342d">tempest-ServerRescueNegativeTestJSON-1626475760</nova:project>
Dec 05 15:47:39 user nova-compute[75080]:       </nova:owner>
Dec 05 15:47:39 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:47:39 user nova-compute[75080]:       <nova:ports>
Dec 05 15:47:39 user nova-compute[75080]:         <nova:port uuid="09233cd3-602f-4eb8-a74c-7d592a1a3906">
Dec 05 15:47:39 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 05 15:47:39 user nova-compute[75080]:         </nova:port>
Dec 05 15:47:39 user nova-compute[75080]:       </nova:ports>
Dec 05 15:47:39 user nova-compute[75080]:     </nova:instance>
Dec 05 15:47:39 user nova-compute[75080]:   </metadata>
Dec 05 15:47:39 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:47:39 user nova-compute[75080]:     <system>
Dec 05 15:47:39 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:47:39 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:47:39 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:47:39 user nova-compute[75080]:       <entry name="serial">db0fde77-eb40-4acb-93f7-66b5b76c8eea</entry>
Dec 05 15:47:39 user nova-compute[75080]:       <entry name="uuid">db0fde77-eb40-4acb-93f7-66b5b76c8eea</entry>
Dec 05 15:47:39 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:47:39 user nova-compute[75080]:     </system>
Dec 05 15:47:39 user nova-compute[75080]:   </sysinfo>
Dec 05 15:47:39 user nova-compute[75080]:   <os>
Dec 05 15:47:39 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:47:39 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:47:39 user nova-compute[75080]:   </os>
Dec 05 15:47:39 user nova-compute[75080]:   <features>
Dec 05 15:47:39 user nova-compute[75080]:     <acpi/>
Dec 05 15:47:39 user nova-compute[75080]:     <apic/>
Dec 05 15:47:39 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:47:39 user nova-compute[75080]:   </features>
Dec 05 15:47:39 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:47:39 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:47:39 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:47:39 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:47:39 user nova-compute[75080]:   </clock>
Dec 05 15:47:39 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:47:39 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:47:39 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:47:39 user nova-compute[75080]:   </cpu>
Dec 05 15:47:39 user nova-compute[75080]:   <devices>
Dec 05 15:47:39 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:47:39 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:47:39 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk.rescue"/>
Dec 05 15:47:39 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:47:39 user nova-compute[75080]:     </disk>
Dec 05 15:47:39 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:47:39 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:47:39 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk"/>
Dec 05 15:47:39 user nova-compute[75080]:       <target dev="vdb" bus="virtio"/>
Dec 05 15:47:39 user nova-compute[75080]:     </disk>
Dec 05 15:47:39 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:47:39 user nova-compute[75080]:       <mac address="fa:16:3e:44:84:7c"/>
Dec 05 15:47:39 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:47:39 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:47:39 user nova-compute[75080]:       <target dev="tap09233cd3-60"/>
Dec 05 15:47:39 user nova-compute[75080]:     </interface>
Dec 05 15:47:39 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:47:39 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/console.log" append="off"/>
Dec 05 15:47:39 user nova-compute[75080]:     </serial>
Dec 05 15:47:39 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:47:39 user nova-compute[75080]:     <video>
Dec 05 15:47:39 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:47:39 user nova-compute[75080]:     </video>
Dec 05 15:47:39 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:47:39 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:47:39 user nova-compute[75080]:     </rng>
Dec 05 15:47:39 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:47:39 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:47:39 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:47:39 user nova-compute[75080]:     </memballoon>
Dec 05 15:47:39 user nova-compute[75080]:   </devices>
Dec 05 15:47:39 user nova-compute[75080]: </domain>
Dec 05 15:47:39 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:47:39 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Instance destroyed successfully.
Dec 05 15:47:39 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:47:39 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:47:39 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] No VIF found with MAC fa:16:3e:44:84:7c, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:47:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:40 user nova-compute[75080]: DEBUG nova.compute.manager [req-5b224c5b-ae0b-4e82-899a-002090bf0dbc req-bd7a5617-07b2-4e15-a3ad-20d4538a65fd service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Received event network-vif-plugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:47:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5b224c5b-ae0b-4e82-899a-002090bf0dbc req-bd7a5617-07b2-4e15-a3ad-20d4538a65fd service nova] Acquiring lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:47:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5b224c5b-ae0b-4e82-899a-002090bf0dbc req-bd7a5617-07b2-4e15-a3ad-20d4538a65fd service nova] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:47:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5b224c5b-ae0b-4e82-899a-002090bf0dbc req-bd7a5617-07b2-4e15-a3ad-20d4538a65fd service nova] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:47:40 user nova-compute[75080]: DEBUG nova.compute.manager [req-5b224c5b-ae0b-4e82-899a-002090bf0dbc req-bd7a5617-07b2-4e15-a3ad-20d4538a65fd service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] No waiting events found dispatching network-vif-plugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:47:40 user nova-compute[75080]: WARNING nova.compute.manager [req-5b224c5b-ae0b-4e82-899a-002090bf0dbc req-bd7a5617-07b2-4e15-a3ad-20d4538a65fd service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Received unexpected event network-vif-plugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 for instance with vm_state active and task_state rescuing.
Dec 05 15:47:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:40 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-e06e3df3-c216-47a9-8b81-b9b15b8aa5fb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8a97a6c4-8486-41be-b919-82ebf61771eb is timed out.
Dec 05 15:47:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:40 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-e06e3df3-c216-47a9-8b81-b9b15b8aa5fb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Successfully detached device vdb from instance 8a97a6c4-8486-41be-b919-82ebf61771eb from the live domain config.
Dec 05 15:47:40 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e06e3df3-c216-47a9-8b81-b9b15b8aa5fb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:47:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06e3df3-c216-47a9-8b81-b9b15b8aa5fb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfIdzFJK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:47:40 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-e06e3df3-c216-47a9-8b81-b9b15b8aa5fb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:47:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-e06e3df3-c216-47a9-8b81-b9b15b8aa5fb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:47:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-e06e3df3-c216-47a9-8b81-b9b15b8aa5fb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:47:40 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9241c725-975d-41e6-8f0c-9d1ecf1e3836]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06e3df3-c216-47a9-8b81-b9b15b8aa5fb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:47:41 user nova-compute[75080]: No targets found.
Dec 05 15:47:41 user nova-compute[75080]: iSNS:
Dec 05 15:47:41 user nova-compute[75080]: No targets found.
Dec 05 15:47:41 user nova-compute[75080]: STATIC:
Dec 05 15:47:41 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479
Dec 05 15:47:41 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:47:41 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:47:41 user nova-compute[75080]: FIRMWARE:
Dec 05 15:47:41 user nova-compute[75080]: No targets found.
Dec 05 15:47:41 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06e3df3-c216-47a9-8b81-b9b15b8aa5fb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:47:41 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:47:41 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06e3df3-c216-47a9-8b81-b9b15b8aa5fb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[032c0c19-d073-45fc-b7bb-1d97d508e83d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd04876-29df-4cef-9928-d4480ed7f2d3]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06e3df3-c216-47a9-8b81-b9b15b8aa5fb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479 (non-flash)
Dec 05 15:47:41 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06e3df3-c216-47a9-8b81-b9b15b8aa5fb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479 (non-flash)
Dec 05 15:47:41 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06e3df3-c216-47a9-8b81-b9b15b8aa5fb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f665c1e0430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479'): ({'sdd'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-e06e3df3-c216-47a9-8b81-b9b15b8aa5fb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Removing single pathed devices sdd {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f0d3f1-ccf1-4083-b4da-274e7ccc1107]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[455e4af3-d733-4d19-96b0-dc06971a00ac]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-e06e3df3-c216-47a9-8b81-b9b15b8aa5fb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Flushing IO for device /dev/sdd {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[758c7bae-e48d-4b1d-afd6-ba4a57919a50]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-e06e3df3-c216-47a9-8b81-b9b15b8aa5fb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af714aa-98fe-4101-8175-eab4f5d02fd5]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-e06e3df3-c216-47a9-8b81-b9b15b8aa5fb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-e06e3df3-c216-47a9-8b81-b9b15b8aa5fb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] SCSI volumes sdd have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06e3df3-c216-47a9-8b81-b9b15b8aa5fb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b5b3b5-5171-4ffa-a2a4-531cd338f699]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06e3df3-c216-47a9-8b81-b9b15b8aa5fb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479 -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[79429d7c-d81e-4cc0-ac02-5e71471af922]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06e3df3-c216-47a9-8b81-b9b15b8aa5fb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479, portal: 172.16.0.220,3260]
Dec 05 15:47:41 user nova-compute[75080]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479, portal: 172.16.0.220,3260] successful.
Dec 05 15:47:41 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479 -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffd34254-e3f1-4f64-b6dc-a22c63a7b479 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[900a7495-0644-4573-bc85-16052286d906]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06e3df3-c216-47a9-8b81-b9b15b8aa5fb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-e06e3df3-c216-47a9-8b81-b9b15b8aa5fb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06e3df3-c216-47a9-8b81-b9b15b8aa5fb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] <== disconnect_volume: return (322ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e06e3df3-c216-47a9-8b81-b9b15b8aa5fb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Acquiring lock "cab67ec5-c075-4f31-a10f-f256d52608ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Lock "cab67ec5-c075-4f31-a10f-f256d52608ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG nova.compute.manager [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:47:41 user nova-compute[75080]: INFO nova.compute.claims [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Claim successful on node user
Dec 05 15:47:41 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.350s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:47:41 user nova-compute[75080]: DEBUG nova.compute.manager [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:47:42 user nova-compute[75080]: DEBUG nova.compute.manager [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:47:42 user nova-compute[75080]: DEBUG nova.network.neutron [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:47:42 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:47:42 user nova-compute[75080]: DEBUG nova.objects.instance [None req-e06e3df3-c216-47a9-8b81-b9b15b8aa5fb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lazy-loading 'flavor' on Instance uuid 8a97a6c4-8486-41be-b919-82ebf61771eb {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:47:42 user nova-compute[75080]: DEBUG nova.compute.manager [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:47:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e06e3df3-c216-47a9-8b81-b9b15b8aa5fb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "8a97a6c4-8486-41be-b919-82ebf61771eb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.855s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:47:42 user nova-compute[75080]: DEBUG nova.compute.manager [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:47:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:47:42 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Creating image(s)
Dec 05 15:47:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Acquiring lock "/opt/stack/data/nova/instances/cab67ec5-c075-4f31-a10f-f256d52608ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:47:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Lock "/opt/stack/data/nova/instances/cab67ec5-c075-4f31-a10f-f256d52608ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:47:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Lock "/opt/stack/data/nova/instances/cab67ec5-c075-4f31-a10f-f256d52608ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:47:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.184s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:47:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:47:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:42 user nova-compute[75080]: DEBUG nova.compute.manager [req-2947c7e6-3375-4e27-8390-956cbe643f90 req-be48c706-fb7d-4ed0-8ce7-93100f96b13f service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Received event network-vif-plugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:47:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2947c7e6-3375-4e27-8390-956cbe643f90 req-be48c706-fb7d-4ed0-8ce7-93100f96b13f service nova] Acquiring lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:47:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2947c7e6-3375-4e27-8390-956cbe643f90 req-be48c706-fb7d-4ed0-8ce7-93100f96b13f service nova] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:47:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2947c7e6-3375-4e27-8390-956cbe643f90 req-be48c706-fb7d-4ed0-8ce7-93100f96b13f service nova] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:47:42 user nova-compute[75080]: DEBUG nova.compute.manager [req-2947c7e6-3375-4e27-8390-956cbe643f90 req-be48c706-fb7d-4ed0-8ce7-93100f96b13f service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] No waiting events found dispatching network-vif-plugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:47:42 user nova-compute[75080]: WARNING nova.compute.manager [req-2947c7e6-3375-4e27-8390-956cbe643f90 req-be48c706-fb7d-4ed0-8ce7-93100f96b13f service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Received unexpected event network-vif-plugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 for instance with vm_state active and task_state rescuing.
Dec 05 15:47:42 user nova-compute[75080]: DEBUG nova.compute.manager [req-2947c7e6-3375-4e27-8390-956cbe643f90 req-be48c706-fb7d-4ed0-8ce7-93100f96b13f service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Received event network-vif-plugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:47:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2947c7e6-3375-4e27-8390-956cbe643f90 req-be48c706-fb7d-4ed0-8ce7-93100f96b13f service nova] Acquiring lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:47:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2947c7e6-3375-4e27-8390-956cbe643f90 req-be48c706-fb7d-4ed0-8ce7-93100f96b13f service nova] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:47:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-2947c7e6-3375-4e27-8390-956cbe643f90 req-be48c706-fb7d-4ed0-8ce7-93100f96b13f service nova] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:47:42 user nova-compute[75080]: DEBUG nova.compute.manager [req-2947c7e6-3375-4e27-8390-956cbe643f90 req-be48c706-fb7d-4ed0-8ce7-93100f96b13f service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] No waiting events found dispatching network-vif-plugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:47:42 user nova-compute[75080]: WARNING nova.compute.manager [req-2947c7e6-3375-4e27-8390-956cbe643f90 req-be48c706-fb7d-4ed0-8ce7-93100f96b13f service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Received unexpected event network-vif-plugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 for instance with vm_state active and task_state rescuing.
Dec 05 15:47:42 user nova-compute[75080]: DEBUG nova.policy [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '08f602e3beee49e1814486f23484a48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb64f100cd174858a9bb5c4fc546f361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:47:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.187s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/cab67ec5-c075-4f31-a10f-f256d52608ab/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/cab67ec5-c075-4f31-a10f-f256d52608ab/disk 1073741824" returned: 0 in 0.072s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:47:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.186s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:43 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cab67ec5-c075-4f31-a10f-f256d52608ab/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 15:47:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab67ec5-c075-4f31-a10f-f256d52608ab/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab67ec5-c075-4f31-a10f-f256d52608ab/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:43 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Cannot resize image /opt/stack/data/nova/instances/cab67ec5-c075-4f31-a10f-f256d52608ab/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 15:47:43 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:47:43 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Ensure instance console log exists: /opt/stack/data/nova/instances/cab67ec5-c075-4f31-a10f-f256d52608ab/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:47:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:47:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:47:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:47:43 user nova-compute[75080]: DEBUG nova.network.neutron [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Successfully created port: 6c68c41a-8fa4-4ef2-afbb-800a9663e868 {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:47:43 user nova-compute[75080]: DEBUG nova.compute.manager [None req-5a03e0c1-dc44-4c8d-be3c-c4b6570cb2d1 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG nova.network.neutron [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Successfully updated port: 6c68c41a-8fa4-4ef2-afbb-800a9663e868 {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Acquiring lock "refresh_cache-cab67ec5-c075-4f31-a10f-f256d52608ab" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Acquired lock "refresh_cache-cab67ec5-c075-4f31-a10f-f256d52608ab" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG nova.network.neutron [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG nova.network.neutron [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG nova.compute.manager [req-3c01cde9-3499-4e13-9873-5b9633349089 req-f20a963d-753e-429c-a900-03e7bbb7576b service nova] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Received event network-changed-6c68c41a-8fa4-4ef2-afbb-800a9663e868 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG nova.compute.manager [req-3c01cde9-3499-4e13-9873-5b9633349089 req-f20a963d-753e-429c-a900-03e7bbb7576b service nova] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Refreshing instance network info cache due to event network-changed-6c68c41a-8fa4-4ef2-afbb-800a9663e868. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-3c01cde9-3499-4e13-9873-5b9633349089 req-f20a963d-753e-429c-a900-03e7bbb7576b service nova] Acquiring lock "refresh_cache-cab67ec5-c075-4f31-a10f-f256d52608ab" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG nova.network.neutron [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Updating instance_info_cache with network_info: [{"id": "6c68c41a-8fa4-4ef2-afbb-800a9663e868", "address": "fa:16:3e:af:4e:3f", "network": {"id": "3389ea5c-1ba8-4cc0-89ea-ab4f0b9be1a0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1976501028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb64f100cd174858a9bb5c4fc546f361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c68c41a-8f", "ovs_interfaceid": "6c68c41a-8fa4-4ef2-afbb-800a9663e868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Releasing lock "refresh_cache-cab67ec5-c075-4f31-a10f-f256d52608ab" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG nova.compute.manager [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Instance network_info: |[{"id": "6c68c41a-8fa4-4ef2-afbb-800a9663e868", "address": "fa:16:3e:af:4e:3f", "network": {"id": "3389ea5c-1ba8-4cc0-89ea-ab4f0b9be1a0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1976501028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb64f100cd174858a9bb5c4fc546f361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c68c41a-8f", "ovs_interfaceid": "6c68c41a-8fa4-4ef2-afbb-800a9663e868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-3c01cde9-3499-4e13-9873-5b9633349089 req-f20a963d-753e-429c-a900-03e7bbb7576b service nova] Acquired lock "refresh_cache-cab67ec5-c075-4f31-a10f-f256d52608ab" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG nova.network.neutron [req-3c01cde9-3499-4e13-9873-5b9633349089 req-f20a963d-753e-429c-a900-03e7bbb7576b service nova] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Refreshing network info cache for port 6c68c41a-8fa4-4ef2-afbb-800a9663e868 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Start _get_guest_xml network_info=[{"id": "6c68c41a-8fa4-4ef2-afbb-800a9663e868", "address": "fa:16:3e:af:4e:3f", "network": {"id": "3389ea5c-1ba8-4cc0-89ea-ab4f0b9be1a0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1976501028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb64f100cd174858a9bb5c4fc546f361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c68c41a-8f", "ovs_interfaceid": "6c68c41a-8fa4-4ef2-afbb-800a9663e868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:47:44 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:47:44 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:47:44 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:47:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-981940042',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-981940042',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-9819400',id=46,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjHhGT2a0mp7RpYEhguaWXdEaqH4OeZC+vOVsKkQXDzL5Yyf/HhpB08v1jwOYuDrOF90ch30BBOP2C2byT2bTX56jsX8t5xpf1wToG5V0r43IohXn/QzCf7r9qQsLZOhA==',key_name='tempest-keypair-1552165815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb64f100cd174858a9bb5c4fc546f361',ramdisk_id='',reservation_id='r-58vxyksg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1323289192',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:47:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08f602e3beee49e1814486f23484a48a',uuid=cab67ec5-c075-4f31-a10f-f256d52608ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c68c41a-8fa4-4ef2-afbb-800a9663e868", "address": "fa:16:3e:af:4e:3f", "network": {"id": "3389ea5c-1ba8-4cc0-89ea-ab4f0b9be1a0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1976501028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb64f100cd174858a9bb5c4fc546f361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c68c41a-8f", "ovs_interfaceid": "6c68c41a-8fa4-4ef2-afbb-800a9663e868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Converting VIF {"id": "6c68c41a-8fa4-4ef2-afbb-800a9663e868", "address": "fa:16:3e:af:4e:3f", "network": {"id": "3389ea5c-1ba8-4cc0-89ea-ab4f0b9be1a0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1976501028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb64f100cd174858a9bb5c4fc546f361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c68c41a-8f", "ovs_interfaceid": "6c68c41a-8fa4-4ef2-afbb-800a9663e868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:4e:3f,bridge_name='br-int',has_traffic_filtering=True,id=6c68c41a-8fa4-4ef2-afbb-800a9663e868,network=Network(3389ea5c-1ba8-4cc0-89ea-ab4f0b9be1a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c68c41a-8f') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG nova.objects.instance [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Lazy-loading 'pci_devices' on Instance uuid cab67ec5-c075-4f31-a10f-f256d52608ab {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:47:44 user nova-compute[75080]:   <uuid>cab67ec5-c075-4f31-a10f-f256d52608ab</uuid>
Dec 05 15:47:44 user nova-compute[75080]:   <name>instance-0000002e</name>
Dec 05 15:47:44 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:47:44 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:47:44 user nova-compute[75080]:   <metadata>
Dec 05 15:47:44 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:47:44 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:47:44 user nova-compute[75080]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-981940042</nova:name>
Dec 05 15:47:44 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:47:44</nova:creationTime>
Dec 05 15:47:44 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:47:44 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:47:44 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:47:44 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:47:44 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:47:44 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:47:44 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:47:44 user nova-compute[75080]:       <nova:owner>
Dec 05 15:47:44 user nova-compute[75080]:         <nova:user uuid="08f602e3beee49e1814486f23484a48a">tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member</nova:user>
Dec 05 15:47:44 user nova-compute[75080]:         <nova:project uuid="cb64f100cd174858a9bb5c4fc546f361">tempest-TestServerVolumeAttachScenarioOldVersion-1323289192</nova:project>
Dec 05 15:47:44 user nova-compute[75080]:       </nova:owner>
Dec 05 15:47:44 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:47:44 user nova-compute[75080]:       <nova:ports>
Dec 05 15:47:44 user nova-compute[75080]:         <nova:port uuid="6c68c41a-8fa4-4ef2-afbb-800a9663e868">
Dec 05 15:47:44 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 05 15:47:44 user nova-compute[75080]:         </nova:port>
Dec 05 15:47:44 user nova-compute[75080]:       </nova:ports>
Dec 05 15:47:44 user nova-compute[75080]:     </nova:instance>
Dec 05 15:47:44 user nova-compute[75080]:   </metadata>
Dec 05 15:47:44 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:47:44 user nova-compute[75080]:     <system>
Dec 05 15:47:44 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:47:44 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:47:44 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:47:44 user nova-compute[75080]:       <entry name="serial">cab67ec5-c075-4f31-a10f-f256d52608ab</entry>
Dec 05 15:47:44 user nova-compute[75080]:       <entry name="uuid">cab67ec5-c075-4f31-a10f-f256d52608ab</entry>
Dec 05 15:47:44 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:47:44 user nova-compute[75080]:     </system>
Dec 05 15:47:44 user nova-compute[75080]:   </sysinfo>
Dec 05 15:47:44 user nova-compute[75080]:   <os>
Dec 05 15:47:44 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:47:44 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:47:44 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:47:44 user nova-compute[75080]:   </os>
Dec 05 15:47:44 user nova-compute[75080]:   <features>
Dec 05 15:47:44 user nova-compute[75080]:     <acpi/>
Dec 05 15:47:44 user nova-compute[75080]:     <apic/>
Dec 05 15:47:44 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:47:44 user nova-compute[75080]:   </features>
Dec 05 15:47:44 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:47:44 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:47:44 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:47:44 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:47:44 user nova-compute[75080]:   </clock>
Dec 05 15:47:44 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:47:44 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:47:44 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:47:44 user nova-compute[75080]:   </cpu>
Dec 05 15:47:44 user nova-compute[75080]:   <devices>
Dec 05 15:47:44 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:47:44 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:47:44 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/cab67ec5-c075-4f31-a10f-f256d52608ab/disk"/>
Dec 05 15:47:44 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:47:44 user nova-compute[75080]:     </disk>
Dec 05 15:47:44 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:47:44 user nova-compute[75080]:       <mac address="fa:16:3e:af:4e:3f"/>
Dec 05 15:47:44 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:47:44 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:47:44 user nova-compute[75080]:       <target dev="tap6c68c41a-8f"/>
Dec 05 15:47:44 user nova-compute[75080]:     </interface>
Dec 05 15:47:44 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:47:44 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/cab67ec5-c075-4f31-a10f-f256d52608ab/console.log" append="off"/>
Dec 05 15:47:44 user nova-compute[75080]:     </serial>
Dec 05 15:47:44 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:47:44 user nova-compute[75080]:     <video>
Dec 05 15:47:44 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:47:44 user nova-compute[75080]:     </video>
Dec 05 15:47:44 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:47:44 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:47:44 user nova-compute[75080]:     </rng>
Dec 05 15:47:44 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:47:44 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:47:44 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:47:44 user nova-compute[75080]:     </memballoon>
Dec 05 15:47:44 user nova-compute[75080]:   </devices>
Dec 05 15:47:44 user nova-compute[75080]: </domain>
Dec 05 15:47:44 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:47:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-981940042',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-981940042',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-9819400',id=46,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjHhGT2a0mp7RpYEhguaWXdEaqH4OeZC+vOVsKkQXDzL5Yyf/HhpB08v1jwOYuDrOF90ch30BBOP2C2byT2bTX56jsX8t5xpf1wToG5V0r43IohXn/QzCf7r9qQsLZOhA==',key_name='tempest-keypair-1552165815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb64f100cd174858a9bb5c4fc546f361',ramdisk_id='',reservation_id='r-58vxyksg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1323289192',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:47:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08f602e3beee49e1814486f23484a48a',uuid=cab67ec5-c075-4f31-a10f-f256d52608ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c68c41a-8fa4-4ef2-afbb-800a9663e868", "address": "fa:16:3e:af:4e:3f", "network": {"id": "3389ea5c-1ba8-4cc0-89ea-ab4f0b9be1a0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1976501028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb64f100cd174858a9bb5c4fc546f361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c68c41a-8f", "ovs_interfaceid": "6c68c41a-8fa4-4ef2-afbb-800a9663e868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Converting VIF {"id": "6c68c41a-8fa4-4ef2-afbb-800a9663e868", "address": "fa:16:3e:af:4e:3f", "network": {"id": "3389ea5c-1ba8-4cc0-89ea-ab4f0b9be1a0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1976501028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb64f100cd174858a9bb5c4fc546f361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c68c41a-8f", "ovs_interfaceid": "6c68c41a-8fa4-4ef2-afbb-800a9663e868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:4e:3f,bridge_name='br-int',has_traffic_filtering=True,id=6c68c41a-8fa4-4ef2-afbb-800a9663e868,network=Network(3389ea5c-1ba8-4cc0-89ea-ab4f0b9be1a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c68c41a-8f') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG os_vif [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:4e:3f,bridge_name='br-int',has_traffic_filtering=True,id=6c68c41a-8fa4-4ef2-afbb-800a9663e868,network=Network(3389ea5c-1ba8-4cc0-89ea-ab4f0b9be1a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c68c41a-8f') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1c709269-01e0-5f88-a624-13da1c80dbfe', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c68c41a-8f, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6c68c41a-8f, col_values=(('qos', UUID('d10a418f-7a8a-49b4-95ea-d163a13029aa')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6c68c41a-8f, col_values=(('external_ids', {'iface-id': '6c68c41a-8fa4-4ef2-afbb-800a9663e868', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:4e:3f', 'vm-uuid': 'cab67ec5-c075-4f31-a10f-f256d52608ab'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:44 user nova-compute[75080]: INFO os_vif [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:4e:3f,bridge_name='br-int',has_traffic_filtering=True,id=6c68c41a-8fa4-4ef2-afbb-800a9663e868,network=Network(3389ea5c-1ba8-4cc0-89ea-ab4f0b9be1a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c68c41a-8f')
Dec 05 15:47:44 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] No VIF found with MAC fa:16:3e:af:4e:3f, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG nova.network.neutron [req-3c01cde9-3499-4e13-9873-5b9633349089 req-f20a963d-753e-429c-a900-03e7bbb7576b service nova] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Updated VIF entry in instance network info cache for port 6c68c41a-8fa4-4ef2-afbb-800a9663e868. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG nova.network.neutron [req-3c01cde9-3499-4e13-9873-5b9633349089 req-f20a963d-753e-429c-a900-03e7bbb7576b service nova] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Updating instance_info_cache with network_info: [{"id": "6c68c41a-8fa4-4ef2-afbb-800a9663e868", "address": "fa:16:3e:af:4e:3f", "network": {"id": "3389ea5c-1ba8-4cc0-89ea-ab4f0b9be1a0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1976501028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb64f100cd174858a9bb5c4fc546f361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c68c41a-8f", "ovs_interfaceid": "6c68c41a-8fa4-4ef2-afbb-800a9663e868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:47:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-3c01cde9-3499-4e13-9873-5b9633349089 req-f20a963d-753e-429c-a900-03e7bbb7576b service nova] Releasing lock "refresh_cache-cab67ec5-c075-4f31-a10f-f256d52608ab" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:47:45 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:45 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:46 user nova-compute[75080]: DEBUG nova.compute.manager [req-c5d4c94c-9ea9-4f92-8454-30246409f799 req-8789c846-c0b2-4c70-9ba1-eacfc47775f5 service nova] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Received event network-vif-plugged-6c68c41a-8fa4-4ef2-afbb-800a9663e868 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:47:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c5d4c94c-9ea9-4f92-8454-30246409f799 req-8789c846-c0b2-4c70-9ba1-eacfc47775f5 service nova] Acquiring lock "cab67ec5-c075-4f31-a10f-f256d52608ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:47:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c5d4c94c-9ea9-4f92-8454-30246409f799 req-8789c846-c0b2-4c70-9ba1-eacfc47775f5 service nova] Lock "cab67ec5-c075-4f31-a10f-f256d52608ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:47:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c5d4c94c-9ea9-4f92-8454-30246409f799 req-8789c846-c0b2-4c70-9ba1-eacfc47775f5 service nova] Lock "cab67ec5-c075-4f31-a10f-f256d52608ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:47:46 user nova-compute[75080]: DEBUG nova.compute.manager [req-c5d4c94c-9ea9-4f92-8454-30246409f799 req-8789c846-c0b2-4c70-9ba1-eacfc47775f5 service nova] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] No waiting events found dispatching network-vif-plugged-6c68c41a-8fa4-4ef2-afbb-800a9663e868 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:47:46 user nova-compute[75080]: WARNING nova.compute.manager [req-c5d4c94c-9ea9-4f92-8454-30246409f799 req-8789c846-c0b2-4c70-9ba1-eacfc47775f5 service nova] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Received unexpected event network-vif-plugged-6c68c41a-8fa4-4ef2-afbb-800a9663e868 for instance with vm_state building and task_state spawning.
Dec 05 15:47:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:47 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:47:47 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:47:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:48 user nova-compute[75080]: DEBUG nova.compute.manager [req-b1b0a7e9-9385-4e0c-888c-787bf706aaa5 req-67476ef9-4e5a-4fca-9ac2-c7a66c213b77 service nova] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Received event network-vif-plugged-6c68c41a-8fa4-4ef2-afbb-800a9663e868 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:47:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-b1b0a7e9-9385-4e0c-888c-787bf706aaa5 req-67476ef9-4e5a-4fca-9ac2-c7a66c213b77 service nova] Acquiring lock "cab67ec5-c075-4f31-a10f-f256d52608ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:47:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-b1b0a7e9-9385-4e0c-888c-787bf706aaa5 req-67476ef9-4e5a-4fca-9ac2-c7a66c213b77 service nova] Lock "cab67ec5-c075-4f31-a10f-f256d52608ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:47:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-b1b0a7e9-9385-4e0c-888c-787bf706aaa5 req-67476ef9-4e5a-4fca-9ac2-c7a66c213b77 service nova] Lock "cab67ec5-c075-4f31-a10f-f256d52608ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:47:48 user nova-compute[75080]: DEBUG nova.compute.manager [req-b1b0a7e9-9385-4e0c-888c-787bf706aaa5 req-67476ef9-4e5a-4fca-9ac2-c7a66c213b77 service nova] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] No waiting events found dispatching network-vif-plugged-6c68c41a-8fa4-4ef2-afbb-800a9663e868 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:47:48 user nova-compute[75080]: WARNING nova.compute.manager [req-b1b0a7e9-9385-4e0c-888c-787bf706aaa5 req-67476ef9-4e5a-4fca-9ac2-c7a66c213b77 service nova] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Received unexpected event network-vif-plugged-6c68c41a-8fa4-4ef2-afbb-800a9663e868 for instance with vm_state building and task_state spawning.
Dec 05 15:47:48 user nova-compute[75080]: DEBUG nova.compute.manager [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:47:48 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:47:48 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Instance spawned successfully.
Dec 05 15:47:48 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:47:48 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:47:48 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:47:48 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:47:48 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:47:48 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:47:48 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:47:48 user nova-compute[75080]: INFO nova.compute.manager [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Took 5.98 seconds to spawn the instance on the hypervisor.
Dec 05 15:47:48 user nova-compute[75080]: DEBUG nova.compute.manager [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:47:48 user nova-compute[75080]: INFO nova.compute.manager [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Took 6.88 seconds to build instance.
Dec 05 15:47:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-eba9b9cc-40c4-4b1a-9d87-6e006dcd1e19 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Lock "cab67ec5-c075-4f31-a10f-f256d52608ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.974s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:47:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:50 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:47:50 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:47:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:53 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:47:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:47:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:47:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:47:53 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:47:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc66525f-8802-426d-872f-5b567e05b316/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc66525f-8802-426d-872f-5b567e05b316/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc66525f-8802-426d-872f-5b567e05b316/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc66525f-8802-426d-872f-5b567e05b316/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab67ec5-c075-4f31-a10f-f256d52608ab/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab67ec5-c075-4f31-a10f-f256d52608ab/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab67ec5-c075-4f31-a10f-f256d52608ab/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:47:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab67ec5-c075-4f31-a10f-f256d52608ab/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:47:56 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:47:56 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:47:56 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=8408MB free_disk=24.891407012939453GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:47:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:47:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:47:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-82b473e4-acbf-48ce-a034-8c161cdc104c tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquiring lock "bc66525f-8802-426d-872f-5b567e05b316" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:47:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-82b473e4-acbf-48ce-a034-8c161cdc104c tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "bc66525f-8802-426d-872f-5b567e05b316" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:47:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-82b473e4-acbf-48ce-a034-8c161cdc104c tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquiring lock "bc66525f-8802-426d-872f-5b567e05b316-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:47:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-82b473e4-acbf-48ce-a034-8c161cdc104c tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "bc66525f-8802-426d-872f-5b567e05b316-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:47:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-82b473e4-acbf-48ce-a034-8c161cdc104c tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "bc66525f-8802-426d-872f-5b567e05b316-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:47:56 user nova-compute[75080]: INFO nova.compute.manager [None req-82b473e4-acbf-48ce-a034-8c161cdc104c tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Terminating instance
Dec 05 15:47:56 user nova-compute[75080]: DEBUG nova.compute.manager [None req-82b473e4-acbf-48ce-a034-8c161cdc104c tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:47:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:57 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance bc66525f-8802-426d-872f-5b567e05b316 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:47:57 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance db0fde77-eb40-4acb-93f7-66b5b76c8eea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:47:57 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 8608d2cf-476d-43b8-a124-c44507459a1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:47:57 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 8a97a6c4-8486-41be-b919-82ebf61771eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:47:57 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance cab67ec5-c075-4f31-a10f-f256d52608ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:47:57 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:47:57 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:47:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:57 user nova-compute[75080]: DEBUG nova.compute.manager [req-9d37c096-307c-4bed-9e62-928c7d354d61 req-f8b646c1-bef0-41fe-90f2-7d3f22f9e3bc service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Received event network-vif-unplugged-f5ab390a-fbf1-4384-80a6-95420f8868f9 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:47:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9d37c096-307c-4bed-9e62-928c7d354d61 req-f8b646c1-bef0-41fe-90f2-7d3f22f9e3bc service nova] Acquiring lock "bc66525f-8802-426d-872f-5b567e05b316-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:47:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9d37c096-307c-4bed-9e62-928c7d354d61 req-f8b646c1-bef0-41fe-90f2-7d3f22f9e3bc service nova] Lock "bc66525f-8802-426d-872f-5b567e05b316-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:47:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9d37c096-307c-4bed-9e62-928c7d354d61 req-f8b646c1-bef0-41fe-90f2-7d3f22f9e3bc service nova] Lock "bc66525f-8802-426d-872f-5b567e05b316-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:47:57 user nova-compute[75080]: DEBUG nova.compute.manager [req-9d37c096-307c-4bed-9e62-928c7d354d61 req-f8b646c1-bef0-41fe-90f2-7d3f22f9e3bc service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] No waiting events found dispatching network-vif-unplugged-f5ab390a-fbf1-4384-80a6-95420f8868f9 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:47:57 user nova-compute[75080]: DEBUG nova.compute.manager [req-9d37c096-307c-4bed-9e62-928c7d354d61 req-f8b646c1-bef0-41fe-90f2-7d3f22f9e3bc service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Received event network-vif-unplugged-f5ab390a-fbf1-4384-80a6-95420f8868f9 for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:47:57 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:47:57 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:47:57 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:47:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.479s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:47:57 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: bc66525f-8802-426d-872f-5b567e05b316] Instance destroyed successfully.
Dec 05 15:47:57 user nova-compute[75080]: DEBUG nova.objects.instance [None req-82b473e4-acbf-48ce-a034-8c161cdc104c tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lazy-loading 'resources' on Instance uuid bc66525f-8802-426d-872f-5b567e05b316 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:47:57 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-82b473e4-acbf-48ce-a034-8c161cdc104c tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:42:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2093592265',display_name='tempest-TestMinimumBasicScenario-server-2093592265',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2093592265',id=42,image_ref='8117b5a8-fd25-4cb9-aa95-dda536d318a6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKe0jhR+SbXnQBb1E1WEhM00pDWOjsXIEsxHIa+sgPNadBl6GMQIj/pfRNSlnkjpDxSTorp+6p5gtZ7oyCAvxeiPzS6O835Nv5Xu+L1+zuTOKgYvUwC5/9lskCdZWYkboQ==',key_name='tempest-TestMinimumBasicScenario-311713196',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:42:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='549e67b7f2574eb38f3395452b647de7',ramdisk_id='',reservation_id='r-4t2ktdta',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8117b5a8-fd25-4cb9-aa95-dda536d318a6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1307764000',owner_user_name='tempest-TestMinimumBasicScenario-1307764000-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:45:15Z,user_data=None,user_id='e0cb687b9ede4bb8ac3e192766fa4f21',uuid=bc66525f-8802-426d-872f-5b567e05b316,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5ab390a-fbf1-4384-80a6-95420f8868f9", "address": "fa:16:3e:3f:f5:32", "network": {"id": "1151f7c9-f853-4f06-93d7-74536b8b12ac", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420489370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549e67b7f2574eb38f3395452b647de7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ab390a-fb", "ovs_interfaceid": "f5ab390a-fbf1-4384-80a6-95420f8868f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:47:57 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-82b473e4-acbf-48ce-a034-8c161cdc104c tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Converting VIF {"id": "f5ab390a-fbf1-4384-80a6-95420f8868f9", "address": "fa:16:3e:3f:f5:32", "network": {"id": "1151f7c9-f853-4f06-93d7-74536b8b12ac", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420489370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549e67b7f2574eb38f3395452b647de7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5ab390a-fb", "ovs_interfaceid": "f5ab390a-fbf1-4384-80a6-95420f8868f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:47:57 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-82b473e4-acbf-48ce-a034-8c161cdc104c tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:f5:32,bridge_name='br-int',has_traffic_filtering=True,id=f5ab390a-fbf1-4384-80a6-95420f8868f9,network=Network(1151f7c9-f853-4f06-93d7-74536b8b12ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5ab390a-fb') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:47:57 user nova-compute[75080]: DEBUG os_vif [None req-82b473e4-acbf-48ce-a034-8c161cdc104c tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:f5:32,bridge_name='br-int',has_traffic_filtering=True,id=f5ab390a-fbf1-4384-80a6-95420f8868f9,network=Network(1151f7c9-f853-4f06-93d7-74536b8b12ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5ab390a-fb') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:47:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5ab390a-fb, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:47:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:47:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5751acfc-1837-421e-9b20-c0e42d9c6ce0) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:47:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:57 user nova-compute[75080]: INFO os_vif [None req-82b473e4-acbf-48ce-a034-8c161cdc104c tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:f5:32,bridge_name='br-int',has_traffic_filtering=True,id=f5ab390a-fbf1-4384-80a6-95420f8868f9,network=Network(1151f7c9-f853-4f06-93d7-74536b8b12ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5ab390a-fb')
Dec 05 15:47:57 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-82b473e4-acbf-48ce-a034-8c161cdc104c tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Deleting instance files /opt/stack/data/nova/instances/bc66525f-8802-426d-872f-5b567e05b316_del
Dec 05 15:47:57 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-82b473e4-acbf-48ce-a034-8c161cdc104c tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Deletion of /opt/stack/data/nova/instances/bc66525f-8802-426d-872f-5b567e05b316_del complete
Dec 05 15:47:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:47:57 user nova-compute[75080]: INFO nova.compute.manager [None req-82b473e4-acbf-48ce-a034-8c161cdc104c tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] [instance: bc66525f-8802-426d-872f-5b567e05b316] Took 0.89 seconds to destroy the instance on the hypervisor.
Dec 05 15:47:57 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-82b473e4-acbf-48ce-a034-8c161cdc104c tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:47:57 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: bc66525f-8802-426d-872f-5b567e05b316] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:47:57 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: bc66525f-8802-426d-872f-5b567e05b316] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:47:58 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:47:58 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:47:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-8a97a6c4-8486-41be-b919-82ebf61771eb" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:47:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-8a97a6c4-8486-41be-b919-82ebf61771eb" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:47:58 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 15:47:58 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: bc66525f-8802-426d-872f-5b567e05b316] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:47:58 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: bc66525f-8802-426d-872f-5b567e05b316] Took 0.68 seconds to deallocate network for instance.
Dec 05 15:47:58 user nova-compute[75080]: DEBUG nova.compute.manager [req-eedf53a2-8c1c-42ee-a64a-4b3b0d7bd4e0 req-abf0749c-354b-43ae-9749-49b8014af906 service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Received event network-vif-deleted-f5ab390a-fbf1-4384-80a6-95420f8868f9 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:47:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-82b473e4-acbf-48ce-a034-8c161cdc104c tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:47:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-82b473e4-acbf-48ce-a034-8c161cdc104c tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:47:58 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-82b473e4-acbf-48ce-a034-8c161cdc104c tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:47:58 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-82b473e4-acbf-48ce-a034-8c161cdc104c tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:47:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-82b473e4-acbf-48ce-a034-8c161cdc104c tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.224s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:47:58 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-82b473e4-acbf-48ce-a034-8c161cdc104c tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Deleted allocations for instance bc66525f-8802-426d-872f-5b567e05b316
Dec 05 15:47:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-82b473e4-acbf-48ce-a034-8c161cdc104c tempest-TestMinimumBasicScenario-1307764000 tempest-TestMinimumBasicScenario-1307764000-project-member] Lock "bc66525f-8802-426d-872f-5b567e05b316" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.092s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:47:59 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Updating instance_info_cache with network_info: [{"id": "0013f2c2-e337-4c3d-8885-ee027a53e8d8", "address": "fa:16:3e:2f:30:8f", "network": {"id": "236ffb89-7d87-41de-8dac-e36bfb38a2d0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-187610999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9070144481d84c98bdc9063c54a9e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0013f2c2-e3", "ovs_interfaceid": "0013f2c2-e337-4c3d-8885-ee027a53e8d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:47:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-8a97a6c4-8486-41be-b919-82ebf61771eb" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:47:59 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 15:47:59 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:47:59 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:47:59 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:47:59 user nova-compute[75080]: DEBUG nova.compute.manager [req-5bb18720-b4c4-41f2-ac5e-199f884b8612 req-78f501b7-ed9f-48ae-a42f-c0e9804d8084 service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Received event network-vif-plugged-f5ab390a-fbf1-4384-80a6-95420f8868f9 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:47:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5bb18720-b4c4-41f2-ac5e-199f884b8612 req-78f501b7-ed9f-48ae-a42f-c0e9804d8084 service nova] Acquiring lock "bc66525f-8802-426d-872f-5b567e05b316-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:47:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5bb18720-b4c4-41f2-ac5e-199f884b8612 req-78f501b7-ed9f-48ae-a42f-c0e9804d8084 service nova] Lock "bc66525f-8802-426d-872f-5b567e05b316-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:47:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5bb18720-b4c4-41f2-ac5e-199f884b8612 req-78f501b7-ed9f-48ae-a42f-c0e9804d8084 service nova] Lock "bc66525f-8802-426d-872f-5b567e05b316-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:47:59 user nova-compute[75080]: DEBUG nova.compute.manager [req-5bb18720-b4c4-41f2-ac5e-199f884b8612 req-78f501b7-ed9f-48ae-a42f-c0e9804d8084 service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] No waiting events found dispatching network-vif-plugged-f5ab390a-fbf1-4384-80a6-95420f8868f9 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:47:59 user nova-compute[75080]: WARNING nova.compute.manager [req-5bb18720-b4c4-41f2-ac5e-199f884b8612 req-78f501b7-ed9f-48ae-a42f-c0e9804d8084 service nova] [instance: bc66525f-8802-426d-872f-5b567e05b316] Received unexpected event network-vif-plugged-f5ab390a-fbf1-4384-80a6-95420f8868f9 for instance with vm_state deleted and task_state None.
Dec 05 15:48:00 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:48:01 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:48:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:48:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:48:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:48:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:48:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:48:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:48:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Acquiring lock "8a97a6c4-8486-41be-b919-82ebf61771eb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:48:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "8a97a6c4-8486-41be-b919-82ebf61771eb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:48:13 user nova-compute[75080]: DEBUG nova.objects.instance [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lazy-loading 'flavor' on Instance uuid 8a97a6c4-8486-41be-b919-82ebf61771eb {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:48:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "8a97a6c4-8486-41be-b919-82ebf61771eb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:48:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Acquiring lock "8a97a6c4-8486-41be-b919-82ebf61771eb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:48:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "8a97a6c4-8486-41be-b919-82ebf61771eb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:48:13 user nova-compute[75080]: INFO nova.compute.manager [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Attaching volume e70e5792-0cb6-49d0-ae7b-c1a905377a8c to /dev/vdb
Dec 05 15:48:13 user nova-compute[75080]: DEBUG os_brick.utils [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:48:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:48:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:48:13 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6256e8-b0d9-49cd-bc9c-612ddba5e483]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:48:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:48:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:48:13 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d289c82-e7f4-4fd1-9513-0e0b46ea6309]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:48:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:48:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:48:13 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce1066d-e3fc-4a28-8453-b7b2f8e4db26]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:48:13 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb5b66b-661b-40b8-a603-0a4690f8690c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:48:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:48:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:48:13 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:48:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:48:13 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:48:13 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:48:13 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d0ed11-3397-4c00-9703-5f74af911f97]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:48:13 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:48:13 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:48:13 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:48:13 user nova-compute[75080]: DEBUG os_brick.utils [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:48:13 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Updating existing volume attachment record: 6d2a6e69-f8f5-473c-b474-1c00505f1aa1 {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:48:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:48:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:48:22 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:48:22 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ajVpLFJT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:48:22 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:48:22 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:48:22 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:48:22 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:48:22 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:48:22 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:48:22 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:48:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:48:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:48:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:48:22 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[22716568-71bb-45e5-8c4a-8844a0ce38cd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:48:22 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:48:22 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:48:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:48:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:48:22 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6167ae0f-b580-4916-b639-ee7fe86b8a99]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:48:22 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c] added
Dec 05 15:48:22 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:48:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:48:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:48:22 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0dd92e9-4871-4d86-b22d-d62aa178585c]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:48:22 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:48:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:48:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:48:22 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40fe30a-ac06-48c3-80eb-65f0a9408ecb]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:48:22 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:48:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ajVpLFJT {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:48:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ajVpLFJT" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:48:22 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[233fae4f-cec9-4084-a60f-e6a789dd9b9b]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:48:22 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ajVpLFJT'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:48:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:48:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:48:22 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e830e8a-b37c-486f-b325-6e45f8df9bb4]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:48:22 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:48:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:48:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:48:22 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a22d53-f7a6-41f6-aee1-1c2b2ed56dd4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:48:22 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 05 15:48:22 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:48:22 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 05 15:48:22 user nova-compute[75080]:  {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:48:22 user nova-compute[75080]: WARNING os_brick.initiator.connectors.iscsi [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 05 15:48:22 user nova-compute[75080]: 
Dec 05 15:48:22 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:48:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:48:23 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d293bfc2-c975-4904-adc4-c6d24d86785a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:48:23 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c, portal: 172.16.0.220,3260]
Dec 05 15:48:23 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c, portal: 172.16.0.220,3260] successful.
Dec 05 15:48:23 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:48:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:48:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:48:23 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[db431611-7d46-4744-b280-adebcf9d06fd]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:48:23 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:48:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:48:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:48:23 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e8484b-da0c-4e0d-b1b7-45aa9ed1ac88]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:48:23 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c (non-flash)
Dec 05 15:48:23 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:48:23 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c (non-flash)
Dec 05 15:48:23 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:48:23 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:48:23 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:48:23 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:48:23 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:48:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:48:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:48:23 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2ec070-c6b2-4199-9759-5754cf3974cc]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:48:23 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:48:23 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ajVpLFJT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:48:24 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:48:24 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26637376435303637', 'path': '/dev/sdb'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:48:24 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637376435303637', 'path': '/dev/sdb'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:48:24 user nova-compute[75080]: DEBUG nova.objects.instance [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lazy-loading 'flavor' on Instance uuid 8a97a6c4-8486-41be-b919-82ebf61771eb {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:48:24 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 15:48:24 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:48:24 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 15:48:24 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:48:24 user nova-compute[75080]:   <serial>e70e5792-0cb6-49d0-ae7b-c1a905377a8c</serial>
Dec 05 15:48:24 user nova-compute[75080]: </disk>
Dec 05 15:48:24 user nova-compute[75080]:  {{(pid=75080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 15:48:24 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:48:24 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:48:24 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] No VIF found with MAC fa:16:3e:2f:30:8f, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:48:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-accfa6f0-c5b8-4299-9d7c-9932b2dede17 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "8a97a6c4-8486-41be-b919-82ebf61771eb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.119s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:48:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-298d184d-e11f-4448-b591-d5d0317f1f89 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Acquiring lock "8a97a6c4-8486-41be-b919-82ebf61771eb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:48:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-298d184d-e11f-4448-b591-d5d0317f1f89 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "8a97a6c4-8486-41be-b919-82ebf61771eb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:48:27 user nova-compute[75080]: INFO nova.compute.manager [None req-298d184d-e11f-4448-b591-d5d0317f1f89 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Detaching volume e70e5792-0cb6-49d0-ae7b-c1a905377a8c
Dec 05 15:48:27 user nova-compute[75080]: INFO nova.virt.block_device [None req-298d184d-e11f-4448-b591-d5d0317f1f89 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Attempting to driver detach volume e70e5792-0cb6-49d0-ae7b-c1a905377a8c from mountpoint /dev/vdb
Dec 05 15:48:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-298d184d-e11f-4448-b591-d5d0317f1f89 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Attempting to detach device vdb from instance 8a97a6c4-8486-41be-b919-82ebf61771eb from the persistent domain config. {{(pid=75080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 15:48:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-298d184d-e11f-4448-b591-d5d0317f1f89 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:48:27 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:48:27 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 15:48:27 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:48:27 user nova-compute[75080]:   <serial>e70e5792-0cb6-49d0-ae7b-c1a905377a8c</serial>
Dec 05 15:48:27 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 15:48:27 user nova-compute[75080]: </disk>
Dec 05 15:48:27 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:48:27 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-298d184d-e11f-4448-b591-d5d0317f1f89 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Successfully detached device vdb from instance 8a97a6c4-8486-41be-b919-82ebf61771eb from the persistent domain config.
Dec 05 15:48:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-298d184d-e11f-4448-b591-d5d0317f1f89 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8a97a6c4-8486-41be-b919-82ebf61771eb from the live domain config. {{(pid=75080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 15:48:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-298d184d-e11f-4448-b591-d5d0317f1f89 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:48:27 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:48:27 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 15:48:27 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:48:27 user nova-compute[75080]:   <serial>e70e5792-0cb6-49d0-ae7b-c1a905377a8c</serial>
Dec 05 15:48:27 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 15:48:27 user nova-compute[75080]: </disk>
Dec 05 15:48:27 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:48:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-298d184d-e11f-4448-b591-d5d0317f1f89 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8a97a6c4-8486-41be-b919-82ebf61771eb {{(pid=75080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 15:48:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:48:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:48:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:48:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:48:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:48:47 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-298d184d-e11f-4448-b591-d5d0317f1f89 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8a97a6c4-8486-41be-b919-82ebf61771eb is timed out.
Dec 05 15:48:47 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-298d184d-e11f-4448-b591-d5d0317f1f89 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Successfully detached device vdb from instance 8a97a6c4-8486-41be-b919-82ebf61771eb from the live domain config.
Dec 05 15:48:47 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-298d184d-e11f-4448-b591-d5d0317f1f89 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-298d184d-e11f-4448-b591-d5d0317f1f89 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ajVpLFJT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:48:47 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-298d184d-e11f-4448-b591-d5d0317f1f89 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:48:47 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-298d184d-e11f-4448-b591-d5d0317f1f89 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-298d184d-e11f-4448-b591-d5d0317f1f89 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be02207-022c-46bc-9192-288752b2234c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-298d184d-e11f-4448-b591-d5d0317f1f89 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:48:47 user nova-compute[75080]: No targets found.
Dec 05 15:48:47 user nova-compute[75080]: iSNS:
Dec 05 15:48:47 user nova-compute[75080]: No targets found.
Dec 05 15:48:47 user nova-compute[75080]: STATIC:
Dec 05 15:48:47 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c
Dec 05 15:48:47 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:48:47 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:48:47 user nova-compute[75080]: FIRMWARE:
Dec 05 15:48:47 user nova-compute[75080]: No targets found.
Dec 05 15:48:47 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-298d184d-e11f-4448-b591-d5d0317f1f89 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:48:47 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:48:47 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-298d184d-e11f-4448-b591-d5d0317f1f89 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba1c712-6785-40de-ac5d-9a59a022f513]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce15c5b7-973d-40fe-bc96-ff2a1b3b0ae2]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-298d184d-e11f-4448-b591-d5d0317f1f89 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c (non-flash)
Dec 05 15:48:47 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-298d184d-e11f-4448-b591-d5d0317f1f89 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c (non-flash)
Dec 05 15:48:47 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-298d184d-e11f-4448-b591-d5d0317f1f89 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6638523010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c'): ({'sdb'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-298d184d-e11f-4448-b591-d5d0317f1f89 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Removing single pathed devices sdb {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[42281878-d583-40fa-bb37-cd0dad387493]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6953772c-b37d-4bb7-a497-b20a1794017d]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-298d184d-e11f-4448-b591-d5d0317f1f89 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Flushing IO for device /dev/sdb {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb52759a-9cc8-46e7-b8da-47793dc0f13b]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-298d184d-e11f-4448-b591-d5d0317f1f89 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9fa71f-1b42-448e-8863-4f094d03f791]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-298d184d-e11f-4448-b591-d5d0317f1f89 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-298d184d-e11f-4448-b591-d5d0317f1f89 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-298d184d-e11f-4448-b591-d5d0317f1f89 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[06894080-d0ca-4702-a1eb-779cde297667]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-298d184d-e11f-4448-b591-d5d0317f1f89 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fc2485-a769-4248-9d2c-aa3deabea4d1]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-298d184d-e11f-4448-b591-d5d0317f1f89 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c, portal: 172.16.0.220,3260]
Dec 05 15:48:47 user nova-compute[75080]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c, portal: 172.16.0.220,3260] successful.
Dec 05 15:48:47 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70e5792-0cb6-49d0-ae7b-c1a905377a8c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a606ae24-fcca-49aa-a4a5-1d2be32605c2]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-298d184d-e11f-4448-b591-d5d0317f1f89 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-298d184d-e11f-4448-b591-d5d0317f1f89 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-298d184d-e11f-4448-b591-d5d0317f1f89 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] <== disconnect_volume: return (310ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:48:47 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-298d184d-e11f-4448-b591-d5d0317f1f89 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:48:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:48:48 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:48:48 user nova-compute[75080]: DEBUG nova.objects.instance [None req-298d184d-e11f-4448-b591-d5d0317f1f89 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lazy-loading 'flavor' on Instance uuid 8a97a6c4-8486-41be-b919-82ebf61771eb {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:48:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-298d184d-e11f-4448-b591-d5d0317f1f89 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "8a97a6c4-8486-41be-b919-82ebf61771eb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.696s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:48:49 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:48:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:48:51 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:48:51 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:48:52 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:48:52 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Cleaning up deleted instances {{(pid=75080) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 05 15:48:52 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] There are 0 instances to clean {{(pid=75080) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 05 15:48:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:48:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:48:53 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:48:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:48:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:48:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:48:53 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:48:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:48:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:48:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:48:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:48:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:48:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:48:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:48:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:48:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:48:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:48:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:48:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:48:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:48:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:48:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:48:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:48:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:48:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:48:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:48:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:48:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab67ec5-c075-4f31-a10f-f256d52608ab/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:48:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab67ec5-c075-4f31-a10f-f256d52608ab/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:48:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab67ec5-c075-4f31-a10f-f256d52608ab/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:48:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab67ec5-c075-4f31-a10f-f256d52608ab/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:48:56 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:48:56 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:48:56 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=8543MB free_disk=24.92163848876953GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:48:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:48:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:48:56 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance db0fde77-eb40-4acb-93f7-66b5b76c8eea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:48:56 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 8608d2cf-476d-43b8-a124-c44507459a1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:48:56 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 8a97a6c4-8486-41be-b919-82ebf61771eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:48:56 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance cab67ec5-c075-4f31-a10f-f256d52608ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:48:56 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:48:56 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:48:56 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing inventories for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 05 15:48:56 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Updating ProviderTree inventory for provider 21b770fa-b774-46c9-9415-db26064ccd0f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 05 15:48:56 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Updating inventory in ProviderTree for provider 21b770fa-b774-46c9-9415-db26064ccd0f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 15:48:56 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing aggregate associations for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f, aggregates: None {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 05 15:48:56 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing trait associations for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f, traits: COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 05 15:48:56 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:48:56 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:48:56 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:48:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.561s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:48:56 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:48:56 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75080) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 05 15:48:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:48:58 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:48:58 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:48:58 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Rebuilding the list of instances to heal {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 15:48:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-db0fde77-eb40-4acb-93f7-66b5b76c8eea" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:48:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-db0fde77-eb40-4acb-93f7-66b5b76c8eea" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:48:58 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 15:48:58 user nova-compute[75080]: DEBUG nova.objects.instance [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lazy-loading 'info_cache' on Instance uuid db0fde77-eb40-4acb-93f7-66b5b76c8eea {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:48:59 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Updating instance_info_cache with network_info: [{"id": "09233cd3-602f-4eb8-a74c-7d592a1a3906", "address": "fa:16:3e:44:84:7c", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09233cd3-60", "ovs_interfaceid": "09233cd3-602f-4eb8-a74c-7d592a1a3906", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:48:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-db0fde77-eb40-4acb-93f7-66b5b76c8eea" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:48:59 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 15:48:59 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:48:59 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:48:59 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:49:02 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:49:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:49:07 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:49:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:49:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:49:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:49:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Acquiring lock "8a97a6c4-8486-41be-b919-82ebf61771eb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:49:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "8a97a6c4-8486-41be-b919-82ebf61771eb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:49:20 user nova-compute[75080]: DEBUG nova.objects.instance [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lazy-loading 'flavor' on Instance uuid 8a97a6c4-8486-41be-b919-82ebf61771eb {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:49:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "8a97a6c4-8486-41be-b919-82ebf61771eb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:49:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Acquiring lock "8a97a6c4-8486-41be-b919-82ebf61771eb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:49:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "8a97a6c4-8486-41be-b919-82ebf61771eb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:49:20 user nova-compute[75080]: INFO nova.compute.manager [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Attaching volume 2ab5adf1-f739-46e7-a96d-43f407784aff to /dev/vdb
Dec 05 15:49:20 user nova-compute[75080]: DEBUG os_brick.utils [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:49:20 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:20 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:20 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7798e5-3968-44c3-b910-ad25f35619dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:20 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:20 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:20 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ec6e8c-81a9-4ab9-bbd4-078370382782]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:20 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:20 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:20 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7bd6e8-25bb-4eee-a172-58c678fd6edb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:20 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[93113a12-638e-4ca9-91df-cc040c6a33c1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:20 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:20 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:49:20 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:49:20 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:20 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:49:20 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:49:20 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a48dcd3-006d-4161-842a-92d5562391de]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:20 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:49:20 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:49:20 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:49:20 user nova-compute[75080]: DEBUG os_brick.utils [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:49:20 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Updating existing volume attachment record: 9bef9159-7ed4-4aba-893c-a8c1424d7464 {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:49:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:49:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:49:28 user nova-compute[75080]: INFO nova.compute.manager [None req-c05e880b-e6e0-4fcf-a002-ce82ad4ba518 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Unrescuing
Dec 05 15:49:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c05e880b-e6e0-4fcf-a002-ce82ad4ba518 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "refresh_cache-db0fde77-eb40-4acb-93f7-66b5b76c8eea" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:49:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c05e880b-e6e0-4fcf-a002-ce82ad4ba518 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquired lock "refresh_cache-db0fde77-eb40-4acb-93f7-66b5b76c8eea" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:49:28 user nova-compute[75080]: DEBUG nova.network.neutron [None req-c05e880b-e6e0-4fcf-a002-ce82ad4ba518 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG nova.network.neutron [None req-c05e880b-e6e0-4fcf-a002-ce82ad4ba518 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Updating instance_info_cache with network_info: [{"id": "09233cd3-602f-4eb8-a74c-7d592a1a3906", "address": "fa:16:3e:44:84:7c", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09233cd3-60", "ovs_interfaceid": "09233cd3-602f-4eb8-a74c-7d592a1a3906", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c05e880b-e6e0-4fcf-a002-ce82ad4ba518 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Releasing lock "refresh_cache-db0fde77-eb40-4acb-93f7-66b5b76c8eea" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG nova.objects.instance [None req-c05e880b-e6e0-4fcf-a002-ce82ad4ba518 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lazy-loading 'flavor' on Instance uuid db0fde77-eb40-4acb-93f7-66b5b76c8eea {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG nova.compute.manager [req-8be9522e-928c-4a02-ac2b-37d1b10d73f5 req-3c3357f3-01fd-4bfe-8578-c35b5607ffcb service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Received event network-vif-unplugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8be9522e-928c-4a02-ac2b-37d1b10d73f5 req-3c3357f3-01fd-4bfe-8578-c35b5607ffcb service nova] Acquiring lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8be9522e-928c-4a02-ac2b-37d1b10d73f5 req-3c3357f3-01fd-4bfe-8578-c35b5607ffcb service nova] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8be9522e-928c-4a02-ac2b-37d1b10d73f5 req-3c3357f3-01fd-4bfe-8578-c35b5607ffcb service nova] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG nova.compute.manager [req-8be9522e-928c-4a02-ac2b-37d1b10d73f5 req-3c3357f3-01fd-4bfe-8578-c35b5607ffcb service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] No waiting events found dispatching network-vif-unplugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:49:29 user nova-compute[75080]: WARNING nova.compute.manager [req-8be9522e-928c-4a02-ac2b-37d1b10d73f5 req-3c3357f3-01fd-4bfe-8578-c35b5607ffcb service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Received unexpected event network-vif-unplugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 for instance with vm_state rescued and task_state unrescuing.
Dec 05 15:49:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JCUvcFZo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:49:29 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:49:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:49:29 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:49:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:49:29 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:49:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a303fdfa-3544-4d40-b3c8-9d7ad5d48e34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:49:29 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be1046a-b69a-48dd-a156-9fc347694c94]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff] added
Dec 05 15:49:29 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[af62060b-61bb-4b91-bc97-7823e311ba2b]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f078ea0b-331f-4a43-9d1f-0df1f3c80a19]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JCUvcFZo {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JCUvcFZo" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a1353c-3c6e-4ef0-80b2-1461b11036c3]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JCUvcFZo'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f8c088-42dd-4620-ac8c-650d3e28b3c1]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[647d82db-af3d-4e67-b47d-fb747018e9b7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 05 15:49:29 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 05 15:49:29 user nova-compute[75080]:  {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:49:29 user nova-compute[75080]: WARNING os_brick.initiator.connectors.iscsi [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 05 15:49:29 user nova-compute[75080]: 
Dec 05 15:49:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[dffe54c2-8343-4c65-aab7-f8a0c2713985]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff, portal: 172.16.0.220,3260]
Dec 05 15:49:29 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff, portal: 172.16.0.220,3260] successful.
Dec 05 15:49:29 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32976a7-a8ac-471c-93ce-56bb9cc3bbb4]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1870a691-04ce-4e8c-817d-193e79607966]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff (non-flash)
Dec 05 15:49:29 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff (non-flash)
Dec 05 15:49:29 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2e64b0-3a4e-4289-b86d-3c2a8e85f4d3]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JCUvcFZo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:49:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:49:29 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Instance destroyed successfully.
Dec 05 15:49:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:49:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:49:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:49:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:49:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:49:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:49:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23334373665613535', 'path': '/dev/sdb'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:49:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334373665613535', 'path': '/dev/sdb'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:49:30 user nova-compute[75080]: DEBUG nova.objects.instance [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lazy-loading 'flavor' on Instance uuid 8a97a6c4-8486-41be-b919-82ebf61771eb {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:49:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 15:49:30 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:49:30 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 15:49:30 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:49:30 user nova-compute[75080]:   <serial>2ab5adf1-f739-46e7-a96d-43f407784aff</serial>
Dec 05 15:49:30 user nova-compute[75080]: </disk>
Dec 05 15:49:30 user nova-compute[75080]:  {{(pid=75080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 15:49:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:49:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:49:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] No VIF found with MAC fa:16:3e:2f:30:8f, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:49:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5ec6cede-a43d-4b8a-b684-118871fc071b tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "8a97a6c4-8486-41be-b919-82ebf61771eb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.810s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:49:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:49:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:49:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:49:31 user nova-compute[75080]: DEBUG nova.compute.manager [req-4d94665f-4659-48a4-85a5-66090cd23767 req-50014950-ccaf-4773-89ce-a3f1d4eb3ef1 service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Received event network-vif-plugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:49:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4d94665f-4659-48a4-85a5-66090cd23767 req-50014950-ccaf-4773-89ce-a3f1d4eb3ef1 service nova] Acquiring lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:49:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4d94665f-4659-48a4-85a5-66090cd23767 req-50014950-ccaf-4773-89ce-a3f1d4eb3ef1 service nova] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:49:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4d94665f-4659-48a4-85a5-66090cd23767 req-50014950-ccaf-4773-89ce-a3f1d4eb3ef1 service nova] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:49:31 user nova-compute[75080]: DEBUG nova.compute.manager [req-4d94665f-4659-48a4-85a5-66090cd23767 req-50014950-ccaf-4773-89ce-a3f1d4eb3ef1 service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] No waiting events found dispatching network-vif-plugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:49:31 user nova-compute[75080]: WARNING nova.compute.manager [req-4d94665f-4659-48a4-85a5-66090cd23767 req-50014950-ccaf-4773-89ce-a3f1d4eb3ef1 service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Received unexpected event network-vif-plugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 for instance with vm_state rescued and task_state unrescuing.
Dec 05 15:49:31 user nova-compute[75080]: DEBUG nova.compute.manager [req-4d94665f-4659-48a4-85a5-66090cd23767 req-50014950-ccaf-4773-89ce-a3f1d4eb3ef1 service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Received event network-vif-plugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:49:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4d94665f-4659-48a4-85a5-66090cd23767 req-50014950-ccaf-4773-89ce-a3f1d4eb3ef1 service nova] Acquiring lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:49:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4d94665f-4659-48a4-85a5-66090cd23767 req-50014950-ccaf-4773-89ce-a3f1d4eb3ef1 service nova] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:49:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4d94665f-4659-48a4-85a5-66090cd23767 req-50014950-ccaf-4773-89ce-a3f1d4eb3ef1 service nova] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:49:31 user nova-compute[75080]: DEBUG nova.compute.manager [req-4d94665f-4659-48a4-85a5-66090cd23767 req-50014950-ccaf-4773-89ce-a3f1d4eb3ef1 service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] No waiting events found dispatching network-vif-plugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:49:31 user nova-compute[75080]: WARNING nova.compute.manager [req-4d94665f-4659-48a4-85a5-66090cd23767 req-50014950-ccaf-4773-89ce-a3f1d4eb3ef1 service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Received unexpected event network-vif-plugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 for instance with vm_state rescued and task_state unrescuing.
Dec 05 15:49:31 user nova-compute[75080]: DEBUG nova.compute.manager [req-4d94665f-4659-48a4-85a5-66090cd23767 req-50014950-ccaf-4773-89ce-a3f1d4eb3ef1 service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Received event network-vif-plugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:49:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4d94665f-4659-48a4-85a5-66090cd23767 req-50014950-ccaf-4773-89ce-a3f1d4eb3ef1 service nova] Acquiring lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:49:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4d94665f-4659-48a4-85a5-66090cd23767 req-50014950-ccaf-4773-89ce-a3f1d4eb3ef1 service nova] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:49:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4d94665f-4659-48a4-85a5-66090cd23767 req-50014950-ccaf-4773-89ce-a3f1d4eb3ef1 service nova] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:49:31 user nova-compute[75080]: DEBUG nova.compute.manager [req-4d94665f-4659-48a4-85a5-66090cd23767 req-50014950-ccaf-4773-89ce-a3f1d4eb3ef1 service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] No waiting events found dispatching network-vif-plugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:49:31 user nova-compute[75080]: WARNING nova.compute.manager [req-4d94665f-4659-48a4-85a5-66090cd23767 req-50014950-ccaf-4773-89ce-a3f1d4eb3ef1 service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Received unexpected event network-vif-plugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 for instance with vm_state rescued and task_state unrescuing.
Dec 05 15:49:31 user nova-compute[75080]: DEBUG nova.compute.manager [req-4d94665f-4659-48a4-85a5-66090cd23767 req-50014950-ccaf-4773-89ce-a3f1d4eb3ef1 service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Received event network-vif-unplugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:49:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4d94665f-4659-48a4-85a5-66090cd23767 req-50014950-ccaf-4773-89ce-a3f1d4eb3ef1 service nova] Acquiring lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:49:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4d94665f-4659-48a4-85a5-66090cd23767 req-50014950-ccaf-4773-89ce-a3f1d4eb3ef1 service nova] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:49:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4d94665f-4659-48a4-85a5-66090cd23767 req-50014950-ccaf-4773-89ce-a3f1d4eb3ef1 service nova] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:49:31 user nova-compute[75080]: DEBUG nova.compute.manager [req-4d94665f-4659-48a4-85a5-66090cd23767 req-50014950-ccaf-4773-89ce-a3f1d4eb3ef1 service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] No waiting events found dispatching network-vif-unplugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:49:31 user nova-compute[75080]: WARNING nova.compute.manager [req-4d94665f-4659-48a4-85a5-66090cd23767 req-50014950-ccaf-4773-89ce-a3f1d4eb3ef1 service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Received unexpected event network-vif-unplugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 for instance with vm_state rescued and task_state unrescuing.
Dec 05 15:49:31 user nova-compute[75080]: DEBUG nova.compute.manager [req-4d94665f-4659-48a4-85a5-66090cd23767 req-50014950-ccaf-4773-89ce-a3f1d4eb3ef1 service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Received event network-vif-plugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:49:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4d94665f-4659-48a4-85a5-66090cd23767 req-50014950-ccaf-4773-89ce-a3f1d4eb3ef1 service nova] Acquiring lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:49:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4d94665f-4659-48a4-85a5-66090cd23767 req-50014950-ccaf-4773-89ce-a3f1d4eb3ef1 service nova] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:49:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4d94665f-4659-48a4-85a5-66090cd23767 req-50014950-ccaf-4773-89ce-a3f1d4eb3ef1 service nova] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:49:31 user nova-compute[75080]: DEBUG nova.compute.manager [req-4d94665f-4659-48a4-85a5-66090cd23767 req-50014950-ccaf-4773-89ce-a3f1d4eb3ef1 service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] No waiting events found dispatching network-vif-plugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:49:31 user nova-compute[75080]: WARNING nova.compute.manager [req-4d94665f-4659-48a4-85a5-66090cd23767 req-50014950-ccaf-4773-89ce-a3f1d4eb3ef1 service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Received unexpected event network-vif-plugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 for instance with vm_state rescued and task_state unrescuing.
Dec 05 15:49:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:49:32 user nova-compute[75080]: DEBUG nova.compute.manager [req-93b01f51-cca3-45a6-80d9-5dae89b1bab0 req-2881034b-abb5-456e-8756-4105a8ef4121 service nova] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Received event network-changed-6c68c41a-8fa4-4ef2-afbb-800a9663e868 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:49:32 user nova-compute[75080]: DEBUG nova.compute.manager [req-93b01f51-cca3-45a6-80d9-5dae89b1bab0 req-2881034b-abb5-456e-8756-4105a8ef4121 service nova] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Refreshing instance network info cache due to event network-changed-6c68c41a-8fa4-4ef2-afbb-800a9663e868. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:49:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-93b01f51-cca3-45a6-80d9-5dae89b1bab0 req-2881034b-abb5-456e-8756-4105a8ef4121 service nova] Acquiring lock "refresh_cache-cab67ec5-c075-4f31-a10f-f256d52608ab" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:49:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-93b01f51-cca3-45a6-80d9-5dae89b1bab0 req-2881034b-abb5-456e-8756-4105a8ef4121 service nova] Acquired lock "refresh_cache-cab67ec5-c075-4f31-a10f-f256d52608ab" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:49:32 user nova-compute[75080]: DEBUG nova.network.neutron [req-93b01f51-cca3-45a6-80d9-5dae89b1bab0 req-2881034b-abb5-456e-8756-4105a8ef4121 service nova] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Refreshing network info cache for port 6c68c41a-8fa4-4ef2-afbb-800a9663e868 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:49:32 user nova-compute[75080]: DEBUG nova.network.neutron [req-93b01f51-cca3-45a6-80d9-5dae89b1bab0 req-2881034b-abb5-456e-8756-4105a8ef4121 service nova] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Updated VIF entry in instance network info cache for port 6c68c41a-8fa4-4ef2-afbb-800a9663e868. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:49:32 user nova-compute[75080]: DEBUG nova.network.neutron [req-93b01f51-cca3-45a6-80d9-5dae89b1bab0 req-2881034b-abb5-456e-8756-4105a8ef4121 service nova] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Updating instance_info_cache with network_info: [{"id": "6c68c41a-8fa4-4ef2-afbb-800a9663e868", "address": "fa:16:3e:af:4e:3f", "network": {"id": "3389ea5c-1ba8-4cc0-89ea-ab4f0b9be1a0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1976501028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb64f100cd174858a9bb5c4fc546f361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c68c41a-8f", "ovs_interfaceid": "6c68c41a-8fa4-4ef2-afbb-800a9663e868", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:49:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-93b01f51-cca3-45a6-80d9-5dae89b1bab0 req-2881034b-abb5-456e-8756-4105a8ef4121 service nova] Releasing lock "refresh_cache-cab67ec5-c075-4f31-a10f-f256d52608ab" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:49:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:49:33 user nova-compute[75080]: DEBUG nova.compute.manager [req-1cc0ad02-0b8d-4897-9f49-5ee3828186b9 req-bcaf9ff9-dd7e-4e21-b141-77a7736a4cc3 service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Received event network-vif-plugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:49:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-1cc0ad02-0b8d-4897-9f49-5ee3828186b9 req-bcaf9ff9-dd7e-4e21-b141-77a7736a4cc3 service nova] Acquiring lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:49:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-1cc0ad02-0b8d-4897-9f49-5ee3828186b9 req-bcaf9ff9-dd7e-4e21-b141-77a7736a4cc3 service nova] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:49:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-1cc0ad02-0b8d-4897-9f49-5ee3828186b9 req-bcaf9ff9-dd7e-4e21-b141-77a7736a4cc3 service nova] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:49:33 user nova-compute[75080]: DEBUG nova.compute.manager [req-1cc0ad02-0b8d-4897-9f49-5ee3828186b9 req-bcaf9ff9-dd7e-4e21-b141-77a7736a4cc3 service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] No waiting events found dispatching network-vif-plugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:49:33 user nova-compute[75080]: WARNING nova.compute.manager [req-1cc0ad02-0b8d-4897-9f49-5ee3828186b9 req-bcaf9ff9-dd7e-4e21-b141-77a7736a4cc3 service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Received unexpected event network-vif-plugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 for instance with vm_state rescued and task_state unrescuing.
Dec 05 15:49:33 user nova-compute[75080]: DEBUG nova.compute.manager [req-1cc0ad02-0b8d-4897-9f49-5ee3828186b9 req-bcaf9ff9-dd7e-4e21-b141-77a7736a4cc3 service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Received event network-vif-plugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:49:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-1cc0ad02-0b8d-4897-9f49-5ee3828186b9 req-bcaf9ff9-dd7e-4e21-b141-77a7736a4cc3 service nova] Acquiring lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:49:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-1cc0ad02-0b8d-4897-9f49-5ee3828186b9 req-bcaf9ff9-dd7e-4e21-b141-77a7736a4cc3 service nova] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:49:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-1cc0ad02-0b8d-4897-9f49-5ee3828186b9 req-bcaf9ff9-dd7e-4e21-b141-77a7736a4cc3 service nova] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:49:33 user nova-compute[75080]: DEBUG nova.compute.manager [req-1cc0ad02-0b8d-4897-9f49-5ee3828186b9 req-bcaf9ff9-dd7e-4e21-b141-77a7736a4cc3 service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] No waiting events found dispatching network-vif-plugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:49:33 user nova-compute[75080]: WARNING nova.compute.manager [req-1cc0ad02-0b8d-4897-9f49-5ee3828186b9 req-bcaf9ff9-dd7e-4e21-b141-77a7736a4cc3 service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Received unexpected event network-vif-plugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 for instance with vm_state rescued and task_state unrescuing.
Dec 05 15:49:33 user nova-compute[75080]: DEBUG nova.compute.manager [None req-c05e880b-e6e0-4fcf-a002-ce82ad4ba518 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:49:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2e81366b-9f16-4c9d-9261-f8faa436dbbb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Acquiring lock "8a97a6c4-8486-41be-b919-82ebf61771eb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:49:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2e81366b-9f16-4c9d-9261-f8faa436dbbb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "8a97a6c4-8486-41be-b919-82ebf61771eb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:49:33 user nova-compute[75080]: INFO nova.compute.manager [None req-2e81366b-9f16-4c9d-9261-f8faa436dbbb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Detaching volume 2ab5adf1-f739-46e7-a96d-43f407784aff
Dec 05 15:49:33 user nova-compute[75080]: INFO nova.virt.block_device [None req-2e81366b-9f16-4c9d-9261-f8faa436dbbb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Attempting to driver detach volume 2ab5adf1-f739-46e7-a96d-43f407784aff from mountpoint /dev/vdb
Dec 05 15:49:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2e81366b-9f16-4c9d-9261-f8faa436dbbb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Attempting to detach device vdb from instance 8a97a6c4-8486-41be-b919-82ebf61771eb from the persistent domain config. {{(pid=75080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 15:49:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-2e81366b-9f16-4c9d-9261-f8faa436dbbb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:49:33 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:49:33 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 15:49:33 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:49:33 user nova-compute[75080]:   <serial>2ab5adf1-f739-46e7-a96d-43f407784aff</serial>
Dec 05 15:49:33 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 15:49:33 user nova-compute[75080]: </disk>
Dec 05 15:49:33 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:49:33 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-2e81366b-9f16-4c9d-9261-f8faa436dbbb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Successfully detached device vdb from instance 8a97a6c4-8486-41be-b919-82ebf61771eb from the persistent domain config.
Dec 05 15:49:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2e81366b-9f16-4c9d-9261-f8faa436dbbb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8a97a6c4-8486-41be-b919-82ebf61771eb from the live domain config. {{(pid=75080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 15:49:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-2e81366b-9f16-4c9d-9261-f8faa436dbbb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:49:33 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:49:33 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 15:49:33 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:49:33 user nova-compute[75080]:   <serial>2ab5adf1-f739-46e7-a96d-43f407784aff</serial>
Dec 05 15:49:33 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 15:49:33 user nova-compute[75080]: </disk>
Dec 05 15:49:33 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:49:34 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2e81366b-9f16-4c9d-9261-f8faa436dbbb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8a97a6c4-8486-41be-b919-82ebf61771eb {{(pid=75080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 15:49:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Acquiring lock "cab67ec5-c075-4f31-a10f-f256d52608ab" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:49:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Lock "cab67ec5-c075-4f31-a10f-f256d52608ab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:49:36 user nova-compute[75080]: DEBUG nova.objects.instance [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Lazy-loading 'flavor' on Instance uuid cab67ec5-c075-4f31-a10f-f256d52608ab {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:49:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Lock "cab67ec5-c075-4f31-a10f-f256d52608ab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:49:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Acquiring lock "cab67ec5-c075-4f31-a10f-f256d52608ab" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:49:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Lock "cab67ec5-c075-4f31-a10f-f256d52608ab" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:49:36 user nova-compute[75080]: INFO nova.compute.manager [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Attaching volume 2c1d420f-9f47-46fb-9ae7-38407036f71a to /dev/vdb
Dec 05 15:49:36 user nova-compute[75080]: DEBUG os_brick.utils [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:49:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[07079b63-e785-448a-8700-465bd53018ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae1b2dc-4419-46ff-9666-57dbec36c217]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4ce464-2161-4f67-9efa-bf671f3a5afc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e777c4f6-5504-4d8f-9afc-87db0635f6a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:49:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:49:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:49:36 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:49:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f25057-1106-4685-bfed-e69661bd6cf2]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:37 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:49:37 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:49:37 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:49:37 user nova-compute[75080]: DEBUG os_brick.utils [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:49:37 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Updating existing volume attachment record: 12270f9f-31c8-4f00-9c71-9ba2cfa4913c {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:49:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:49:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ofDmnYVJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:49:46 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:49:46 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:49:46 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:49:46 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:49:46 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:49:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0657ac75-5a9c-432a-be90-29dee9179b34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:49:46 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c811e2-9c20-4642-9341-5b807d486477]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a] added
Dec 05 15:49:46 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a966d396-d3c9-4942-b960-2967cd2197a0]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[18dbea8a-553f-41a7-9d5a-0c82899b0d9b]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ofDmnYVJ {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ofDmnYVJ" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78c7da0-1b9b-43b4-b1f1-2055aac57dc9]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ofDmnYVJ'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[807bfaca-cb45-4bfd-ad4d-ce7ad6ccaa34]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5469c5b4-2c4c-4d6a-a563-d0812cfdd6af]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff (non-flash)
Dec 05 15:49:46 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff (non-flash)
Dec 05 15:49:46 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d72b556-3081-4030-9333-da08dba04717]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a, portal: 172.16.0.220,3260]
Dec 05 15:49:46 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a, portal: 172.16.0.220,3260] successful.
Dec 05 15:49:46 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ceb78b9-88cd-44f7-9069-3f1398eaac5c]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0524f9cd-0151-4685-9262-fbb760ad8e6c]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff (non-flash)
Dec 05 15:49:46 user nova-compute[75080]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a (non-flash)
Dec 05 15:49:46 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff (non-flash)
Dec 05 15:49:46 user nova-compute[75080]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a (non-flash)
Dec 05 15:49:46 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af08193-2288-4f9a-a89e-c436abce36d2]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:46 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: None {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:49:47 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:49:47 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ofDmnYVJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:49:47 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:49:47 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23037326236316235', 'path': '/dev/sdc'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:49:47 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037326236316235', 'path': '/dev/sdc'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:49:47 user nova-compute[75080]: DEBUG nova.objects.instance [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Lazy-loading 'flavor' on Instance uuid cab67ec5-c075-4f31-a10f-f256d52608ab {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:49:47 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 15:49:47 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:49:47 user nova-compute[75080]:   <source dev="/dev/sdc"/>
Dec 05 15:49:47 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:49:47 user nova-compute[75080]:   <serial>2c1d420f-9f47-46fb-9ae7-38407036f71a</serial>
Dec 05 15:49:47 user nova-compute[75080]: </disk>
Dec 05 15:49:47 user nova-compute[75080]:  {{(pid=75080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 15:49:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:49:48 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:49:48 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:49:48 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] No VIF found with MAC fa:16:3e:af:4e:3f, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:49:48 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-adc2d8e9-00f4-49f9-b0cc-afd2da0af685 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Lock "cab67ec5-c075-4f31-a10f-f256d52608ab" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.473s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:49:48 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:49:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-88f91d26-b31a-42fe-9e93-776cb103b6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Acquiring lock "cab67ec5-c075-4f31-a10f-f256d52608ab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:49:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-88f91d26-b31a-42fe-9e93-776cb103b6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Lock "cab67ec5-c075-4f31-a10f-f256d52608ab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:49:49 user nova-compute[75080]: INFO nova.compute.manager [None req-88f91d26-b31a-42fe-9e93-776cb103b6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Detaching volume 2c1d420f-9f47-46fb-9ae7-38407036f71a
Dec 05 15:49:49 user nova-compute[75080]: INFO nova.virt.block_device [None req-88f91d26-b31a-42fe-9e93-776cb103b6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Attempting to driver detach volume 2c1d420f-9f47-46fb-9ae7-38407036f71a from mountpoint /dev/vdb
Dec 05 15:49:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-88f91d26-b31a-42fe-9e93-776cb103b6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Attempting to detach device vdb from instance cab67ec5-c075-4f31-a10f-f256d52608ab from the persistent domain config. {{(pid=75080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 15:49:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-88f91d26-b31a-42fe-9e93-776cb103b6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:49:49 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:49:49 user nova-compute[75080]:   <source dev="/dev/sdc"/>
Dec 05 15:49:49 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:49:49 user nova-compute[75080]:   <serial>2c1d420f-9f47-46fb-9ae7-38407036f71a</serial>
Dec 05 15:49:49 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 15:49:49 user nova-compute[75080]: </disk>
Dec 05 15:49:49 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:49:49 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-88f91d26-b31a-42fe-9e93-776cb103b6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Successfully detached device vdb from instance cab67ec5-c075-4f31-a10f-f256d52608ab from the persistent domain config.
Dec 05 15:49:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-88f91d26-b31a-42fe-9e93-776cb103b6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cab67ec5-c075-4f31-a10f-f256d52608ab from the live domain config. {{(pid=75080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 15:49:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-88f91d26-b31a-42fe-9e93-776cb103b6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:49:49 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:49:49 user nova-compute[75080]:   <source dev="/dev/sdc"/>
Dec 05 15:49:49 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:49:49 user nova-compute[75080]:   <serial>2c1d420f-9f47-46fb-9ae7-38407036f71a</serial>
Dec 05 15:49:49 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 15:49:49 user nova-compute[75080]: </disk>
Dec 05 15:49:49 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:49:49 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-88f91d26-b31a-42fe-9e93-776cb103b6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cab67ec5-c075-4f31-a10f-f256d52608ab {{(pid=75080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 15:49:50 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:49:51 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:49:51 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:49:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:49:53 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:49:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:49:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:49:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:49:53 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:49:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:53 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:54 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-2e81366b-9f16-4c9d-9261-f8faa436dbbb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8a97a6c4-8486-41be-b919-82ebf61771eb is timed out.
Dec 05 15:49:54 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-2e81366b-9f16-4c9d-9261-f8faa436dbbb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Successfully detached device vdb from instance 8a97a6c4-8486-41be-b919-82ebf61771eb from the live domain config.
Dec 05 15:49:54 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e81366b-9f16-4c9d-9261-f8faa436dbbb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e81366b-9f16-4c9d-9261-f8faa436dbbb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JCUvcFZo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:49:54 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-2e81366b-9f16-4c9d-9261-f8faa436dbbb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:49:54 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-2e81366b-9f16-4c9d-9261-f8faa436dbbb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-2e81366b-9f16-4c9d-9261-f8faa436dbbb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6a08ff-769c-4616-8ccd-c4af24bf25e6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e81366b-9f16-4c9d-9261-f8faa436dbbb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:49:54 user nova-compute[75080]: No targets found.
Dec 05 15:49:54 user nova-compute[75080]: iSNS:
Dec 05 15:49:54 user nova-compute[75080]: No targets found.
Dec 05 15:49:54 user nova-compute[75080]: STATIC:
Dec 05 15:49:54 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a
Dec 05 15:49:54 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:49:54 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:49:54 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff
Dec 05 15:49:54 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:49:54 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:49:54 user nova-compute[75080]: FIRMWARE:
Dec 05 15:49:54 user nova-compute[75080]: No targets found.
Dec 05 15:49:54 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e81366b-9f16-4c9d-9261-f8faa436dbbb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:49:54 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:49:54 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e81366b-9f16-4c9d-9261-f8faa436dbbb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a750ecee-f150-4453-82db-4a283f3072b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad01adf8-dec6-4a17-9396-a8b241ee131b]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e81366b-9f16-4c9d-9261-f8faa436dbbb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff (non-flash)
Dec 05 15:49:54 user nova-compute[75080]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a (non-flash)
Dec 05 15:49:54 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e81366b-9f16-4c9d-9261-f8faa436dbbb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff (non-flash)
Dec 05 15:49:54 user nova-compute[75080]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a (non-flash)
Dec 05 15:49:54 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e81366b-9f16-4c9d-9261-f8faa436dbbb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f665c1f6200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff'): ({'sdb'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-2e81366b-9f16-4c9d-9261-f8faa436dbbb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Removing single pathed devices sdb {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9413a196-23df-4bc5-892c-e7a11d8141f7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f2d7e0-97d3-4b64-8338-c0ed18e7e42a]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-2e81366b-9f16-4c9d-9261-f8faa436dbbb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Flushing IO for device /dev/sdb {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5f2276-6058-49e8-ad87-c69e4b2879a9]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-2e81366b-9f16-4c9d-9261-f8faa436dbbb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f1a89b-4fa6-4340-80e1-414bd82f3337]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-2e81366b-9f16-4c9d-9261-f8faa436dbbb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-2e81366b-9f16-4c9d-9261-f8faa436dbbb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e81366b-9f16-4c9d-9261-f8faa436dbbb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a30b02-4ffd-4979-9b55-00516dbfd606]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e81366b-9f16-4c9d-9261-f8faa436dbbb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb800b05-2db2-4f45-ac2b-fc426dacfd29]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e81366b-9f16-4c9d-9261-f8faa436dbbb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff, portal: 172.16.0.220,3260]
Dec 05 15:49:54 user nova-compute[75080]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff, portal: 172.16.0.220,3260] successful.
Dec 05 15:49:54 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ab5adf1-f739-46e7-a96d-43f407784aff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95a6dce-efc2-4bb0-993e-ea152cf593ab]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e81366b-9f16-4c9d-9261-f8faa436dbbb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-2e81366b-9f16-4c9d-9261-f8faa436dbbb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e81366b-9f16-4c9d-9261-f8faa436dbbb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] <== disconnect_volume: return (350ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e81366b-9f16-4c9d-9261-f8faa436dbbb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab67ec5-c075-4f31-a10f-f256d52608ab/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab67ec5-c075-4f31-a10f-f256d52608ab/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab67ec5-c075-4f31-a10f-f256d52608ab/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:49:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab67ec5-c075-4f31-a10f-f256d52608ab/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:49:55 user nova-compute[75080]: DEBUG nova.objects.instance [None req-2e81366b-9f16-4c9d-9261-f8faa436dbbb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lazy-loading 'flavor' on Instance uuid 8a97a6c4-8486-41be-b919-82ebf61771eb {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:49:55 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:49:55 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:49:55 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=8542MB free_disk=24.919490814208984GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:49:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:49:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:49:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2e81366b-9f16-4c9d-9261-f8faa436dbbb tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "8a97a6c4-8486-41be-b919-82ebf61771eb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.073s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:49:55 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance db0fde77-eb40-4acb-93f7-66b5b76c8eea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:49:55 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 8608d2cf-476d-43b8-a124-c44507459a1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:49:55 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 8a97a6c4-8486-41be-b919-82ebf61771eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:49:55 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance cab67ec5-c075-4f31-a10f-f256d52608ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:49:55 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:49:55 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:49:56 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:49:56 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:49:56 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:49:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.263s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:49:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:49:58 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:49:58 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:49:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-8608d2cf-476d-43b8-a124-c44507459a1e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:49:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-8608d2cf-476d-43b8-a124-c44507459a1e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:49:58 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 15:49:58 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Updating instance_info_cache with network_info: [{"id": "9a4d35f3-f184-49ba-b94d-5fcdd955f572", "address": "fa:16:3e:22:37:f1", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a4d35f3-f1", "ovs_interfaceid": "9a4d35f3-f184-49ba-b94d-5fcdd955f572", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:49:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-8608d2cf-476d-43b8-a124-c44507459a1e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:49:58 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 15:49:58 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:49:58 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:49:58 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:50:01 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:50:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:50:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:50:03 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:50:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:50:09 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-88f91d26-b31a-42fe-9e93-776cb103b6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cab67ec5-c075-4f31-a10f-f256d52608ab is timed out.
Dec 05 15:50:09 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-88f91d26-b31a-42fe-9e93-776cb103b6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Successfully detached device vdb from instance cab67ec5-c075-4f31-a10f-f256d52608ab from the live domain config.
Dec 05 15:50:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88f91d26-b31a-42fe-9e93-776cb103b6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:50:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f91d26-b31a-42fe-9e93-776cb103b6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ofDmnYVJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:50:09 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-88f91d26-b31a-42fe-9e93-776cb103b6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:50:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-88f91d26-b31a-42fe-9e93-776cb103b6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:50:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-88f91d26-b31a-42fe-9e93-776cb103b6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:50:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:50:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:50:09 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c56ca5-73db-46f9-8b38-be1ba0a4a0a7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:50:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f91d26-b31a-42fe-9e93-776cb103b6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:50:09 user nova-compute[75080]: No targets found.
Dec 05 15:50:09 user nova-compute[75080]: iSNS:
Dec 05 15:50:09 user nova-compute[75080]: No targets found.
Dec 05 15:50:09 user nova-compute[75080]: STATIC:
Dec 05 15:50:09 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a
Dec 05 15:50:09 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:50:09 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:50:09 user nova-compute[75080]: FIRMWARE:
Dec 05 15:50:09 user nova-compute[75080]: No targets found.
Dec 05 15:50:09 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:50:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f91d26-b31a-42fe-9e93-776cb103b6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:50:09 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:50:09 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:50:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f91d26-b31a-42fe-9e93-776cb103b6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:50:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:50:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:50:09 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a20b570-3ca1-45f8-8932-da4d75ac81bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:50:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:50:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:50:09 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3521c582-8a81-4576-931c-a71f70227b72]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:50:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f91d26-b31a-42fe-9e93-776cb103b6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a (non-flash)
Dec 05 15:50:09 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:50:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f91d26-b31a-42fe-9e93-776cb103b6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a (non-flash)
Dec 05 15:50:09 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:50:09 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f91d26-b31a-42fe-9e93-776cb103b6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f665c135240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a'): ({'sdc'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:50:09 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-88f91d26-b31a-42fe-9e93-776cb103b6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Removing single pathed devices sdc {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:50:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:50:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:50:09 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08c7903-c151-4863-a52f-8a96d67558d6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:50:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:50:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:50:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba3be11-3b44-427e-bdcc-531ee5a283d6]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:50:10 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-88f91d26-b31a-42fe-9e93-776cb103b6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Flushing IO for device /dev/sdc {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:50:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:50:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:50:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a5ebb1-107f-437d-861a-0b71e6931f0d]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:50:10 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-88f91d26-b31a-42fe-9e93-776cb103b6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:50:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:50:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:50:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0479d4-7a26-44b3-b242-c560c7db2c92]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:50:10 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-88f91d26-b31a-42fe-9e93-776cb103b6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:50:10 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-88f91d26-b31a-42fe-9e93-776cb103b6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] SCSI volumes sdc have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:50:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f91d26-b31a-42fe-9e93-776cb103b6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:50:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:50:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:50:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[56731741-a21e-441f-b4ba-a4940ec56bf0]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:50:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f91d26-b31a-42fe-9e93-776cb103b6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:50:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:50:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:50:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4a8dfe-5c60-462a-ada5-ede41c254bcf]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:50:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f91d26-b31a-42fe-9e93-776cb103b6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a, portal: 172.16.0.220,3260]
Dec 05 15:50:10 user nova-compute[75080]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a, portal: 172.16.0.220,3260] successful.
Dec 05 15:50:10 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:50:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:50:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1d420f-9f47-46fb-9ae7-38407036f71a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:50:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9ffedf-417b-4a09-ad0e-72dce3dd9135]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:50:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f91d26-b31a-42fe-9e93-776cb103b6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:50:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-88f91d26-b31a-42fe-9e93-776cb103b6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:50:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f91d26-b31a-42fe-9e93-776cb103b6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] <== disconnect_volume: return (308ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:50:10 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88f91d26-b31a-42fe-9e93-776cb103b6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:50:11 user nova-compute[75080]: DEBUG nova.objects.instance [None req-88f91d26-b31a-42fe-9e93-776cb103b6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Lazy-loading 'flavor' on Instance uuid cab67ec5-c075-4f31-a10f-f256d52608ab {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:50:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-88f91d26-b31a-42fe-9e93-776cb103b6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Lock "cab67ec5-c075-4f31-a10f-f256d52608ab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.718s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:50:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:50:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:50:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 15:50:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:50:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:50:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:50:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:50:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:50:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:50:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 15:50:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:50:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:50:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:50:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Acquiring lock "8a97a6c4-8486-41be-b919-82ebf61771eb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:50:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "8a97a6c4-8486-41be-b919-82ebf61771eb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:50:26 user nova-compute[75080]: DEBUG nova.objects.instance [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lazy-loading 'flavor' on Instance uuid 8a97a6c4-8486-41be-b919-82ebf61771eb {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:50:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "8a97a6c4-8486-41be-b919-82ebf61771eb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:50:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Acquiring lock "8a97a6c4-8486-41be-b919-82ebf61771eb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:50:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "8a97a6c4-8486-41be-b919-82ebf61771eb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:50:27 user nova-compute[75080]: INFO nova.compute.manager [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Attaching volume 405d5204-f332-42b9-9d12-ab0e81f8c117 to /dev/vdb
Dec 05 15:50:27 user nova-compute[75080]: DEBUG os_brick.utils [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:50:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:50:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:50:27 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f89d0d7-a4d8-4fcb-911a-af9b0d4628c4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:50:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:50:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:50:27 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b8b49b-8da7-4b34-9a3b-c9a4321510d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:50:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:50:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:50:27 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3867421a-ff25-4369-bc96-4cd96fb46bc5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:50:27 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c636570-8a78-40de-b545-2face84595a9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:50:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:50:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:50:27 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:50:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:50:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:50:27 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:50:27 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba75acd-1724-40d2-96f2-0625e9bfeb7d]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:50:27 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:50:27 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:50:27 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:50:27 user nova-compute[75080]: DEBUG os_brick.utils [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:50:27 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Updating existing volume attachment record: 26c8000f-6a10-46e1-bbe1-0c6ae6b386b5 {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:50:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:50:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:50:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:50:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:50:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 15:50:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:50:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:50:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mxzcHuyE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:50:36 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:50:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:50:36 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:50:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:50:36 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:50:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117 -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f53a54-a0f3-4eaf-8968-cec543a912cd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:50:36 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117 -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cac89f9-a7d5-4e77-abeb-277f204c48cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117] added
Dec 05 15:50:36 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d97f33-461e-4cba-9f68-cb8016275cd7]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1cd059-7c69-419f-ad5d-ce945e4759f8]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mxzcHuyE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mxzcHuyE" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5374598d-4245-48c2-9e0e-a08dc41f1504]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mxzcHuyE'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2111938b-08c2-4559-96ae-08debe29c0bf]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[33641e6b-189e-4be8-8371-f03c02b83b87]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 05 15:50:36 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 05 15:50:36 user nova-compute[75080]:  {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:50:36 user nova-compute[75080]: WARNING os_brick.initiator.connectors.iscsi [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 05 15:50:36 user nova-compute[75080]: 
Dec 05 15:50:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117 -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7922c5e0-95b8-4dc6-8534-5c6521b8aa6b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117, portal: 172.16.0.220,3260]
Dec 05 15:50:36 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117, portal: 172.16.0.220,3260] successful.
Dec 05 15:50:36 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a700544b-bcdf-4534-b3c3-d0d6ad66388f]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a128fe-6e33-467d-bd8e-0149baa89c18]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117 (non-flash)
Dec 05 15:50:36 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117 (non-flash)
Dec 05 15:50:36 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b83e7ef-f38d-4ac6-a4f0-634f64808332]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:50:36 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:50:37 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:50:37 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mxzcHuyE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:50:37 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:50:37 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '26237633130383432', 'path': '/dev/sdb'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:50:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237633130383432', 'path': '/dev/sdb'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:50:37 user nova-compute[75080]: DEBUG nova.objects.instance [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lazy-loading 'flavor' on Instance uuid 8a97a6c4-8486-41be-b919-82ebf61771eb {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:50:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 15:50:37 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:50:37 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 15:50:37 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:50:37 user nova-compute[75080]:   <serial>405d5204-f332-42b9-9d12-ab0e81f8c117</serial>
Dec 05 15:50:37 user nova-compute[75080]: </disk>
Dec 05 15:50:37 user nova-compute[75080]:  {{(pid=75080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 15:50:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:50:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:50:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:50:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] No VIF found with MAC fa:16:3e:2f:30:8f, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:50:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a7e00f14-e1c8-4a54-8030-257e3c039fa4 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "8a97a6c4-8486-41be-b919-82ebf61771eb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.974s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:50:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-cf187160-8cac-4076-a08b-014031a724ea tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Acquiring lock "8a97a6c4-8486-41be-b919-82ebf61771eb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:50:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-cf187160-8cac-4076-a08b-014031a724ea tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "8a97a6c4-8486-41be-b919-82ebf61771eb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:50:40 user nova-compute[75080]: INFO nova.compute.manager [None req-cf187160-8cac-4076-a08b-014031a724ea tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Detaching volume 405d5204-f332-42b9-9d12-ab0e81f8c117
Dec 05 15:50:40 user nova-compute[75080]: INFO nova.virt.block_device [None req-cf187160-8cac-4076-a08b-014031a724ea tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Attempting to driver detach volume 405d5204-f332-42b9-9d12-ab0e81f8c117 from mountpoint /dev/vdb
Dec 05 15:50:40 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-cf187160-8cac-4076-a08b-014031a724ea tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Attempting to detach device vdb from instance 8a97a6c4-8486-41be-b919-82ebf61771eb from the persistent domain config. {{(pid=75080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 15:50:40 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-cf187160-8cac-4076-a08b-014031a724ea tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:50:40 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:50:40 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 15:50:40 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:50:40 user nova-compute[75080]:   <serial>405d5204-f332-42b9-9d12-ab0e81f8c117</serial>
Dec 05 15:50:40 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 15:50:40 user nova-compute[75080]: </disk>
Dec 05 15:50:40 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:50:40 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-cf187160-8cac-4076-a08b-014031a724ea tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Successfully detached device vdb from instance 8a97a6c4-8486-41be-b919-82ebf61771eb from the persistent domain config.
Dec 05 15:50:40 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-cf187160-8cac-4076-a08b-014031a724ea tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8a97a6c4-8486-41be-b919-82ebf61771eb from the live domain config. {{(pid=75080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 15:50:40 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-cf187160-8cac-4076-a08b-014031a724ea tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:50:40 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:50:40 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 15:50:40 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:50:40 user nova-compute[75080]:   <serial>405d5204-f332-42b9-9d12-ab0e81f8c117</serial>
Dec 05 15:50:40 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 15:50:40 user nova-compute[75080]: </disk>
Dec 05 15:50:40 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:50:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-cf187160-8cac-4076-a08b-014031a724ea tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8a97a6c4-8486-41be-b919-82ebf61771eb {{(pid=75080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 15:50:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:50:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:50:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-4f1477ee-86ba-4867-a7ea-e22d41c86f22 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Acquiring lock "cab67ec5-c075-4f31-a10f-f256d52608ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:50:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-4f1477ee-86ba-4867-a7ea-e22d41c86f22 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Lock "cab67ec5-c075-4f31-a10f-f256d52608ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:50:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-4f1477ee-86ba-4867-a7ea-e22d41c86f22 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Acquiring lock "cab67ec5-c075-4f31-a10f-f256d52608ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:50:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-4f1477ee-86ba-4867-a7ea-e22d41c86f22 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Lock "cab67ec5-c075-4f31-a10f-f256d52608ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:50:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-4f1477ee-86ba-4867-a7ea-e22d41c86f22 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Lock "cab67ec5-c075-4f31-a10f-f256d52608ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:50:44 user nova-compute[75080]: INFO nova.compute.manager [None req-4f1477ee-86ba-4867-a7ea-e22d41c86f22 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Terminating instance
Dec 05 15:50:44 user nova-compute[75080]: DEBUG nova.compute.manager [None req-4f1477ee-86ba-4867-a7ea-e22d41c86f22 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:50:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:50:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:50:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:50:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:50:44 user nova-compute[75080]: DEBUG nova.compute.manager [req-91fef581-2539-4f30-a497-cbaa64e0cb5d req-71401704-89ff-4aa7-91f9-d30fc7534081 service nova] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Received event network-vif-unplugged-6c68c41a-8fa4-4ef2-afbb-800a9663e868 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:50:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-91fef581-2539-4f30-a497-cbaa64e0cb5d req-71401704-89ff-4aa7-91f9-d30fc7534081 service nova] Acquiring lock "cab67ec5-c075-4f31-a10f-f256d52608ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:50:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-91fef581-2539-4f30-a497-cbaa64e0cb5d req-71401704-89ff-4aa7-91f9-d30fc7534081 service nova] Lock "cab67ec5-c075-4f31-a10f-f256d52608ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:50:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-91fef581-2539-4f30-a497-cbaa64e0cb5d req-71401704-89ff-4aa7-91f9-d30fc7534081 service nova] Lock "cab67ec5-c075-4f31-a10f-f256d52608ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:50:44 user nova-compute[75080]: DEBUG nova.compute.manager [req-91fef581-2539-4f30-a497-cbaa64e0cb5d req-71401704-89ff-4aa7-91f9-d30fc7534081 service nova] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] No waiting events found dispatching network-vif-unplugged-6c68c41a-8fa4-4ef2-afbb-800a9663e868 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:50:44 user nova-compute[75080]: DEBUG nova.compute.manager [req-91fef581-2539-4f30-a497-cbaa64e0cb5d req-71401704-89ff-4aa7-91f9-d30fc7534081 service nova] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Received event network-vif-unplugged-6c68c41a-8fa4-4ef2-afbb-800a9663e868 for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:50:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:50:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:50:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:50:44 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Instance destroyed successfully.
Dec 05 15:50:44 user nova-compute[75080]: DEBUG nova.objects.instance [None req-4f1477ee-86ba-4867-a7ea-e22d41c86f22 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Lazy-loading 'resources' on Instance uuid cab67ec5-c075-4f31-a10f-f256d52608ab {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:50:45 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:50:45 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-4f1477ee-86ba-4867-a7ea-e22d41c86f22 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:47:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-981940042',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-981940042',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-9819400',id=46,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjHhGT2a0mp7RpYEhguaWXdEaqH4OeZC+vOVsKkQXDzL5Yyf/HhpB08v1jwOYuDrOF90ch30BBOP2C2byT2bTX56jsX8t5xpf1wToG5V0r43IohXn/QzCf7r9qQsLZOhA==',key_name='tempest-keypair-1552165815',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:47:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb64f100cd174858a9bb5c4fc546f361',ramdisk_id='',reservation_id='r-58vxyksg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1323289192',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:47:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08f602e3beee49e1814486f23484a48a',uuid=cab67ec5-c075-4f31-a10f-f256d52608ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c68c41a-8fa4-4ef2-afbb-800a9663e868", "address": "fa:16:3e:af:4e:3f", "network": {"id": "3389ea5c-1ba8-4cc0-89ea-ab4f0b9be1a0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1976501028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb64f100cd174858a9bb5c4fc546f361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c68c41a-8f", "ovs_interfaceid": "6c68c41a-8fa4-4ef2-afbb-800a9663e868", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:50:45 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-4f1477ee-86ba-4867-a7ea-e22d41c86f22 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Converting VIF {"id": "6c68c41a-8fa4-4ef2-afbb-800a9663e868", "address": "fa:16:3e:af:4e:3f", "network": {"id": "3389ea5c-1ba8-4cc0-89ea-ab4f0b9be1a0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1976501028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb64f100cd174858a9bb5c4fc546f361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c68c41a-8f", "ovs_interfaceid": "6c68c41a-8fa4-4ef2-afbb-800a9663e868", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:50:45 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-4f1477ee-86ba-4867-a7ea-e22d41c86f22 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:4e:3f,bridge_name='br-int',has_traffic_filtering=True,id=6c68c41a-8fa4-4ef2-afbb-800a9663e868,network=Network(3389ea5c-1ba8-4cc0-89ea-ab4f0b9be1a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c68c41a-8f') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:50:45 user nova-compute[75080]: DEBUG os_vif [None req-4f1477ee-86ba-4867-a7ea-e22d41c86f22 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:4e:3f,bridge_name='br-int',has_traffic_filtering=True,id=6c68c41a-8fa4-4ef2-afbb-800a9663e868,network=Network(3389ea5c-1ba8-4cc0-89ea-ab4f0b9be1a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c68c41a-8f') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:50:45 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:50:45 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c68c41a-8f, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:50:45 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:50:45 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:50:45 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d10a418f-7a8a-49b4-95ea-d163a13029aa) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:50:45 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:50:45 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:50:45 user nova-compute[75080]: INFO os_vif [None req-4f1477ee-86ba-4867-a7ea-e22d41c86f22 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:4e:3f,bridge_name='br-int',has_traffic_filtering=True,id=6c68c41a-8fa4-4ef2-afbb-800a9663e868,network=Network(3389ea5c-1ba8-4cc0-89ea-ab4f0b9be1a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c68c41a-8f')
Dec 05 15:50:45 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-4f1477ee-86ba-4867-a7ea-e22d41c86f22 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Deleting instance files /opt/stack/data/nova/instances/cab67ec5-c075-4f31-a10f-f256d52608ab_del
Dec 05 15:50:45 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-4f1477ee-86ba-4867-a7ea-e22d41c86f22 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Deletion of /opt/stack/data/nova/instances/cab67ec5-c075-4f31-a10f-f256d52608ab_del complete
Dec 05 15:50:45 user nova-compute[75080]: INFO nova.compute.manager [None req-4f1477ee-86ba-4867-a7ea-e22d41c86f22 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Took 1.00 seconds to destroy the instance on the hypervisor.
Dec 05 15:50:45 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-4f1477ee-86ba-4867-a7ea-e22d41c86f22 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:50:45 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:50:45 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:50:45 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:50:45 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:50:45 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:50:45 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:50:45 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:50:45 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:50:45 user nova-compute[75080]: DEBUG nova.compute.manager [req-5d6f25bb-9f55-4c55-bff8-a52153d85f8d req-a22c0ee1-8f1b-448d-9862-7dc0e1cc3141 service nova] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Received event network-vif-deleted-6c68c41a-8fa4-4ef2-afbb-800a9663e868 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:50:45 user nova-compute[75080]: INFO nova.compute.manager [req-5d6f25bb-9f55-4c55-bff8-a52153d85f8d req-a22c0ee1-8f1b-448d-9862-7dc0e1cc3141 service nova] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Neutron deleted interface 6c68c41a-8fa4-4ef2-afbb-800a9663e868; detaching it from the instance and deleting it from the info cache
Dec 05 15:50:45 user nova-compute[75080]: DEBUG nova.network.neutron [req-5d6f25bb-9f55-4c55-bff8-a52153d85f8d req-a22c0ee1-8f1b-448d-9862-7dc0e1cc3141 service nova] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:50:45 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Took 0.80 seconds to deallocate network for instance.
Dec 05 15:50:45 user nova-compute[75080]: DEBUG nova.compute.manager [req-5d6f25bb-9f55-4c55-bff8-a52153d85f8d req-a22c0ee1-8f1b-448d-9862-7dc0e1cc3141 service nova] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Detach interface failed, port_id=6c68c41a-8fa4-4ef2-afbb-800a9663e868, reason: Instance cab67ec5-c075-4f31-a10f-f256d52608ab could not be found. {{(pid=75080) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 15:50:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-4f1477ee-86ba-4867-a7ea-e22d41c86f22 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:50:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-4f1477ee-86ba-4867-a7ea-e22d41c86f22 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:50:46 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-4f1477ee-86ba-4867-a7ea-e22d41c86f22 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:50:46 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-4f1477ee-86ba-4867-a7ea-e22d41c86f22 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:50:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-4f1477ee-86ba-4867-a7ea-e22d41c86f22 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.187s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:50:46 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-4f1477ee-86ba-4867-a7ea-e22d41c86f22 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Deleted allocations for instance cab67ec5-c075-4f31-a10f-f256d52608ab
Dec 05 15:50:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-4f1477ee-86ba-4867-a7ea-e22d41c86f22 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192 tempest-TestServerVolumeAttachScenarioOldVersion-1323289192-project-member] Lock "cab67ec5-c075-4f31-a10f-f256d52608ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.201s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:50:46 user nova-compute[75080]: DEBUG nova.compute.manager [req-5ff76d84-7fce-4d91-85a2-8cbbfe8b6534 req-07e49d43-211b-47e1-88e8-ef32aac1c046 service nova] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Received event network-vif-plugged-6c68c41a-8fa4-4ef2-afbb-800a9663e868 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:50:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5ff76d84-7fce-4d91-85a2-8cbbfe8b6534 req-07e49d43-211b-47e1-88e8-ef32aac1c046 service nova] Acquiring lock "cab67ec5-c075-4f31-a10f-f256d52608ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:50:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5ff76d84-7fce-4d91-85a2-8cbbfe8b6534 req-07e49d43-211b-47e1-88e8-ef32aac1c046 service nova] Lock "cab67ec5-c075-4f31-a10f-f256d52608ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:50:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5ff76d84-7fce-4d91-85a2-8cbbfe8b6534 req-07e49d43-211b-47e1-88e8-ef32aac1c046 service nova] Lock "cab67ec5-c075-4f31-a10f-f256d52608ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:50:46 user nova-compute[75080]: DEBUG nova.compute.manager [req-5ff76d84-7fce-4d91-85a2-8cbbfe8b6534 req-07e49d43-211b-47e1-88e8-ef32aac1c046 service nova] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] No waiting events found dispatching network-vif-plugged-6c68c41a-8fa4-4ef2-afbb-800a9663e868 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:50:46 user nova-compute[75080]: WARNING nova.compute.manager [req-5ff76d84-7fce-4d91-85a2-8cbbfe8b6534 req-07e49d43-211b-47e1-88e8-ef32aac1c046 service nova] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Received unexpected event network-vif-plugged-6c68c41a-8fa4-4ef2-afbb-800a9663e868 for instance with vm_state deleted and task_state None.
Dec 05 15:50:46 user nova-compute[75080]: DEBUG nova.compute.manager [req-5ff76d84-7fce-4d91-85a2-8cbbfe8b6534 req-07e49d43-211b-47e1-88e8-ef32aac1c046 service nova] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Received event network-vif-plugged-6c68c41a-8fa4-4ef2-afbb-800a9663e868 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:50:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5ff76d84-7fce-4d91-85a2-8cbbfe8b6534 req-07e49d43-211b-47e1-88e8-ef32aac1c046 service nova] Acquiring lock "cab67ec5-c075-4f31-a10f-f256d52608ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:50:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5ff76d84-7fce-4d91-85a2-8cbbfe8b6534 req-07e49d43-211b-47e1-88e8-ef32aac1c046 service nova] Lock "cab67ec5-c075-4f31-a10f-f256d52608ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:50:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5ff76d84-7fce-4d91-85a2-8cbbfe8b6534 req-07e49d43-211b-47e1-88e8-ef32aac1c046 service nova] Lock "cab67ec5-c075-4f31-a10f-f256d52608ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:50:46 user nova-compute[75080]: DEBUG nova.compute.manager [req-5ff76d84-7fce-4d91-85a2-8cbbfe8b6534 req-07e49d43-211b-47e1-88e8-ef32aac1c046 service nova] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] No waiting events found dispatching network-vif-plugged-6c68c41a-8fa4-4ef2-afbb-800a9663e868 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:50:46 user nova-compute[75080]: WARNING nova.compute.manager [req-5ff76d84-7fce-4d91-85a2-8cbbfe8b6534 req-07e49d43-211b-47e1-88e8-ef32aac1c046 service nova] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Received unexpected event network-vif-plugged-6c68c41a-8fa4-4ef2-afbb-800a9663e868 for instance with vm_state deleted and task_state None.
Dec 05 15:50:46 user nova-compute[75080]: DEBUG nova.compute.manager [req-5ff76d84-7fce-4d91-85a2-8cbbfe8b6534 req-07e49d43-211b-47e1-88e8-ef32aac1c046 service nova] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Received event network-vif-plugged-6c68c41a-8fa4-4ef2-afbb-800a9663e868 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:50:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5ff76d84-7fce-4d91-85a2-8cbbfe8b6534 req-07e49d43-211b-47e1-88e8-ef32aac1c046 service nova] Acquiring lock "cab67ec5-c075-4f31-a10f-f256d52608ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:50:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5ff76d84-7fce-4d91-85a2-8cbbfe8b6534 req-07e49d43-211b-47e1-88e8-ef32aac1c046 service nova] Lock "cab67ec5-c075-4f31-a10f-f256d52608ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:50:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5ff76d84-7fce-4d91-85a2-8cbbfe8b6534 req-07e49d43-211b-47e1-88e8-ef32aac1c046 service nova] Lock "cab67ec5-c075-4f31-a10f-f256d52608ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:50:46 user nova-compute[75080]: DEBUG nova.compute.manager [req-5ff76d84-7fce-4d91-85a2-8cbbfe8b6534 req-07e49d43-211b-47e1-88e8-ef32aac1c046 service nova] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] No waiting events found dispatching network-vif-plugged-6c68c41a-8fa4-4ef2-afbb-800a9663e868 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:50:46 user nova-compute[75080]: WARNING nova.compute.manager [req-5ff76d84-7fce-4d91-85a2-8cbbfe8b6534 req-07e49d43-211b-47e1-88e8-ef32aac1c046 service nova] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Received unexpected event network-vif-plugged-6c68c41a-8fa4-4ef2-afbb-800a9663e868 for instance with vm_state deleted and task_state None.
Dec 05 15:50:46 user nova-compute[75080]: DEBUG nova.compute.manager [req-5ff76d84-7fce-4d91-85a2-8cbbfe8b6534 req-07e49d43-211b-47e1-88e8-ef32aac1c046 service nova] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Received event network-vif-unplugged-6c68c41a-8fa4-4ef2-afbb-800a9663e868 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:50:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5ff76d84-7fce-4d91-85a2-8cbbfe8b6534 req-07e49d43-211b-47e1-88e8-ef32aac1c046 service nova] Acquiring lock "cab67ec5-c075-4f31-a10f-f256d52608ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:50:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5ff76d84-7fce-4d91-85a2-8cbbfe8b6534 req-07e49d43-211b-47e1-88e8-ef32aac1c046 service nova] Lock "cab67ec5-c075-4f31-a10f-f256d52608ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:50:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5ff76d84-7fce-4d91-85a2-8cbbfe8b6534 req-07e49d43-211b-47e1-88e8-ef32aac1c046 service nova] Lock "cab67ec5-c075-4f31-a10f-f256d52608ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:50:46 user nova-compute[75080]: DEBUG nova.compute.manager [req-5ff76d84-7fce-4d91-85a2-8cbbfe8b6534 req-07e49d43-211b-47e1-88e8-ef32aac1c046 service nova] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] No waiting events found dispatching network-vif-unplugged-6c68c41a-8fa4-4ef2-afbb-800a9663e868 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:50:46 user nova-compute[75080]: WARNING nova.compute.manager [req-5ff76d84-7fce-4d91-85a2-8cbbfe8b6534 req-07e49d43-211b-47e1-88e8-ef32aac1c046 service nova] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Received unexpected event network-vif-unplugged-6c68c41a-8fa4-4ef2-afbb-800a9663e868 for instance with vm_state deleted and task_state None.
Dec 05 15:50:46 user nova-compute[75080]: DEBUG nova.compute.manager [req-5ff76d84-7fce-4d91-85a2-8cbbfe8b6534 req-07e49d43-211b-47e1-88e8-ef32aac1c046 service nova] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Received event network-vif-plugged-6c68c41a-8fa4-4ef2-afbb-800a9663e868 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:50:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5ff76d84-7fce-4d91-85a2-8cbbfe8b6534 req-07e49d43-211b-47e1-88e8-ef32aac1c046 service nova] Acquiring lock "cab67ec5-c075-4f31-a10f-f256d52608ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:50:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5ff76d84-7fce-4d91-85a2-8cbbfe8b6534 req-07e49d43-211b-47e1-88e8-ef32aac1c046 service nova] Lock "cab67ec5-c075-4f31-a10f-f256d52608ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:50:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5ff76d84-7fce-4d91-85a2-8cbbfe8b6534 req-07e49d43-211b-47e1-88e8-ef32aac1c046 service nova] Lock "cab67ec5-c075-4f31-a10f-f256d52608ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:50:46 user nova-compute[75080]: DEBUG nova.compute.manager [req-5ff76d84-7fce-4d91-85a2-8cbbfe8b6534 req-07e49d43-211b-47e1-88e8-ef32aac1c046 service nova] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] No waiting events found dispatching network-vif-plugged-6c68c41a-8fa4-4ef2-afbb-800a9663e868 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:50:46 user nova-compute[75080]: WARNING nova.compute.manager [req-5ff76d84-7fce-4d91-85a2-8cbbfe8b6534 req-07e49d43-211b-47e1-88e8-ef32aac1c046 service nova] [instance: cab67ec5-c075-4f31-a10f-f256d52608ab] Received unexpected event network-vif-plugged-6c68c41a-8fa4-4ef2-afbb-800a9663e868 for instance with vm_state deleted and task_state None.
Dec 05 15:50:49 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:50:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:50:51 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:50:52 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:50:52 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:50:54 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:50:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:50:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:50:54 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:50:54 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:50:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:50:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:50:54 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:50:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:50:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:50:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:50:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:50:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:50:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:50:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:50:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:50:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:50:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:50:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:50:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:50:55 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:50:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:50:56 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:50:56 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:50:56 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=8692MB free_disk=24.945850372314453GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:50:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:50:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:50:56 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance db0fde77-eb40-4acb-93f7-66b5b76c8eea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:50:56 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 8608d2cf-476d-43b8-a124-c44507459a1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:50:56 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 8a97a6c4-8486-41be-b919-82ebf61771eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:50:56 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:50:56 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:50:56 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:50:56 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:50:56 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:50:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.244s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:50:58 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:50:58 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:50:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-8a97a6c4-8486-41be-b919-82ebf61771eb" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:50:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-8a97a6c4-8486-41be-b919-82ebf61771eb" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:50:58 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 15:50:59 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Updating instance_info_cache with network_info: [{"id": "0013f2c2-e337-4c3d-8885-ee027a53e8d8", "address": "fa:16:3e:2f:30:8f", "network": {"id": "236ffb89-7d87-41de-8dac-e36bfb38a2d0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-187610999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9070144481d84c98bdc9063c54a9e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0013f2c2-e3", "ovs_interfaceid": "0013f2c2-e337-4c3d-8885-ee027a53e8d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:50:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-8a97a6c4-8486-41be-b919-82ebf61771eb" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:50:59 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 15:50:59 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:50:59 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:51:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:51:00 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:51:01 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-cf187160-8cac-4076-a08b-014031a724ea tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8a97a6c4-8486-41be-b919-82ebf61771eb is timed out.
Dec 05 15:51:01 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-cf187160-8cac-4076-a08b-014031a724ea tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Successfully detached device vdb from instance 8a97a6c4-8486-41be-b919-82ebf61771eb from the live domain config.
Dec 05 15:51:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf187160-8cac-4076-a08b-014031a724ea tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf187160-8cac-4076-a08b-014031a724ea tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mxzcHuyE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:51:01 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-cf187160-8cac-4076-a08b-014031a724ea tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:51:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-cf187160-8cac-4076-a08b-014031a724ea tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-cf187160-8cac-4076-a08b-014031a724ea tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c67cee9-37a6-43b1-ae81-11d13663b6d8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf187160-8cac-4076-a08b-014031a724ea tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:51:01 user nova-compute[75080]: No targets found.
Dec 05 15:51:01 user nova-compute[75080]: iSNS:
Dec 05 15:51:01 user nova-compute[75080]: No targets found.
Dec 05 15:51:01 user nova-compute[75080]: STATIC:
Dec 05 15:51:01 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117
Dec 05 15:51:01 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:51:01 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:51:01 user nova-compute[75080]: FIRMWARE:
Dec 05 15:51:01 user nova-compute[75080]: No targets found.
Dec 05 15:51:01 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf187160-8cac-4076-a08b-014031a724ea tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:51:01 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:51:01 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf187160-8cac-4076-a08b-014031a724ea tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfebea1-5b6a-4f34-a80e-73e8da58391d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cab056-490f-480e-9a0e-a59c20d0712f]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf187160-8cac-4076-a08b-014031a724ea tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117 (non-flash)
Dec 05 15:51:01 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf187160-8cac-4076-a08b-014031a724ea tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117 (non-flash)
Dec 05 15:51:01 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf187160-8cac-4076-a08b-014031a724ea tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6638522830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117'): ({'sdb'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-cf187160-8cac-4076-a08b-014031a724ea tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Removing single pathed devices sdb {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa6bb87-6c14-48c6-b3fe-b8f9f54d34ef]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9e6b70-d94d-478f-932a-319d5289373e]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-cf187160-8cac-4076-a08b-014031a724ea tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Flushing IO for device /dev/sdb {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1250db99-8ed6-414c-a761-2ed81b1e7b7e]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-cf187160-8cac-4076-a08b-014031a724ea tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0d09fe-c707-4e47-923a-2587892126fd]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-cf187160-8cac-4076-a08b-014031a724ea tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-cf187160-8cac-4076-a08b-014031a724ea tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf187160-8cac-4076-a08b-014031a724ea tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d460ce-3424-4e76-8cf9-3ed0c3cef449]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf187160-8cac-4076-a08b-014031a724ea tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117 -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[61445c42-e108-4960-b188-91821c231d46]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf187160-8cac-4076-a08b-014031a724ea tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117, portal: 172.16.0.220,3260]
Dec 05 15:51:01 user nova-compute[75080]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117, portal: 172.16.0.220,3260] successful.
Dec 05 15:51:01 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117 -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:405d5204-f332-42b9-9d12-ab0e81f8c117 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abaa7b8-3440-41ff-b01a-0887e281e678]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf187160-8cac-4076-a08b-014031a724ea tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-cf187160-8cac-4076-a08b-014031a724ea tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf187160-8cac-4076-a08b-014031a724ea tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] <== disconnect_volume: return (304ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:51:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf187160-8cac-4076-a08b-014031a724ea tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:51:02 user nova-compute[75080]: DEBUG nova.objects.instance [None req-cf187160-8cac-4076-a08b-014031a724ea tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lazy-loading 'flavor' on Instance uuid 8a97a6c4-8486-41be-b919-82ebf61771eb {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:51:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-cf187160-8cac-4076-a08b-014031a724ea tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "8a97a6c4-8486-41be-b919-82ebf61771eb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.672s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:51:03 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:51:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:51:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:51:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 15:51:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:51:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:51:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:51:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:51:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:51:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 15:51:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:51:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:51:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:51:15 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:51:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:51:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:51:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 15:51:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:51:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:51:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:51:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:51:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:51:24 user nova-compute[75080]: DEBUG nova.compute.manager [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:51:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:51:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:51:24 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:51:24 user nova-compute[75080]: INFO nova.compute.claims [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Claim successful on node user
Dec 05 15:51:24 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:51:24 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:51:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.263s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:51:24 user nova-compute[75080]: DEBUG nova.compute.manager [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:51:24 user nova-compute[75080]: DEBUG nova.compute.manager [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:51:24 user nova-compute[75080]: DEBUG nova.network.neutron [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:51:24 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:51:24 user nova-compute[75080]: DEBUG nova.compute.manager [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:51:24 user nova-compute[75080]: DEBUG nova.policy [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1afa4590c69f423d97f7cd485e193b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea1ac008cfd499a8df635aac9b1342d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:51:24 user nova-compute[75080]: DEBUG nova.compute.manager [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:51:24 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:51:24 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Creating image(s)
Dec 05 15:51:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "/opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:51:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "/opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:51:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "/opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:51:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:51:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.189s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:51:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:51:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:51:24 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:51:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:51:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.169s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:51:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:51:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk 1073741824" returned: 0 in 0.058s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:51:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:51:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:51:25 user nova-compute[75080]: DEBUG nova.network.neutron [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Successfully created port: 22ddcc5a-537d-41ac-b4c7-e4a702d84748 {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:51:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.181s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:51:25 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 15:51:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:51:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:51:25 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Cannot resize image /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 15:51:25 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:51:25 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Ensure instance console log exists: /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:51:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:51:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:51:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:51:25 user nova-compute[75080]: DEBUG nova.network.neutron [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Successfully updated port: 22ddcc5a-537d-41ac-b4c7-e4a702d84748 {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:51:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "refresh_cache-7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:51:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquired lock "refresh_cache-7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:51:25 user nova-compute[75080]: DEBUG nova.network.neutron [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:51:25 user nova-compute[75080]: DEBUG nova.compute.manager [req-06788274-b53d-4d50-9b32-c4860585dcd6 req-18148fac-f708-40dc-9f26-3f3f10965d3b service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Received event network-changed-22ddcc5a-537d-41ac-b4c7-e4a702d84748 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:51:25 user nova-compute[75080]: DEBUG nova.compute.manager [req-06788274-b53d-4d50-9b32-c4860585dcd6 req-18148fac-f708-40dc-9f26-3f3f10965d3b service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Refreshing instance network info cache due to event network-changed-22ddcc5a-537d-41ac-b4c7-e4a702d84748. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:51:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-06788274-b53d-4d50-9b32-c4860585dcd6 req-18148fac-f708-40dc-9f26-3f3f10965d3b service nova] Acquiring lock "refresh_cache-7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:51:25 user nova-compute[75080]: DEBUG nova.network.neutron [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG nova.network.neutron [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Updating instance_info_cache with network_info: [{"id": "22ddcc5a-537d-41ac-b4c7-e4a702d84748", "address": "fa:16:3e:2f:f6:98", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ddcc5a-53", "ovs_interfaceid": "22ddcc5a-537d-41ac-b4c7-e4a702d84748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Releasing lock "refresh_cache-7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG nova.compute.manager [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Instance network_info: |[{"id": "22ddcc5a-537d-41ac-b4c7-e4a702d84748", "address": "fa:16:3e:2f:f6:98", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ddcc5a-53", "ovs_interfaceid": "22ddcc5a-537d-41ac-b4c7-e4a702d84748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-06788274-b53d-4d50-9b32-c4860585dcd6 req-18148fac-f708-40dc-9f26-3f3f10965d3b service nova] Acquired lock "refresh_cache-7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG nova.network.neutron [req-06788274-b53d-4d50-9b32-c4860585dcd6 req-18148fac-f708-40dc-9f26-3f3f10965d3b service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Refreshing network info cache for port 22ddcc5a-537d-41ac-b4c7-e4a702d84748 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Start _get_guest_xml network_info=[{"id": "22ddcc5a-537d-41ac-b4c7-e4a702d84748", "address": "fa:16:3e:2f:f6:98", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ddcc5a-53", "ovs_interfaceid": "22ddcc5a-537d-41ac-b4c7-e4a702d84748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:51:26 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:51:26 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:51:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:51:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-199249757',display_name='tempest-ServerRescueNegativeTestJSON-server-199249757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-199249757',id=47,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAgxSWkE/X5Qmy90sb5F3iA/7Io6ebkQVGemg7IdToZcm2LVt34tO/RkaNoO/5BDm6wpIZMOgIbznVpPEpc/oyLgJQw+s1ZWNaskbKmcyuJfpER0nfleTcXApBfkK9c+6A==',key_name='tempest-keypair-1096119825',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cea1ac008cfd499a8df635aac9b1342d',ramdisk_id='',reservation_id='r-ukmdqv62',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1626475760',owner_user_name='tempest-ServerRescueNegativeTestJSON-1626475760-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:51:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1afa4590c69f423d97f7cd485e193b0f',uuid=7b2885bd-b61d-4e6f-9a6b-ba5939ae6274,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22ddcc5a-537d-41ac-b4c7-e4a702d84748", "address": "fa:16:3e:2f:f6:98", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ddcc5a-53", "ovs_interfaceid": "22ddcc5a-537d-41ac-b4c7-e4a702d84748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Converting VIF {"id": "22ddcc5a-537d-41ac-b4c7-e4a702d84748", "address": "fa:16:3e:2f:f6:98", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ddcc5a-53", "ovs_interfaceid": "22ddcc5a-537d-41ac-b4c7-e4a702d84748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:f6:98,bridge_name='br-int',has_traffic_filtering=True,id=22ddcc5a-537d-41ac-b4c7-e4a702d84748,network=Network(c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22ddcc5a-53') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG nova.objects.instance [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:51:26 user nova-compute[75080]:   <uuid>7b2885bd-b61d-4e6f-9a6b-ba5939ae6274</uuid>
Dec 05 15:51:26 user nova-compute[75080]:   <name>instance-0000002f</name>
Dec 05 15:51:26 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:51:26 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:51:26 user nova-compute[75080]:   <metadata>
Dec 05 15:51:26 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:51:26 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:51:26 user nova-compute[75080]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-199249757</nova:name>
Dec 05 15:51:26 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:51:26</nova:creationTime>
Dec 05 15:51:26 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:51:26 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:51:26 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:51:26 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:51:26 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:51:26 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:51:26 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:51:26 user nova-compute[75080]:       <nova:owner>
Dec 05 15:51:26 user nova-compute[75080]:         <nova:user uuid="1afa4590c69f423d97f7cd485e193b0f">tempest-ServerRescueNegativeTestJSON-1626475760-project-member</nova:user>
Dec 05 15:51:26 user nova-compute[75080]:         <nova:project uuid="cea1ac008cfd499a8df635aac9b1342d">tempest-ServerRescueNegativeTestJSON-1626475760</nova:project>
Dec 05 15:51:26 user nova-compute[75080]:       </nova:owner>
Dec 05 15:51:26 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:51:26 user nova-compute[75080]:       <nova:ports>
Dec 05 15:51:26 user nova-compute[75080]:         <nova:port uuid="22ddcc5a-537d-41ac-b4c7-e4a702d84748">
Dec 05 15:51:26 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 05 15:51:26 user nova-compute[75080]:         </nova:port>
Dec 05 15:51:26 user nova-compute[75080]:       </nova:ports>
Dec 05 15:51:26 user nova-compute[75080]:     </nova:instance>
Dec 05 15:51:26 user nova-compute[75080]:   </metadata>
Dec 05 15:51:26 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:51:26 user nova-compute[75080]:     <system>
Dec 05 15:51:26 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:51:26 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:51:26 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:51:26 user nova-compute[75080]:       <entry name="serial">7b2885bd-b61d-4e6f-9a6b-ba5939ae6274</entry>
Dec 05 15:51:26 user nova-compute[75080]:       <entry name="uuid">7b2885bd-b61d-4e6f-9a6b-ba5939ae6274</entry>
Dec 05 15:51:26 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:51:26 user nova-compute[75080]:     </system>
Dec 05 15:51:26 user nova-compute[75080]:   </sysinfo>
Dec 05 15:51:26 user nova-compute[75080]:   <os>
Dec 05 15:51:26 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:51:26 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:51:26 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:51:26 user nova-compute[75080]:   </os>
Dec 05 15:51:26 user nova-compute[75080]:   <features>
Dec 05 15:51:26 user nova-compute[75080]:     <acpi/>
Dec 05 15:51:26 user nova-compute[75080]:     <apic/>
Dec 05 15:51:26 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:51:26 user nova-compute[75080]:   </features>
Dec 05 15:51:26 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:51:26 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:51:26 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:51:26 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:51:26 user nova-compute[75080]:   </clock>
Dec 05 15:51:26 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:51:26 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:51:26 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:51:26 user nova-compute[75080]:   </cpu>
Dec 05 15:51:26 user nova-compute[75080]:   <devices>
Dec 05 15:51:26 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:51:26 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:51:26 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk"/>
Dec 05 15:51:26 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:51:26 user nova-compute[75080]:     </disk>
Dec 05 15:51:26 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:51:26 user nova-compute[75080]:       <mac address="fa:16:3e:2f:f6:98"/>
Dec 05 15:51:26 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:51:26 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:51:26 user nova-compute[75080]:       <target dev="tap22ddcc5a-53"/>
Dec 05 15:51:26 user nova-compute[75080]:     </interface>
Dec 05 15:51:26 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:51:26 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/console.log" append="off"/>
Dec 05 15:51:26 user nova-compute[75080]:     </serial>
Dec 05 15:51:26 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:51:26 user nova-compute[75080]:     <video>
Dec 05 15:51:26 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:51:26 user nova-compute[75080]:     </video>
Dec 05 15:51:26 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:51:26 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:51:26 user nova-compute[75080]:     </rng>
Dec 05 15:51:26 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:51:26 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:51:26 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:51:26 user nova-compute[75080]:     </memballoon>
Dec 05 15:51:26 user nova-compute[75080]:   </devices>
Dec 05 15:51:26 user nova-compute[75080]: </domain>
Dec 05 15:51:26 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:51:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-199249757',display_name='tempest-ServerRescueNegativeTestJSON-server-199249757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-199249757',id=47,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAgxSWkE/X5Qmy90sb5F3iA/7Io6ebkQVGemg7IdToZcm2LVt34tO/RkaNoO/5BDm6wpIZMOgIbznVpPEpc/oyLgJQw+s1ZWNaskbKmcyuJfpER0nfleTcXApBfkK9c+6A==',key_name='tempest-keypair-1096119825',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cea1ac008cfd499a8df635aac9b1342d',ramdisk_id='',reservation_id='r-ukmdqv62',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1626475760',owner_user_name='tempest-ServerRescueNegativeTestJSON-1626475760-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:51:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1afa4590c69f423d97f7cd485e193b0f',uuid=7b2885bd-b61d-4e6f-9a6b-ba5939ae6274,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22ddcc5a-537d-41ac-b4c7-e4a702d84748", "address": "fa:16:3e:2f:f6:98", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ddcc5a-53", "ovs_interfaceid": "22ddcc5a-537d-41ac-b4c7-e4a702d84748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Converting VIF {"id": "22ddcc5a-537d-41ac-b4c7-e4a702d84748", "address": "fa:16:3e:2f:f6:98", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ddcc5a-53", "ovs_interfaceid": "22ddcc5a-537d-41ac-b4c7-e4a702d84748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:f6:98,bridge_name='br-int',has_traffic_filtering=True,id=22ddcc5a-537d-41ac-b4c7-e4a702d84748,network=Network(c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22ddcc5a-53') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG os_vif [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:f6:98,bridge_name='br-int',has_traffic_filtering=True,id=22ddcc5a-537d-41ac-b4c7-e4a702d84748,network=Network(c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22ddcc5a-53') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6ff0960f-5a21-5467-b4fb-2b93a08627ef', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22ddcc5a-53, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap22ddcc5a-53, col_values=(('qos', UUID('d75c5a9c-5fbc-4a3e-b270-996a04b836e2')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap22ddcc5a-53, col_values=(('external_ids', {'iface-id': '22ddcc5a-537d-41ac-b4c7-e4a702d84748', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:f6:98', 'vm-uuid': '7b2885bd-b61d-4e6f-9a6b-ba5939ae6274'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:51:26 user nova-compute[75080]: INFO os_vif [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:f6:98,bridge_name='br-int',has_traffic_filtering=True,id=22ddcc5a-537d-41ac-b4c7-e4a702d84748,network=Network(c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22ddcc5a-53')
Dec 05 15:51:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] No VIF found with MAC fa:16:3e:2f:f6:98, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG nova.network.neutron [req-06788274-b53d-4d50-9b32-c4860585dcd6 req-18148fac-f708-40dc-9f26-3f3f10965d3b service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Updated VIF entry in instance network info cache for port 22ddcc5a-537d-41ac-b4c7-e4a702d84748. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG nova.network.neutron [req-06788274-b53d-4d50-9b32-c4860585dcd6 req-18148fac-f708-40dc-9f26-3f3f10965d3b service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Updating instance_info_cache with network_info: [{"id": "22ddcc5a-537d-41ac-b4c7-e4a702d84748", "address": "fa:16:3e:2f:f6:98", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ddcc5a-53", "ovs_interfaceid": "22ddcc5a-537d-41ac-b4c7-e4a702d84748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:51:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-06788274-b53d-4d50-9b32-c4860585dcd6 req-18148fac-f708-40dc-9f26-3f3f10965d3b service nova] Releasing lock "refresh_cache-7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:51:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:51:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:51:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:51:27 user nova-compute[75080]: DEBUG nova.compute.manager [req-73518b8c-9411-45c0-9bf1-a22c70b04e12 req-373f9cf1-14ec-4018-a97a-20ac4c1c4ac6 service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Received event network-vif-plugged-22ddcc5a-537d-41ac-b4c7-e4a702d84748 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:51:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-73518b8c-9411-45c0-9bf1-a22c70b04e12 req-373f9cf1-14ec-4018-a97a-20ac4c1c4ac6 service nova] Acquiring lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:51:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-73518b8c-9411-45c0-9bf1-a22c70b04e12 req-373f9cf1-14ec-4018-a97a-20ac4c1c4ac6 service nova] Lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:51:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-73518b8c-9411-45c0-9bf1-a22c70b04e12 req-373f9cf1-14ec-4018-a97a-20ac4c1c4ac6 service nova] Lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:51:27 user nova-compute[75080]: DEBUG nova.compute.manager [req-73518b8c-9411-45c0-9bf1-a22c70b04e12 req-373f9cf1-14ec-4018-a97a-20ac4c1c4ac6 service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] No waiting events found dispatching network-vif-plugged-22ddcc5a-537d-41ac-b4c7-e4a702d84748 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:51:27 user nova-compute[75080]: WARNING nova.compute.manager [req-73518b8c-9411-45c0-9bf1-a22c70b04e12 req-373f9cf1-14ec-4018-a97a-20ac4c1c4ac6 service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Received unexpected event network-vif-plugged-22ddcc5a-537d-41ac-b4c7-e4a702d84748 for instance with vm_state building and task_state spawning.
Dec 05 15:51:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:51:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:51:29 user nova-compute[75080]: DEBUG nova.compute.manager [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:51:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:51:29 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Instance spawned successfully.
Dec 05 15:51:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:51:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:51:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:51:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:51:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:51:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:51:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:51:29 user nova-compute[75080]: INFO nova.compute.manager [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Took 5.16 seconds to spawn the instance on the hypervisor.
Dec 05 15:51:29 user nova-compute[75080]: DEBUG nova.compute.manager [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:51:30 user nova-compute[75080]: INFO nova.compute.manager [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Took 5.78 seconds to build instance.
Dec 05 15:51:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8224a43c-256a-4dcf-ace2-f391d7abb2c5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.880s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:51:30 user nova-compute[75080]: DEBUG nova.compute.manager [req-c17043b3-dc1f-45fc-8938-0655baea8792 req-d35c685d-8cfd-4195-8530-587cd5d3c1ab service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Received event network-vif-plugged-22ddcc5a-537d-41ac-b4c7-e4a702d84748 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:51:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c17043b3-dc1f-45fc-8938-0655baea8792 req-d35c685d-8cfd-4195-8530-587cd5d3c1ab service nova] Acquiring lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:51:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c17043b3-dc1f-45fc-8938-0655baea8792 req-d35c685d-8cfd-4195-8530-587cd5d3c1ab service nova] Lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:51:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c17043b3-dc1f-45fc-8938-0655baea8792 req-d35c685d-8cfd-4195-8530-587cd5d3c1ab service nova] Lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:51:30 user nova-compute[75080]: DEBUG nova.compute.manager [req-c17043b3-dc1f-45fc-8938-0655baea8792 req-d35c685d-8cfd-4195-8530-587cd5d3c1ab service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] No waiting events found dispatching network-vif-plugged-22ddcc5a-537d-41ac-b4c7-e4a702d84748 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:51:30 user nova-compute[75080]: WARNING nova.compute.manager [req-c17043b3-dc1f-45fc-8938-0655baea8792 req-d35c685d-8cfd-4195-8530-587cd5d3c1ab service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Received unexpected event network-vif-plugged-22ddcc5a-537d-41ac-b4c7-e4a702d84748 for instance with vm_state active and task_state None.
Dec 05 15:51:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:51:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:51:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:51:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:51:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:51:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:51:45 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:51:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:51:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:51:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:51:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:51:50 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:51:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:51:51 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:51:52 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:51:52 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:51:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:51:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:51:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:51:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:51:56 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:51:56 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:51:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:51:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:51:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:51:56 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:51:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:51:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:51:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:51:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:51:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:51:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:51:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:51:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:51:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:51:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:51:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:51:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:51:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:51:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:51:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:51:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:51:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:51:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:51:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:51:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:51:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:51:58 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:51:58 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:51:58 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=8594MB free_disk=24.9068603515625GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:51:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:51:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:51:59 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance db0fde77-eb40-4acb-93f7-66b5b76c8eea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:51:59 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 8608d2cf-476d-43b8-a124-c44507459a1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:51:59 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 8a97a6c4-8486-41be-b919-82ebf61771eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:51:59 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:51:59 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:51:59 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:51:59 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:51:59 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:51:59 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:51:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.316s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:52:00 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:52:00 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:52:00 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Didn't find any instances for network info cache update. {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 15:52:00 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:52:00 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:52:01 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9371bb16-4aa1-4100-994f-1af6207aecd8 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Acquiring lock "8a97a6c4-8486-41be-b919-82ebf61771eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:52:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9371bb16-4aa1-4100-994f-1af6207aecd8 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "8a97a6c4-8486-41be-b919-82ebf61771eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:52:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9371bb16-4aa1-4100-994f-1af6207aecd8 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Acquiring lock "8a97a6c4-8486-41be-b919-82ebf61771eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:52:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9371bb16-4aa1-4100-994f-1af6207aecd8 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "8a97a6c4-8486-41be-b919-82ebf61771eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:52:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9371bb16-4aa1-4100-994f-1af6207aecd8 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "8a97a6c4-8486-41be-b919-82ebf61771eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:52:04 user nova-compute[75080]: INFO nova.compute.manager [None req-9371bb16-4aa1-4100-994f-1af6207aecd8 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Terminating instance
Dec 05 15:52:04 user nova-compute[75080]: DEBUG nova.compute.manager [None req-9371bb16-4aa1-4100-994f-1af6207aecd8 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:52:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:05 user nova-compute[75080]: DEBUG nova.compute.manager [req-90df8428-862b-4912-8d48-3ee63514103e req-5f10c176-482a-40b8-97d9-b74ea7a2a656 service nova] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Received event network-vif-unplugged-0013f2c2-e337-4c3d-8885-ee027a53e8d8 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:52:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-90df8428-862b-4912-8d48-3ee63514103e req-5f10c176-482a-40b8-97d9-b74ea7a2a656 service nova] Acquiring lock "8a97a6c4-8486-41be-b919-82ebf61771eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:52:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-90df8428-862b-4912-8d48-3ee63514103e req-5f10c176-482a-40b8-97d9-b74ea7a2a656 service nova] Lock "8a97a6c4-8486-41be-b919-82ebf61771eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:52:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-90df8428-862b-4912-8d48-3ee63514103e req-5f10c176-482a-40b8-97d9-b74ea7a2a656 service nova] Lock "8a97a6c4-8486-41be-b919-82ebf61771eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:52:05 user nova-compute[75080]: DEBUG nova.compute.manager [req-90df8428-862b-4912-8d48-3ee63514103e req-5f10c176-482a-40b8-97d9-b74ea7a2a656 service nova] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] No waiting events found dispatching network-vif-unplugged-0013f2c2-e337-4c3d-8885-ee027a53e8d8 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:52:05 user nova-compute[75080]: DEBUG nova.compute.manager [req-90df8428-862b-4912-8d48-3ee63514103e req-5f10c176-482a-40b8-97d9-b74ea7a2a656 service nova] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Received event network-vif-unplugged-0013f2c2-e337-4c3d-8885-ee027a53e8d8 for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:52:05 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:52:05 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:52:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:05 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Instance destroyed successfully.
Dec 05 15:52:05 user nova-compute[75080]: DEBUG nova.objects.instance [None req-9371bb16-4aa1-4100-994f-1af6207aecd8 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lazy-loading 'resources' on Instance uuid 8a97a6c4-8486-41be-b919-82ebf61771eb {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:52:05 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-9371bb16-4aa1-4100-994f-1af6207aecd8 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1889405403',display_name='tempest-SnapshotDataIntegrityTests-server-1889405403',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1889405403',id=45,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZfnhv2hKs/TOeylBLMGyfZhHrnLmSE69uL3s2rYt1xM8hl3eenMxvcuMPgt+9CRciqY5uG6OpYVFS/TwHTAwXEQL2HkKTttYK56HMxoBQbjLbnzK5EuHvMCsKcign/sw==',key_name='tempest-keypair-861482726',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:44:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9070144481d84c98bdc9063c54a9e5e0',ramdisk_id='',reservation_id='r-s3fcv0tt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1992304988',owner_user_name='tempest-SnapshotDataIntegrityTests-1992304988-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:44:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c312f375da424b90b954abc2617ad026',uuid=8a97a6c4-8486-41be-b919-82ebf61771eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0013f2c2-e337-4c3d-8885-ee027a53e8d8", "address": "fa:16:3e:2f:30:8f", "network": {"id": "236ffb89-7d87-41de-8dac-e36bfb38a2d0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-187610999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9070144481d84c98bdc9063c54a9e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0013f2c2-e3", "ovs_interfaceid": "0013f2c2-e337-4c3d-8885-ee027a53e8d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:52:05 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-9371bb16-4aa1-4100-994f-1af6207aecd8 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Converting VIF {"id": "0013f2c2-e337-4c3d-8885-ee027a53e8d8", "address": "fa:16:3e:2f:30:8f", "network": {"id": "236ffb89-7d87-41de-8dac-e36bfb38a2d0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-187610999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9070144481d84c98bdc9063c54a9e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0013f2c2-e3", "ovs_interfaceid": "0013f2c2-e337-4c3d-8885-ee027a53e8d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:52:05 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-9371bb16-4aa1-4100-994f-1af6207aecd8 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:30:8f,bridge_name='br-int',has_traffic_filtering=True,id=0013f2c2-e337-4c3d-8885-ee027a53e8d8,network=Network(236ffb89-7d87-41de-8dac-e36bfb38a2d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0013f2c2-e3') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:52:05 user nova-compute[75080]: DEBUG os_vif [None req-9371bb16-4aa1-4100-994f-1af6207aecd8 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:30:8f,bridge_name='br-int',has_traffic_filtering=True,id=0013f2c2-e337-4c3d-8885-ee027a53e8d8,network=Network(236ffb89-7d87-41de-8dac-e36bfb38a2d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0013f2c2-e3') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:52:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0013f2c2-e3, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:52:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=052fc22c-865c-40db-91a9-1174dd4acba3) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:52:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:52:05 user nova-compute[75080]: INFO os_vif [None req-9371bb16-4aa1-4100-994f-1af6207aecd8 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:30:8f,bridge_name='br-int',has_traffic_filtering=True,id=0013f2c2-e337-4c3d-8885-ee027a53e8d8,network=Network(236ffb89-7d87-41de-8dac-e36bfb38a2d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0013f2c2-e3')
Dec 05 15:52:05 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-9371bb16-4aa1-4100-994f-1af6207aecd8 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Deleting instance files /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb_del
Dec 05 15:52:05 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-9371bb16-4aa1-4100-994f-1af6207aecd8 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Deletion of /opt/stack/data/nova/instances/8a97a6c4-8486-41be-b919-82ebf61771eb_del complete
Dec 05 15:52:05 user nova-compute[75080]: INFO nova.compute.manager [None req-9371bb16-4aa1-4100-994f-1af6207aecd8 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Took 0.91 seconds to destroy the instance on the hypervisor.
Dec 05 15:52:05 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-9371bb16-4aa1-4100-994f-1af6207aecd8 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:52:05 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:52:05 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:52:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Acquiring lock "329c6583-54c9-4cb4-a747-89986c2b1878" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:52:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lock "329c6583-54c9-4cb4-a747-89986c2b1878" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:52:06 user nova-compute[75080]: DEBUG nova.compute.manager [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 15:52:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:52:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:52:06 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:52:06 user nova-compute[75080]: INFO nova.compute.claims [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Claim successful on node user
Dec 05 15:52:06 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:52:06 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:52:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.319s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:52:06 user nova-compute[75080]: DEBUG nova.compute.manager [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 15:52:06 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:52:06 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Took 0.88 seconds to deallocate network for instance.
Dec 05 15:52:06 user nova-compute[75080]: DEBUG nova.compute.manager [req-fab75a8d-730b-43df-8a98-b4a8fccb32f4 req-590aa264-4000-423b-9d82-7ffbb9f7bacb service nova] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Received event network-vif-deleted-0013f2c2-e337-4c3d-8885-ee027a53e8d8 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:52:06 user nova-compute[75080]: DEBUG nova.compute.manager [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 15:52:06 user nova-compute[75080]: DEBUG nova.network.neutron [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 15:52:06 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 15:52:06 user nova-compute[75080]: DEBUG nova.compute.manager [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 15:52:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9371bb16-4aa1-4100-994f-1af6207aecd8 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:52:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9371bb16-4aa1-4100-994f-1af6207aecd8 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:52:06 user nova-compute[75080]: DEBUG nova.policy [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dc433b4ab35c404f83f8729ee04fb164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19ed3436a3f43a3b4a69e81a76bb263', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 15:52:06 user nova-compute[75080]: INFO nova.virt.block_device [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Booting with volume 274194ad-2323-4414-a457-ad40d2362439 at /dev/vda
Dec 05 15:52:06 user nova-compute[75080]: DEBUG os_brick.utils [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:52:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:52:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:52:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62aa0f7-dc3d-443d-ac48-511acb6a0fdc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:52:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:52:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:52:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c229b6d4-02fc-41d5-8fb3-a187faa7e1d7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:52:06 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-9371bb16-4aa1-4100-994f-1af6207aecd8 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:52:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:52:06 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-9371bb16-4aa1-4100-994f-1af6207aecd8 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:52:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:52:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[048a1b5e-475a-4734-8413-4d89bbf2262d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:52:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf21fc6-28ce-43c8-9fad-f0c2fcb6adb9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:52:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:52:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:52:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:52:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9371bb16-4aa1-4100-994f-1af6207aecd8 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.276s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:52:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:52:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:52:06 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:52:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0912e341-cfcf-458e-a170-ad1017788d3a]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:52:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:52:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:52:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:52:06 user nova-compute[75080]: DEBUG os_brick.utils [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:52:06 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Updating existing volume attachment record: 8330af04-0b02-4b1b-8cc4-b09d77969417 {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:52:06 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-9371bb16-4aa1-4100-994f-1af6207aecd8 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Deleted allocations for instance 8a97a6c4-8486-41be-b919-82ebf61771eb
Dec 05 15:52:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-9371bb16-4aa1-4100-994f-1af6207aecd8 tempest-SnapshotDataIntegrityTests-1992304988 tempest-SnapshotDataIntegrityTests-1992304988-project-member] Lock "8a97a6c4-8486-41be-b919-82ebf61771eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.327s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:52:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-45edb38b-38dd-43e8-ae9b-3e116ac66831 req-5fe35097-ea1d-454d-8bf1-38396875d4ab service nova] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Received event network-vif-plugged-0013f2c2-e337-4c3d-8885-ee027a53e8d8 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:52:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-45edb38b-38dd-43e8-ae9b-3e116ac66831 req-5fe35097-ea1d-454d-8bf1-38396875d4ab service nova] Acquiring lock "8a97a6c4-8486-41be-b919-82ebf61771eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:52:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-45edb38b-38dd-43e8-ae9b-3e116ac66831 req-5fe35097-ea1d-454d-8bf1-38396875d4ab service nova] Lock "8a97a6c4-8486-41be-b919-82ebf61771eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:52:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-45edb38b-38dd-43e8-ae9b-3e116ac66831 req-5fe35097-ea1d-454d-8bf1-38396875d4ab service nova] Lock "8a97a6c4-8486-41be-b919-82ebf61771eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:52:07 user nova-compute[75080]: DEBUG nova.compute.manager [req-45edb38b-38dd-43e8-ae9b-3e116ac66831 req-5fe35097-ea1d-454d-8bf1-38396875d4ab service nova] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] No waiting events found dispatching network-vif-plugged-0013f2c2-e337-4c3d-8885-ee027a53e8d8 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:52:07 user nova-compute[75080]: WARNING nova.compute.manager [req-45edb38b-38dd-43e8-ae9b-3e116ac66831 req-5fe35097-ea1d-454d-8bf1-38396875d4ab service nova] [instance: 8a97a6c4-8486-41be-b919-82ebf61771eb] Received unexpected event network-vif-plugged-0013f2c2-e337-4c3d-8885-ee027a53e8d8 for instance with vm_state deleted and task_state None.
Dec 05 15:52:07 user nova-compute[75080]: DEBUG nova.network.neutron [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Successfully created port: 86318321-0dae-41ca-b65d-420d34a4524d {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 15:52:08 user nova-compute[75080]: DEBUG nova.network.neutron [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Successfully updated port: 86318321-0dae-41ca-b65d-420d34a4524d {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 15:52:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Acquiring lock "refresh_cache-329c6583-54c9-4cb4-a747-89986c2b1878" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:52:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Acquired lock "refresh_cache-329c6583-54c9-4cb4-a747-89986c2b1878" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:52:08 user nova-compute[75080]: DEBUG nova.network.neutron [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:52:08 user nova-compute[75080]: DEBUG nova.network.neutron [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 15:52:08 user nova-compute[75080]: DEBUG nova.network.neutron [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Updating instance_info_cache with network_info: [{"id": "86318321-0dae-41ca-b65d-420d34a4524d", "address": "fa:16:3e:0b:ba:19", "network": {"id": "a7d887a3-0434-4d0a-933b-5e2605ccc742", "bridge": "br-int", "label": "tempest-TestShelveInstance-763789771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e19ed3436a3f43a3b4a69e81a76bb263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86318321-0d", "ovs_interfaceid": "86318321-0dae-41ca-b65d-420d34a4524d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:52:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Releasing lock "refresh_cache-329c6583-54c9-4cb4-a747-89986c2b1878" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:52:08 user nova-compute[75080]: DEBUG nova.compute.manager [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Instance network_info: |[{"id": "86318321-0dae-41ca-b65d-420d34a4524d", "address": "fa:16:3e:0b:ba:19", "network": {"id": "a7d887a3-0434-4d0a-933b-5e2605ccc742", "bridge": "br-int", "label": "tempest-TestShelveInstance-763789771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e19ed3436a3f43a3b4a69e81a76bb263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86318321-0d", "ovs_interfaceid": "86318321-0dae-41ca-b65d-420d34a4524d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 15:52:08 user nova-compute[75080]: DEBUG nova.compute.manager [req-864f61a2-e2ff-4790-af7f-257c28a7ca06 req-e5c809d2-c5d6-4e5b-b00b-b9be3d7f99c3 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Received event network-changed-86318321-0dae-41ca-b65d-420d34a4524d {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:52:08 user nova-compute[75080]: DEBUG nova.compute.manager [req-864f61a2-e2ff-4790-af7f-257c28a7ca06 req-e5c809d2-c5d6-4e5b-b00b-b9be3d7f99c3 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Refreshing instance network info cache due to event network-changed-86318321-0dae-41ca-b65d-420d34a4524d. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:52:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-864f61a2-e2ff-4790-af7f-257c28a7ca06 req-e5c809d2-c5d6-4e5b-b00b-b9be3d7f99c3 service nova] Acquiring lock "refresh_cache-329c6583-54c9-4cb4-a747-89986c2b1878" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:52:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-864f61a2-e2ff-4790-af7f-257c28a7ca06 req-e5c809d2-c5d6-4e5b-b00b-b9be3d7f99c3 service nova] Acquired lock "refresh_cache-329c6583-54c9-4cb4-a747-89986c2b1878" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:52:08 user nova-compute[75080]: DEBUG nova.network.neutron [req-864f61a2-e2ff-4790-af7f-257c28a7ca06 req-e5c809d2-c5d6-4e5b-b00b-b9be3d7f99c3 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Refreshing network info cache for port 86318321-0dae-41ca-b65d-420d34a4524d {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:52:08 user nova-compute[75080]: DEBUG nova.network.neutron [req-864f61a2-e2ff-4790-af7f-257c28a7ca06 req-e5c809d2-c5d6-4e5b-b00b-b9be3d7f99c3 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Updated VIF entry in instance network info cache for port 86318321-0dae-41ca-b65d-420d34a4524d. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:52:08 user nova-compute[75080]: DEBUG nova.network.neutron [req-864f61a2-e2ff-4790-af7f-257c28a7ca06 req-e5c809d2-c5d6-4e5b-b00b-b9be3d7f99c3 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Updating instance_info_cache with network_info: [{"id": "86318321-0dae-41ca-b65d-420d34a4524d", "address": "fa:16:3e:0b:ba:19", "network": {"id": "a7d887a3-0434-4d0a-933b-5e2605ccc742", "bridge": "br-int", "label": "tempest-TestShelveInstance-763789771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e19ed3436a3f43a3b4a69e81a76bb263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86318321-0d", "ovs_interfaceid": "86318321-0dae-41ca-b65d-420d34a4524d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:52:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-864f61a2-e2ff-4790-af7f-257c28a7ca06 req-e5c809d2-c5d6-4e5b-b00b-b9be3d7f99c3 service nova] Releasing lock "refresh_cache-329c6583-54c9-4cb4-a747-89986c2b1878" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:52:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:15 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG nova.compute.manager [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:52:16 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Creating image(s)
Dec 05 15:52:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Did not create local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Ensure instance console log exists: /opt/stack/data/nova/instances/329c6583-54c9-4cb4-a747-89986c2b1878/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Start _get_guest_xml network_info=[{"id": "86318321-0dae-41ca-b65d-420d34a4524d", "address": "fa:16:3e:0b:ba:19", "network": {"id": "a7d887a3-0434-4d0a-933b-5e2605ccc742", "bridge": "br-int", "label": "tempest-TestShelveInstance-763789771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e19ed3436a3f43a3b4a69e81a76bb263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86318321-0d", "ovs_interfaceid": "86318321-0dae-41ca-b65d-420d34a4524d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNlcUJVW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '329c6583-54c9-4cb4-a747-89986c2b1878', 'attached_at': '', 'detached_at': '', 'volume_id': '274194ad-2323-4414-a457-ad40d2362439', 'serial': '274194ad-2323-4414-a457-ad40d2362439'}, 'device_type': 'disk', 'attachment_id': '8330af04-0b02-4b1b-8cc4-b09d77969417', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:52:16 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:52:16 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:52:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNlcUJVW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:52:16 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:52:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:52:16 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:52:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:52:16 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:52:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d010842b-a894-43bd-b18b-0aed2f2746e5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:52:16 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9404826-2816-431e-bc08-688f8e348e2f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439] added
Dec 05 15:52:16 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b6b7f0-4c21-4106-8563-1db71e7179da]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a617c5d-b3f5-4307-8031-094d1e71a268]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BNlcUJVW {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BNlcUJVW" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5bdd0e-310c-4645-a582-85a711949ccc]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BNlcUJVW'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc301ce2-b55b-411d-b2de-f5443c88dd2c]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce91a7e9-98fa-4cc3-85a8-666246fb8494]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 05 15:52:16 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 05 15:52:16 user nova-compute[75080]:  {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:52:16 user nova-compute[75080]: WARNING os_brick.initiator.connectors.iscsi [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 05 15:52:16 user nova-compute[75080]: 
Dec 05 15:52:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95b68c6-76b9-4433-ac32-5211efb254bf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439, portal: 172.16.0.220,3260]
Dec 05 15:52:16 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439, portal: 172.16.0.220,3260] successful.
Dec 05 15:52:16 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[84517815-0b66-4062-a135-d4f96ef29a51]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8336cade-fb9d-4a60-ad6f-f0c740663850]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 (non-flash)
Dec 05 15:52:16 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 (non-flash)
Dec 05 15:52:16 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[366f4811-e1a3-46e4-b612-256123785281]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:52:16 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:52:17 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:52:17 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNlcUJVW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:52:17 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:52:17 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] <== connect_volume: return (1273ms) {'type': 'block', 'scsi_wwn': '23035376230396131', 'path': '/dev/sdb'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:52:17 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035376230396131', 'path': '/dev/sdb'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:52:17 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:52:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1630400400',display_name='tempest-TestShelveInstance-server-1630400400',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1630400400',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmKfgAKgMU6IomiZs7rO+j8BLtupVV252Mpj3PRlhKsLoH3JO7LcuKNG35YGaZ/sdpoln2GZLbf+bTXedFhdkFU932m2Eaw3wJf2Gfx9vPzyGtXMYVdjuBSvDTqkEncGQ==',key_name='tempest-TestShelveInstance-951166409',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e19ed3436a3f43a3b4a69e81a76bb263',ramdisk_id='',reservation_id='r-15caxesf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1198767828',owner_user_name='tempest-TestShelveInstance-1198767828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:52:07Z,user_data=None,user_id='dc433b4ab35c404f83f8729ee04fb164',uuid=329c6583-54c9-4cb4-a747-89986c2b1878,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86318321-0dae-41ca-b65d-420d34a4524d", "address": "fa:16:3e:0b:ba:19", "network": {"id": "a7d887a3-0434-4d0a-933b-5e2605ccc742", "bridge": "br-int", "label": "tempest-TestShelveInstance-763789771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e19ed3436a3f43a3b4a69e81a76bb263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86318321-0d", "ovs_interfaceid": "86318321-0dae-41ca-b65d-420d34a4524d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:52:17 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Converting VIF {"id": "86318321-0dae-41ca-b65d-420d34a4524d", "address": "fa:16:3e:0b:ba:19", "network": {"id": "a7d887a3-0434-4d0a-933b-5e2605ccc742", "bridge": "br-int", "label": "tempest-TestShelveInstance-763789771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e19ed3436a3f43a3b4a69e81a76bb263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86318321-0d", "ovs_interfaceid": "86318321-0dae-41ca-b65d-420d34a4524d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:52:17 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ba:19,bridge_name='br-int',has_traffic_filtering=True,id=86318321-0dae-41ca-b65d-420d34a4524d,network=Network(a7d887a3-0434-4d0a-933b-5e2605ccc742),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86318321-0d') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:52:17 user nova-compute[75080]: DEBUG nova.objects.instance [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lazy-loading 'pci_devices' on Instance uuid 329c6583-54c9-4cb4-a747-89986c2b1878 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:52:17 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:52:17 user nova-compute[75080]:   <uuid>329c6583-54c9-4cb4-a747-89986c2b1878</uuid>
Dec 05 15:52:17 user nova-compute[75080]:   <name>instance-00000030</name>
Dec 05 15:52:17 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:52:17 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:52:17 user nova-compute[75080]:   <metadata>
Dec 05 15:52:17 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:52:17 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:52:17 user nova-compute[75080]:       <nova:name>tempest-TestShelveInstance-server-1630400400</nova:name>
Dec 05 15:52:17 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:52:16</nova:creationTime>
Dec 05 15:52:17 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:52:17 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:52:17 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:52:17 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:52:17 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:52:17 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:52:17 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:52:17 user nova-compute[75080]:       <nova:owner>
Dec 05 15:52:17 user nova-compute[75080]:         <nova:user uuid="dc433b4ab35c404f83f8729ee04fb164">tempest-TestShelveInstance-1198767828-project-member</nova:user>
Dec 05 15:52:17 user nova-compute[75080]:         <nova:project uuid="e19ed3436a3f43a3b4a69e81a76bb263">tempest-TestShelveInstance-1198767828</nova:project>
Dec 05 15:52:17 user nova-compute[75080]:       </nova:owner>
Dec 05 15:52:17 user nova-compute[75080]:       <nova:ports>
Dec 05 15:52:17 user nova-compute[75080]:         <nova:port uuid="86318321-0dae-41ca-b65d-420d34a4524d">
Dec 05 15:52:17 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 05 15:52:17 user nova-compute[75080]:         </nova:port>
Dec 05 15:52:17 user nova-compute[75080]:       </nova:ports>
Dec 05 15:52:17 user nova-compute[75080]:     </nova:instance>
Dec 05 15:52:17 user nova-compute[75080]:   </metadata>
Dec 05 15:52:17 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:52:17 user nova-compute[75080]:     <system>
Dec 05 15:52:17 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:52:17 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:52:17 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:52:17 user nova-compute[75080]:       <entry name="serial">329c6583-54c9-4cb4-a747-89986c2b1878</entry>
Dec 05 15:52:17 user nova-compute[75080]:       <entry name="uuid">329c6583-54c9-4cb4-a747-89986c2b1878</entry>
Dec 05 15:52:17 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:52:17 user nova-compute[75080]:     </system>
Dec 05 15:52:17 user nova-compute[75080]:   </sysinfo>
Dec 05 15:52:17 user nova-compute[75080]:   <os>
Dec 05 15:52:17 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:52:17 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:52:17 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:52:17 user nova-compute[75080]:   </os>
Dec 05 15:52:17 user nova-compute[75080]:   <features>
Dec 05 15:52:17 user nova-compute[75080]:     <acpi/>
Dec 05 15:52:17 user nova-compute[75080]:     <apic/>
Dec 05 15:52:17 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:52:17 user nova-compute[75080]:   </features>
Dec 05 15:52:17 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:52:17 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:52:17 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:52:17 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:52:17 user nova-compute[75080]:   </clock>
Dec 05 15:52:17 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:52:17 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:52:17 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:52:17 user nova-compute[75080]:   </cpu>
Dec 05 15:52:17 user nova-compute[75080]:   <devices>
Dec 05 15:52:17 user nova-compute[75080]:     <disk type="block" device="disk">
Dec 05 15:52:17 user nova-compute[75080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:52:17 user nova-compute[75080]:       <source dev="/dev/sdb"/>
Dec 05 15:52:17 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:52:17 user nova-compute[75080]:       <serial>274194ad-2323-4414-a457-ad40d2362439</serial>
Dec 05 15:52:17 user nova-compute[75080]:     </disk>
Dec 05 15:52:17 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:52:17 user nova-compute[75080]:       <mac address="fa:16:3e:0b:ba:19"/>
Dec 05 15:52:17 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:52:17 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:52:17 user nova-compute[75080]:       <target dev="tap86318321-0d"/>
Dec 05 15:52:17 user nova-compute[75080]:     </interface>
Dec 05 15:52:17 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:52:17 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/329c6583-54c9-4cb4-a747-89986c2b1878/console.log" append="off"/>
Dec 05 15:52:17 user nova-compute[75080]:     </serial>
Dec 05 15:52:17 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:52:17 user nova-compute[75080]:     <video>
Dec 05 15:52:17 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:52:17 user nova-compute[75080]:     </video>
Dec 05 15:52:17 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:52:17 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:52:17 user nova-compute[75080]:     </rng>
Dec 05 15:52:17 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:52:17 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:52:17 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:52:17 user nova-compute[75080]:     </memballoon>
Dec 05 15:52:17 user nova-compute[75080]:   </devices>
Dec 05 15:52:17 user nova-compute[75080]: </domain>
Dec 05 15:52:17 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:52:17 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:52:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1630400400',display_name='tempest-TestShelveInstance-server-1630400400',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1630400400',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmKfgAKgMU6IomiZs7rO+j8BLtupVV252Mpj3PRlhKsLoH3JO7LcuKNG35YGaZ/sdpoln2GZLbf+bTXedFhdkFU932m2Eaw3wJf2Gfx9vPzyGtXMYVdjuBSvDTqkEncGQ==',key_name='tempest-TestShelveInstance-951166409',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e19ed3436a3f43a3b4a69e81a76bb263',ramdisk_id='',reservation_id='r-15caxesf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1198767828',owner_user_name='tempest-TestShelveInstance-1198767828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:52:07Z,user_data=None,user_id='dc433b4ab35c404f83f8729ee04fb164',uuid=329c6583-54c9-4cb4-a747-89986c2b1878,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86318321-0dae-41ca-b65d-420d34a4524d", "address": "fa:16:3e:0b:ba:19", "network": {"id": "a7d887a3-0434-4d0a-933b-5e2605ccc742", "bridge": "br-int", "label": "tempest-TestShelveInstance-763789771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e19ed3436a3f43a3b4a69e81a76bb263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86318321-0d", "ovs_interfaceid": "86318321-0dae-41ca-b65d-420d34a4524d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:52:17 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Converting VIF {"id": "86318321-0dae-41ca-b65d-420d34a4524d", "address": "fa:16:3e:0b:ba:19", "network": {"id": "a7d887a3-0434-4d0a-933b-5e2605ccc742", "bridge": "br-int", "label": "tempest-TestShelveInstance-763789771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e19ed3436a3f43a3b4a69e81a76bb263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86318321-0d", "ovs_interfaceid": "86318321-0dae-41ca-b65d-420d34a4524d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:52:17 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ba:19,bridge_name='br-int',has_traffic_filtering=True,id=86318321-0dae-41ca-b65d-420d34a4524d,network=Network(a7d887a3-0434-4d0a-933b-5e2605ccc742),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86318321-0d') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:52:17 user nova-compute[75080]: DEBUG os_vif [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ba:19,bridge_name='br-int',has_traffic_filtering=True,id=86318321-0dae-41ca-b65d-420d34a4524d,network=Network(a7d887a3-0434-4d0a-933b-5e2605ccc742),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86318321-0d') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:52:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:52:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:52:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e77ba76f-a5e7-5a7d-b8c9-954bcbbbb4f5', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:52:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86318321-0d, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:52:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap86318321-0d, col_values=(('qos', UUID('32577afb-604d-4526-afc2-412a325980b8')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:52:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap86318321-0d, col_values=(('external_ids', {'iface-id': '86318321-0dae-41ca-b65d-420d34a4524d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:ba:19', 'vm-uuid': '329c6583-54c9-4cb4-a747-89986c2b1878'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:52:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:52:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:17 user nova-compute[75080]: INFO os_vif [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ba:19,bridge_name='br-int',has_traffic_filtering=True,id=86318321-0dae-41ca-b65d-420d34a4524d,network=Network(a7d887a3-0434-4d0a-933b-5e2605ccc742),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86318321-0d')
Dec 05 15:52:17 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:52:17 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] No VIF found with MAC fa:16:3e:0b:ba:19, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:52:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:19 user nova-compute[75080]: DEBUG nova.compute.manager [req-48842e95-2518-4b16-ba86-33b65287deca req-37962aab-24fa-4533-a0bc-a95bd272b088 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Received event network-vif-plugged-86318321-0dae-41ca-b65d-420d34a4524d {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:52:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-48842e95-2518-4b16-ba86-33b65287deca req-37962aab-24fa-4533-a0bc-a95bd272b088 service nova] Acquiring lock "329c6583-54c9-4cb4-a747-89986c2b1878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:52:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-48842e95-2518-4b16-ba86-33b65287deca req-37962aab-24fa-4533-a0bc-a95bd272b088 service nova] Lock "329c6583-54c9-4cb4-a747-89986c2b1878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:52:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-48842e95-2518-4b16-ba86-33b65287deca req-37962aab-24fa-4533-a0bc-a95bd272b088 service nova] Lock "329c6583-54c9-4cb4-a747-89986c2b1878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:52:19 user nova-compute[75080]: DEBUG nova.compute.manager [req-48842e95-2518-4b16-ba86-33b65287deca req-37962aab-24fa-4533-a0bc-a95bd272b088 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] No waiting events found dispatching network-vif-plugged-86318321-0dae-41ca-b65d-420d34a4524d {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:52:19 user nova-compute[75080]: WARNING nova.compute.manager [req-48842e95-2518-4b16-ba86-33b65287deca req-37962aab-24fa-4533-a0bc-a95bd272b088 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Received unexpected event network-vif-plugged-86318321-0dae-41ca-b65d-420d34a4524d for instance with vm_state building and task_state spawning.
Dec 05 15:52:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:20 user nova-compute[75080]: DEBUG nova.compute.manager [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:52:20 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:52:20 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Instance spawned successfully.
Dec 05 15:52:20 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 15:52:20 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:52:20 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:52:20 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:52:20 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:52:20 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:52:20 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 15:52:21 user nova-compute[75080]: INFO nova.compute.manager [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Took 4.89 seconds to spawn the instance on the hypervisor.
Dec 05 15:52:21 user nova-compute[75080]: DEBUG nova.compute.manager [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:52:21 user nova-compute[75080]: INFO nova.compute.manager [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Took 14.92 seconds to build instance.
Dec 05 15:52:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3612e16a-2e42-4d30-b7ad-64e306d0965f tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lock "329c6583-54c9-4cb4-a747-89986c2b1878" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.032s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:52:21 user nova-compute[75080]: DEBUG nova.compute.manager [req-df08d311-8c49-40f4-8fdc-51ccf53c5c2c req-326328b5-8a0b-4d5f-85ec-fed4fe418769 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Received event network-vif-plugged-86318321-0dae-41ca-b65d-420d34a4524d {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:52:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-df08d311-8c49-40f4-8fdc-51ccf53c5c2c req-326328b5-8a0b-4d5f-85ec-fed4fe418769 service nova] Acquiring lock "329c6583-54c9-4cb4-a747-89986c2b1878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:52:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-df08d311-8c49-40f4-8fdc-51ccf53c5c2c req-326328b5-8a0b-4d5f-85ec-fed4fe418769 service nova] Lock "329c6583-54c9-4cb4-a747-89986c2b1878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:52:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-df08d311-8c49-40f4-8fdc-51ccf53c5c2c req-326328b5-8a0b-4d5f-85ec-fed4fe418769 service nova] Lock "329c6583-54c9-4cb4-a747-89986c2b1878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:52:21 user nova-compute[75080]: DEBUG nova.compute.manager [req-df08d311-8c49-40f4-8fdc-51ccf53c5c2c req-326328b5-8a0b-4d5f-85ec-fed4fe418769 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] No waiting events found dispatching network-vif-plugged-86318321-0dae-41ca-b65d-420d34a4524d {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:52:21 user nova-compute[75080]: WARNING nova.compute.manager [req-df08d311-8c49-40f4-8fdc-51ccf53c5c2c req-326328b5-8a0b-4d5f-85ec-fed4fe418769 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Received unexpected event network-vif-plugged-86318321-0dae-41ca-b65d-420d34a4524d for instance with vm_state active and task_state None.
Dec 05 15:52:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:52:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 15:52:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:52:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:52:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:52 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:52:52 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:52:52 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:52:52 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:52:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:57 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:52:57 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:52:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:52:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:52:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:52:57 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:52:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:52:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:52:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:52:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:52:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:52:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:52:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:52:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:52:58 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:52:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:52:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:52:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:52:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:52:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:52:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:52:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:52:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:52:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:52:59 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:52:59 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:52:59 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=8619MB free_disk=24.93219757080078GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:52:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:52:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:52:59 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance db0fde77-eb40-4acb-93f7-66b5b76c8eea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:52:59 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 8608d2cf-476d-43b8-a124-c44507459a1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:52:59 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:52:59 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 329c6583-54c9-4cb4-a747-89986c2b1878 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:52:59 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:52:59 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:52:59 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:52:59 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:52:59 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:52:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.284s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:53:00 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:53:00 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:53:00 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Rebuilding the list of instances to heal {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 15:53:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-db0fde77-eb40-4acb-93f7-66b5b76c8eea" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:53:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-db0fde77-eb40-4acb-93f7-66b5b76c8eea" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:53:00 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 15:53:00 user nova-compute[75080]: DEBUG nova.objects.instance [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lazy-loading 'info_cache' on Instance uuid db0fde77-eb40-4acb-93f7-66b5b76c8eea {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:53:01 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:53:01 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Updating instance_info_cache with network_info: [{"id": "09233cd3-602f-4eb8-a74c-7d592a1a3906", "address": "fa:16:3e:44:84:7c", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09233cd3-60", "ovs_interfaceid": "09233cd3-602f-4eb8-a74c-7d592a1a3906", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:53:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-db0fde77-eb40-4acb-93f7-66b5b76c8eea" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:53:01 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 15:53:01 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:53:02 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:53:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:53:05 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:53:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:53:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:53:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 15:53:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:53:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:53:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:53:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:53:15 user nova-compute[75080]: DEBUG nova.compute.manager [req-5e5e57e0-4149-4d41-8d58-cec42b1f8ff5 req-f4d1b299-28a9-4b6d-b4fa-a5a82f2cc164 service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Received event network-changed-22ddcc5a-537d-41ac-b4c7-e4a702d84748 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:53:15 user nova-compute[75080]: DEBUG nova.compute.manager [req-5e5e57e0-4149-4d41-8d58-cec42b1f8ff5 req-f4d1b299-28a9-4b6d-b4fa-a5a82f2cc164 service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Refreshing instance network info cache due to event network-changed-22ddcc5a-537d-41ac-b4c7-e4a702d84748. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:53:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5e5e57e0-4149-4d41-8d58-cec42b1f8ff5 req-f4d1b299-28a9-4b6d-b4fa-a5a82f2cc164 service nova] Acquiring lock "refresh_cache-7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:53:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5e5e57e0-4149-4d41-8d58-cec42b1f8ff5 req-f4d1b299-28a9-4b6d-b4fa-a5a82f2cc164 service nova] Acquired lock "refresh_cache-7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:53:15 user nova-compute[75080]: DEBUG nova.network.neutron [req-5e5e57e0-4149-4d41-8d58-cec42b1f8ff5 req-f4d1b299-28a9-4b6d-b4fa-a5a82f2cc164 service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Refreshing network info cache for port 22ddcc5a-537d-41ac-b4c7-e4a702d84748 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:53:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:53:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:53:15 user nova-compute[75080]: DEBUG nova.objects.instance [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lazy-loading 'flavor' on Instance uuid 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:53:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:53:16 user nova-compute[75080]: DEBUG nova.network.neutron [req-5e5e57e0-4149-4d41-8d58-cec42b1f8ff5 req-f4d1b299-28a9-4b6d-b4fa-a5a82f2cc164 service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Updated VIF entry in instance network info cache for port 22ddcc5a-537d-41ac-b4c7-e4a702d84748. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:53:16 user nova-compute[75080]: DEBUG nova.network.neutron [req-5e5e57e0-4149-4d41-8d58-cec42b1f8ff5 req-f4d1b299-28a9-4b6d-b4fa-a5a82f2cc164 service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Updating instance_info_cache with network_info: [{"id": "22ddcc5a-537d-41ac-b4c7-e4a702d84748", "address": "fa:16:3e:2f:f6:98", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ddcc5a-53", "ovs_interfaceid": "22ddcc5a-537d-41ac-b4c7-e4a702d84748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:53:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5e5e57e0-4149-4d41-8d58-cec42b1f8ff5 req-f4d1b299-28a9-4b6d-b4fa-a5a82f2cc164 service nova] Releasing lock "refresh_cache-7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:53:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:53:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:53:16 user nova-compute[75080]: INFO nova.compute.manager [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Attaching volume 02cc512a-4437-4f1a-8dfe-07e55fba1d55 to /dev/vdb
Dec 05 15:53:16 user nova-compute[75080]: DEBUG os_brick.utils [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:53:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:53:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:53:16 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[066e9243-556c-430d-b4de-e675d6496194]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:53:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:53:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:53:16 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c06a340-797c-4c6a-9bbb-5e2014e2d87e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:53:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:53:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:53:16 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe88f319-159a-4efc-a15b-45d8471f2097]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:53:16 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa58cc4c-c16d-4762-9867-54ba6f0c1699]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:53:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:53:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:53:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:53:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:53:16 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:53:16 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:53:16 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d4df8d-cbed-4692-a089-c1ad530a0987]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:53:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:53:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:53:16 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:53:16 user nova-compute[75080]: DEBUG os_brick.utils [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:53:16 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Updating existing volume attachment record: bc155a5d-3489-4029-9bab-3cd7a970ab80 {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:53:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:53:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:53:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 15:53:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:53:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:53:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:53:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:53:18 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:53:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:53:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:53:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:53:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:53:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:53:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:53:18 user nova-compute[75080]: DEBUG nova.virt.libvirt.imagecache [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Verify base images {{(pid=75080) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Dec 05 15:53:18 user nova-compute[75080]: DEBUG nova.virt.libvirt.imagecache [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75080) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Dec 05 15:53:18 user nova-compute[75080]: DEBUG nova.virt.libvirt.imagecache [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Image id 945b9282-153c-4cca-bc1c-40b0d399f793 yields fingerprint ed68b1c252927ed00fc816385a65373cdd096dee {{(pid=75080) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Dec 05 15:53:18 user nova-compute[75080]: INFO nova.virt.libvirt.imagecache [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] image 945b9282-153c-4cca-bc1c-40b0d399f793 at (/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee): checking
Dec 05 15:53:18 user nova-compute[75080]: DEBUG nova.virt.libvirt.imagecache [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] image 945b9282-153c-4cca-bc1c-40b0d399f793 at (/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee): image is in use {{(pid=75080) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Dec 05 15:53:18 user nova-compute[75080]: DEBUG nova.virt.libvirt.imagecache [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] 329c6583-54c9-4cb4-a747-89986c2b1878 is a valid instance name {{(pid=75080) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Dec 05 15:53:18 user nova-compute[75080]: DEBUG nova.virt.libvirt.imagecache [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] db0fde77-eb40-4acb-93f7-66b5b76c8eea is a valid instance name {{(pid=75080) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Dec 05 15:53:18 user nova-compute[75080]: DEBUG nova.virt.libvirt.imagecache [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] db0fde77-eb40-4acb-93f7-66b5b76c8eea has a disk file {{(pid=75080) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Dec 05 15:53:18 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:53:18 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:53:18 user nova-compute[75080]: DEBUG nova.virt.libvirt.imagecache [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance db0fde77-eb40-4acb-93f7-66b5b76c8eea is backed by ed68b1c252927ed00fc816385a65373cdd096dee {{(pid=75080) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Dec 05 15:53:18 user nova-compute[75080]: DEBUG nova.virt.libvirt.imagecache [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274 is a valid instance name {{(pid=75080) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Dec 05 15:53:18 user nova-compute[75080]: DEBUG nova.virt.libvirt.imagecache [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274 has a disk file {{(pid=75080) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Dec 05 15:53:18 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:53:18 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:53:18 user nova-compute[75080]: DEBUG nova.virt.libvirt.imagecache [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274 is backed by ed68b1c252927ed00fc816385a65373cdd096dee {{(pid=75080) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Dec 05 15:53:18 user nova-compute[75080]: DEBUG nova.virt.libvirt.imagecache [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] 8608d2cf-476d-43b8-a124-c44507459a1e is a valid instance name {{(pid=75080) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Dec 05 15:53:18 user nova-compute[75080]: DEBUG nova.virt.libvirt.imagecache [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] 8608d2cf-476d-43b8-a124-c44507459a1e has a disk file {{(pid=75080) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Dec 05 15:53:18 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:53:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:53:19 user nova-compute[75080]: DEBUG nova.virt.libvirt.imagecache [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 8608d2cf-476d-43b8-a124-c44507459a1e is backed by ed68b1c252927ed00fc816385a65373cdd096dee {{(pid=75080) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Dec 05 15:53:19 user nova-compute[75080]: WARNING nova.virt.libvirt.imagecache [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/79d3f9a84388fc1fdb2993dc4445d36dd5ea24e1
Dec 05 15:53:19 user nova-compute[75080]: WARNING nova.virt.libvirt.imagecache [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2065b70a707228fa5425420645de326baa55157b
Dec 05 15:53:19 user nova-compute[75080]: WARNING nova.virt.libvirt.imagecache [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/00d562a34d978f94f36ce8eac0c1b4637d3be4b1
Dec 05 15:53:19 user nova-compute[75080]: WARNING nova.virt.libvirt.imagecache [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d9aa3c5f8b5c503db2afd90145ce9213ead0dc0c
Dec 05 15:53:19 user nova-compute[75080]: WARNING nova.virt.libvirt.imagecache [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a063d7d82bff4ce73d73f3ee60fd7ac80a1dc0e3
Dec 05 15:53:19 user nova-compute[75080]: WARNING nova.virt.libvirt.imagecache [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/37ea81c1c9d0902561967135c472dc0a71c01997
Dec 05 15:53:19 user nova-compute[75080]: WARNING nova.virt.libvirt.imagecache [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/0fdcd1adbc55311e43e8b7a1fda6100cfedd56d3
Dec 05 15:53:19 user nova-compute[75080]: WARNING nova.virt.libvirt.imagecache [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/743326af1c1b89416c168e55cb540fe715fcd5cd
Dec 05 15:53:19 user nova-compute[75080]: WARNING nova.virt.libvirt.imagecache [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/da6ea48d427fd5057b2c2ccf2b1b00b8b2b0d5e0
Dec 05 15:53:19 user nova-compute[75080]: INFO nova.virt.libvirt.imagecache [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Active base files: /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee
Dec 05 15:53:19 user nova-compute[75080]: INFO nova.virt.libvirt.imagecache [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Removable base files: /opt/stack/data/nova/instances/_base/79d3f9a84388fc1fdb2993dc4445d36dd5ea24e1 /opt/stack/data/nova/instances/_base/2065b70a707228fa5425420645de326baa55157b /opt/stack/data/nova/instances/_base/00d562a34d978f94f36ce8eac0c1b4637d3be4b1 /opt/stack/data/nova/instances/_base/d9aa3c5f8b5c503db2afd90145ce9213ead0dc0c /opt/stack/data/nova/instances/_base/a063d7d82bff4ce73d73f3ee60fd7ac80a1dc0e3 /opt/stack/data/nova/instances/_base/37ea81c1c9d0902561967135c472dc0a71c01997 /opt/stack/data/nova/instances/_base/0fdcd1adbc55311e43e8b7a1fda6100cfedd56d3 /opt/stack/data/nova/instances/_base/743326af1c1b89416c168e55cb540fe715fcd5cd /opt/stack/data/nova/instances/_base/da6ea48d427fd5057b2c2ccf2b1b00b8b2b0d5e0
Dec 05 15:53:19 user nova-compute[75080]: INFO nova.virt.libvirt.imagecache [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/79d3f9a84388fc1fdb2993dc4445d36dd5ea24e1
Dec 05 15:53:19 user nova-compute[75080]: INFO nova.virt.libvirt.imagecache [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2065b70a707228fa5425420645de326baa55157b
Dec 05 15:53:19 user nova-compute[75080]: INFO nova.virt.libvirt.imagecache [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/00d562a34d978f94f36ce8eac0c1b4637d3be4b1
Dec 05 15:53:19 user nova-compute[75080]: INFO nova.virt.libvirt.imagecache [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d9aa3c5f8b5c503db2afd90145ce9213ead0dc0c
Dec 05 15:53:19 user nova-compute[75080]: INFO nova.virt.libvirt.imagecache [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a063d7d82bff4ce73d73f3ee60fd7ac80a1dc0e3
Dec 05 15:53:19 user nova-compute[75080]: INFO nova.virt.libvirt.imagecache [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/37ea81c1c9d0902561967135c472dc0a71c01997
Dec 05 15:53:19 user nova-compute[75080]: INFO nova.virt.libvirt.imagecache [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0fdcd1adbc55311e43e8b7a1fda6100cfedd56d3
Dec 05 15:53:19 user nova-compute[75080]: INFO nova.virt.libvirt.imagecache [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/743326af1c1b89416c168e55cb540fe715fcd5cd
Dec 05 15:53:19 user nova-compute[75080]: INFO nova.virt.libvirt.imagecache [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/da6ea48d427fd5057b2c2ccf2b1b00b8b2b0d5e0
Dec 05 15:53:19 user nova-compute[75080]: DEBUG nova.virt.libvirt.imagecache [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Verification complete {{(pid=75080) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Dec 05 15:53:19 user nova-compute[75080]: DEBUG nova.virt.libvirt.imagecache [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Verify swap images {{(pid=75080) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Dec 05 15:53:19 user nova-compute[75080]: DEBUG nova.virt.libvirt.imagecache [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Verify ephemeral images {{(pid=75080) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Dec 05 15:53:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:53:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IaAtsfmw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:53:25 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:53:25 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:53:25 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:53:25 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:53:25 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:53:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55 -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[74de514a-5ea1-4275-8012-c35558998894]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:53:25 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55 -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c79c6fd-4cad-4f44-9450-dfb26e52bd9b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55] added
Dec 05 15:53:25 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3211565c-0e06-4a66-8719-5857984d952e]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b457f7e7-046c-4266-9c4c-0e6ee3cb61dd]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IaAtsfmw {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IaAtsfmw" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d15c444-6824-47a5-995e-77b0fd2be61c]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IaAtsfmw'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78423c8-42dd-4bb2-8399-bc2a232f7649]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cddab5b-c640-43a0-9f6f-545a9b70726f]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 (non-flash)
Dec 05 15:53:25 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 (non-flash)
Dec 05 15:53:25 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55 -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[47416d00-bb06-49cb-bda2-c89a7c5c7683]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55, portal: 172.16.0.220,3260]
Dec 05 15:53:25 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55, portal: 172.16.0.220,3260] successful.
Dec 05 15:53:25 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cff63d-ac55-4f97-a44b-9a95df407767]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e76af4-0c7b-438a-b9c8-02a9b5b31814]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 (non-flash)
Dec 05 15:53:25 user nova-compute[75080]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55 (non-flash)
Dec 05 15:53:25 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 (non-flash)
Dec 05 15:53:25 user nova-compute[75080]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55 (non-flash)
Dec 05 15:53:25 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8dc9b6-c7bd-4f86-a8bd-00a242918bb9]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:53:25 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: None {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:53:26 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:53:26 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IaAtsfmw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:53:26 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:53:26 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26166653630336334', 'path': '/dev/sdc'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:53:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166653630336334', 'path': '/dev/sdc'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:53:26 user nova-compute[75080]: DEBUG nova.objects.instance [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lazy-loading 'flavor' on Instance uuid 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:53:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 15:53:26 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:53:26 user nova-compute[75080]:   <source dev="/dev/sdc"/>
Dec 05 15:53:26 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:53:26 user nova-compute[75080]:   <serial>02cc512a-4437-4f1a-8dfe-07e55fba1d55</serial>
Dec 05 15:53:26 user nova-compute[75080]: </disk>
Dec 05 15:53:26 user nova-compute[75080]:  {{(pid=75080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 15:53:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:53:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:53:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] No VIF found with MAC fa:16:3e:2f:f6:98, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:53:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-478e7816-6662-4b91-90d7-7dab0bd9c7a2 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.123s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:53:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:53:28 user nova-compute[75080]: INFO nova.compute.manager [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Rescuing
Dec 05 15:53:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "refresh_cache-7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:53:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquired lock "refresh_cache-7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:53:28 user nova-compute[75080]: DEBUG nova.network.neutron [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:53:28 user nova-compute[75080]: DEBUG nova.network.neutron [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Updating instance_info_cache with network_info: [{"id": "22ddcc5a-537d-41ac-b4c7-e4a702d84748", "address": "fa:16:3e:2f:f6:98", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ddcc5a-53", "ovs_interfaceid": "22ddcc5a-537d-41ac-b4c7-e4a702d84748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:53:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Releasing lock "refresh_cache-7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:53:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:53:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:53:29 user nova-compute[75080]: DEBUG nova.compute.manager [req-f50b5113-0232-48ff-95e1-4cc2345d227e req-5c8137b9-828d-4753-8335-8c6a5a8e2380 service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Received event network-vif-unplugged-22ddcc5a-537d-41ac-b4c7-e4a702d84748 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:53:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f50b5113-0232-48ff-95e1-4cc2345d227e req-5c8137b9-828d-4753-8335-8c6a5a8e2380 service nova] Acquiring lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:53:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f50b5113-0232-48ff-95e1-4cc2345d227e req-5c8137b9-828d-4753-8335-8c6a5a8e2380 service nova] Lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:53:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f50b5113-0232-48ff-95e1-4cc2345d227e req-5c8137b9-828d-4753-8335-8c6a5a8e2380 service nova] Lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:53:29 user nova-compute[75080]: DEBUG nova.compute.manager [req-f50b5113-0232-48ff-95e1-4cc2345d227e req-5c8137b9-828d-4753-8335-8c6a5a8e2380 service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] No waiting events found dispatching network-vif-unplugged-22ddcc5a-537d-41ac-b4c7-e4a702d84748 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:53:29 user nova-compute[75080]: WARNING nova.compute.manager [req-f50b5113-0232-48ff-95e1-4cc2345d227e req-5c8137b9-828d-4753-8335-8c6a5a8e2380 service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Received unexpected event network-vif-unplugged-22ddcc5a-537d-41ac-b4c7-e4a702d84748 for instance with vm_state active and task_state rescuing.
Dec 05 15:53:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:53:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:53:29 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Instance destroyed successfully.
Dec 05 15:53:29 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Attempting rescue
Dec 05 15:53:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75080) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 05 15:53:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Instance directory exists: not creating {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 05 15:53:29 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Creating image(s)
Dec 05 15:53:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "/opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:53:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "/opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:53:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "/opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:53:29 user nova-compute[75080]: DEBUG nova.objects.instance [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:53:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:53:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:53:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:53:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.178s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:53:29 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk.rescue {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:53:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk.rescue" returned: 0 in 0.060s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:53:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:53:30 user nova-compute[75080]: DEBUG nova.objects.instance [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lazy-loading 'migration_context' on Instance uuid 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:53:30 user nova-compute[75080]: DEBUG nova.objects.base [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Object Instance<7b2885bd-b61d-4e6f-9a6b-ba5939ae6274> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:53:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 15:53:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Start _get_guest_xml network_info=[{"id": "22ddcc5a-537d-41ac-b4c7-e4a702d84748", "address": "fa:16:3e:2f:f6:98", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "vif_mac": "fa:16:3e:2f:f6:98"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ddcc5a-53", "ovs_interfaceid": "22ddcc5a-537d-41ac-b4c7-e4a702d84748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:53:30 user nova-compute[75080]: DEBUG nova.objects.instance [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lazy-loading 'resources' on Instance uuid 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:53:30 user nova-compute[75080]: DEBUG nova.objects.base [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Object Instance<7b2885bd-b61d-4e6f-9a6b-ba5939ae6274> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:53:30 user nova-compute[75080]: DEBUG nova.objects.instance [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lazy-loading 'numa_topology' on Instance uuid 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:53:30 user nova-compute[75080]: DEBUG nova.objects.base [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Object Instance<7b2885bd-b61d-4e6f-9a6b-ba5939ae6274> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:53:30 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:53:30 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:53:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:53:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:53:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:53:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:53:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:53:30 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:53:30 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:53:30 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:53:30 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:53:30 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:53:30 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:53:30 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:53:30 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:53:30 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:53:30 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:53:30 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:53:30 user nova-compute[75080]: DEBUG nova.objects.instance [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:53:30 user nova-compute[75080]: DEBUG nova.objects.base [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Object Instance<7b2885bd-b61d-4e6f-9a6b-ba5939ae6274> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:53:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:51:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-199249757',display_name='tempest-ServerRescueNegativeTestJSON-server-199249757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-199249757',id=47,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAgxSWkE/X5Qmy90sb5F3iA/7Io6ebkQVGemg7IdToZcm2LVt34tO/RkaNoO/5BDm6wpIZMOgIbznVpPEpc/oyLgJQw+s1ZWNaskbKmcyuJfpER0nfleTcXApBfkK9c+6A==',key_name='tempest-keypair-1096119825',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:51:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cea1ac008cfd499a8df635aac9b1342d',ramdisk_id='',reservation_id='r-ukmdqv62',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1626475760',owner_user_name='tempest-ServerRescueNegativeTestJSON-1626475760-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T15:51:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1afa4590c69f423d97f7cd485e193b0f',uuid=7b2885bd-b61d-4e6f-9a6b-ba5939ae6274,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22ddcc5a-537d-41ac-b4c7-e4a702d84748", "address": "fa:16:3e:2f:f6:98", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "vif_mac": "fa:16:3e:2f:f6:98"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ddcc5a-53", "ovs_interfaceid": "22ddcc5a-537d-41ac-b4c7-e4a702d84748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:53:30 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Converting VIF {"id": "22ddcc5a-537d-41ac-b4c7-e4a702d84748", "address": "fa:16:3e:2f:f6:98", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "vif_mac": "fa:16:3e:2f:f6:98"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ddcc5a-53", "ovs_interfaceid": "22ddcc5a-537d-41ac-b4c7-e4a702d84748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:53:30 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:f6:98,bridge_name='br-int',has_traffic_filtering=True,id=22ddcc5a-537d-41ac-b4c7-e4a702d84748,network=Network(c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22ddcc5a-53') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:53:30 user nova-compute[75080]: DEBUG nova.objects.instance [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:53:30 user nova-compute[75080]: DEBUG nova.objects.base [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Object Instance<7b2885bd-b61d-4e6f-9a6b-ba5939ae6274> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:53:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:53:30 user nova-compute[75080]:   <uuid>7b2885bd-b61d-4e6f-9a6b-ba5939ae6274</uuid>
Dec 05 15:53:30 user nova-compute[75080]:   <name>instance-0000002f</name>
Dec 05 15:53:30 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:53:30 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:53:30 user nova-compute[75080]:   <metadata>
Dec 05 15:53:30 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:53:30 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:53:30 user nova-compute[75080]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-199249757</nova:name>
Dec 05 15:53:30 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:53:30</nova:creationTime>
Dec 05 15:53:30 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:53:30 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:53:30 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:53:30 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:53:30 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:53:30 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:53:30 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:53:30 user nova-compute[75080]:       <nova:owner>
Dec 05 15:53:30 user nova-compute[75080]:         <nova:user uuid="1afa4590c69f423d97f7cd485e193b0f">tempest-ServerRescueNegativeTestJSON-1626475760-project-member</nova:user>
Dec 05 15:53:30 user nova-compute[75080]:         <nova:project uuid="cea1ac008cfd499a8df635aac9b1342d">tempest-ServerRescueNegativeTestJSON-1626475760</nova:project>
Dec 05 15:53:30 user nova-compute[75080]:       </nova:owner>
Dec 05 15:53:30 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 15:53:30 user nova-compute[75080]:       <nova:ports>
Dec 05 15:53:30 user nova-compute[75080]:         <nova:port uuid="22ddcc5a-537d-41ac-b4c7-e4a702d84748">
Dec 05 15:53:30 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 05 15:53:30 user nova-compute[75080]:         </nova:port>
Dec 05 15:53:30 user nova-compute[75080]:       </nova:ports>
Dec 05 15:53:30 user nova-compute[75080]:     </nova:instance>
Dec 05 15:53:30 user nova-compute[75080]:   </metadata>
Dec 05 15:53:30 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:53:30 user nova-compute[75080]:     <system>
Dec 05 15:53:30 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:53:30 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:53:30 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:53:30 user nova-compute[75080]:       <entry name="serial">7b2885bd-b61d-4e6f-9a6b-ba5939ae6274</entry>
Dec 05 15:53:30 user nova-compute[75080]:       <entry name="uuid">7b2885bd-b61d-4e6f-9a6b-ba5939ae6274</entry>
Dec 05 15:53:30 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:53:30 user nova-compute[75080]:     </system>
Dec 05 15:53:30 user nova-compute[75080]:   </sysinfo>
Dec 05 15:53:30 user nova-compute[75080]:   <os>
Dec 05 15:53:30 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:53:30 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:53:30 user nova-compute[75080]:   </os>
Dec 05 15:53:30 user nova-compute[75080]:   <features>
Dec 05 15:53:30 user nova-compute[75080]:     <acpi/>
Dec 05 15:53:30 user nova-compute[75080]:     <apic/>
Dec 05 15:53:30 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:53:30 user nova-compute[75080]:   </features>
Dec 05 15:53:30 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:53:30 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:53:30 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:53:30 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:53:30 user nova-compute[75080]:   </clock>
Dec 05 15:53:30 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:53:30 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:53:30 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:53:30 user nova-compute[75080]:   </cpu>
Dec 05 15:53:30 user nova-compute[75080]:   <devices>
Dec 05 15:53:30 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:53:30 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:53:30 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk.rescue"/>
Dec 05 15:53:30 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:53:30 user nova-compute[75080]:     </disk>
Dec 05 15:53:30 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 15:53:30 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 15:53:30 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk"/>
Dec 05 15:53:30 user nova-compute[75080]:       <target dev="vdb" bus="virtio"/>
Dec 05 15:53:30 user nova-compute[75080]:     </disk>
Dec 05 15:53:30 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:53:30 user nova-compute[75080]:       <mac address="fa:16:3e:2f:f6:98"/>
Dec 05 15:53:30 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:53:30 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:53:30 user nova-compute[75080]:       <target dev="tap22ddcc5a-53"/>
Dec 05 15:53:30 user nova-compute[75080]:     </interface>
Dec 05 15:53:30 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:53:30 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/console.log" append="off"/>
Dec 05 15:53:30 user nova-compute[75080]:     </serial>
Dec 05 15:53:30 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:53:30 user nova-compute[75080]:     <video>
Dec 05 15:53:30 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:53:30 user nova-compute[75080]:     </video>
Dec 05 15:53:30 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:53:30 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:53:30 user nova-compute[75080]:     </rng>
Dec 05 15:53:30 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:53:30 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:53:30 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:53:30 user nova-compute[75080]:     </memballoon>
Dec 05 15:53:30 user nova-compute[75080]:   </devices>
Dec 05 15:53:30 user nova-compute[75080]: </domain>
Dec 05 15:53:30 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:53:30 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Instance destroyed successfully.
Dec 05 15:53:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:53:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:53:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] No VIF found with MAC fa:16:3e:2f:f6:98, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:53:31 user nova-compute[75080]: DEBUG nova.compute.manager [req-d86dc71f-8f01-4adf-86ea-7ceb6c544a67 req-f59d0001-fe86-4a6a-885d-2135ef708c90 service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Received event network-vif-plugged-22ddcc5a-537d-41ac-b4c7-e4a702d84748 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:53:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d86dc71f-8f01-4adf-86ea-7ceb6c544a67 req-f59d0001-fe86-4a6a-885d-2135ef708c90 service nova] Acquiring lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:53:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d86dc71f-8f01-4adf-86ea-7ceb6c544a67 req-f59d0001-fe86-4a6a-885d-2135ef708c90 service nova] Lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:53:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d86dc71f-8f01-4adf-86ea-7ceb6c544a67 req-f59d0001-fe86-4a6a-885d-2135ef708c90 service nova] Lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:53:31 user nova-compute[75080]: DEBUG nova.compute.manager [req-d86dc71f-8f01-4adf-86ea-7ceb6c544a67 req-f59d0001-fe86-4a6a-885d-2135ef708c90 service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] No waiting events found dispatching network-vif-plugged-22ddcc5a-537d-41ac-b4c7-e4a702d84748 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:53:31 user nova-compute[75080]: WARNING nova.compute.manager [req-d86dc71f-8f01-4adf-86ea-7ceb6c544a67 req-f59d0001-fe86-4a6a-885d-2135ef708c90 service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Received unexpected event network-vif-plugged-22ddcc5a-537d-41ac-b4c7-e4a702d84748 for instance with vm_state active and task_state rescuing.
Dec 05 15:53:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:53:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:53:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:53:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:53:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:53:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:53:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:53:33 user nova-compute[75080]: DEBUG nova.compute.manager [req-e4bba0a8-e134-4947-81b6-5c9876330259 req-10e6cf92-a756-4343-a8a4-edff7f10c2b8 service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Received event network-vif-plugged-22ddcc5a-537d-41ac-b4c7-e4a702d84748 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:53:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-e4bba0a8-e134-4947-81b6-5c9876330259 req-10e6cf92-a756-4343-a8a4-edff7f10c2b8 service nova] Acquiring lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:53:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-e4bba0a8-e134-4947-81b6-5c9876330259 req-10e6cf92-a756-4343-a8a4-edff7f10c2b8 service nova] Lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:53:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-e4bba0a8-e134-4947-81b6-5c9876330259 req-10e6cf92-a756-4343-a8a4-edff7f10c2b8 service nova] Lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:53:33 user nova-compute[75080]: DEBUG nova.compute.manager [req-e4bba0a8-e134-4947-81b6-5c9876330259 req-10e6cf92-a756-4343-a8a4-edff7f10c2b8 service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] No waiting events found dispatching network-vif-plugged-22ddcc5a-537d-41ac-b4c7-e4a702d84748 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:53:33 user nova-compute[75080]: WARNING nova.compute.manager [req-e4bba0a8-e134-4947-81b6-5c9876330259 req-10e6cf92-a756-4343-a8a4-edff7f10c2b8 service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Received unexpected event network-vif-plugged-22ddcc5a-537d-41ac-b4c7-e4a702d84748 for instance with vm_state active and task_state rescuing.
Dec 05 15:53:33 user nova-compute[75080]: DEBUG nova.compute.manager [req-e4bba0a8-e134-4947-81b6-5c9876330259 req-10e6cf92-a756-4343-a8a4-edff7f10c2b8 service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Received event network-vif-plugged-22ddcc5a-537d-41ac-b4c7-e4a702d84748 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:53:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-e4bba0a8-e134-4947-81b6-5c9876330259 req-10e6cf92-a756-4343-a8a4-edff7f10c2b8 service nova] Acquiring lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:53:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-e4bba0a8-e134-4947-81b6-5c9876330259 req-10e6cf92-a756-4343-a8a4-edff7f10c2b8 service nova] Lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:53:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-e4bba0a8-e134-4947-81b6-5c9876330259 req-10e6cf92-a756-4343-a8a4-edff7f10c2b8 service nova] Lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:53:33 user nova-compute[75080]: DEBUG nova.compute.manager [req-e4bba0a8-e134-4947-81b6-5c9876330259 req-10e6cf92-a756-4343-a8a4-edff7f10c2b8 service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] No waiting events found dispatching network-vif-plugged-22ddcc5a-537d-41ac-b4c7-e4a702d84748 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:53:33 user nova-compute[75080]: WARNING nova.compute.manager [req-e4bba0a8-e134-4947-81b6-5c9876330259 req-10e6cf92-a756-4343-a8a4-edff7f10c2b8 service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Received unexpected event network-vif-plugged-22ddcc5a-537d-41ac-b4c7-e4a702d84748 for instance with vm_state active and task_state rescuing.
Dec 05 15:53:33 user nova-compute[75080]: DEBUG nova.compute.manager [None req-3c187f59-927f-48f9-8956-a5d4d7e58986 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:53:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:53:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:53:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:53:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:53:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:53:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:53:53 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:53:53 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:53:54 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:53:54 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:53:54 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:53:54 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Cleaning up deleted instances {{(pid=75080) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 05 15:53:54 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] There are 0 instances to clean {{(pid=75080) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 05 15:53:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:53:57 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:53:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:53:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:53:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:53:57 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:53:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:53:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:53:57 user nova-compute[75080]: DEBUG nova.compute.manager [req-8cb3d202-6b3c-4db1-a78f-cab1a0e7fa81 req-acd766d5-dc30-4d1c-88d3-6fb62ef0bb0c service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Received event network-changed-86318321-0dae-41ca-b65d-420d34a4524d {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:53:57 user nova-compute[75080]: DEBUG nova.compute.manager [req-8cb3d202-6b3c-4db1-a78f-cab1a0e7fa81 req-acd766d5-dc30-4d1c-88d3-6fb62ef0bb0c service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Refreshing instance network info cache due to event network-changed-86318321-0dae-41ca-b65d-420d34a4524d. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:53:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8cb3d202-6b3c-4db1-a78f-cab1a0e7fa81 req-acd766d5-dc30-4d1c-88d3-6fb62ef0bb0c service nova] Acquiring lock "refresh_cache-329c6583-54c9-4cb4-a747-89986c2b1878" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:53:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8cb3d202-6b3c-4db1-a78f-cab1a0e7fa81 req-acd766d5-dc30-4d1c-88d3-6fb62ef0bb0c service nova] Acquired lock "refresh_cache-329c6583-54c9-4cb4-a747-89986c2b1878" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:53:57 user nova-compute[75080]: DEBUG nova.network.neutron [req-8cb3d202-6b3c-4db1-a78f-cab1a0e7fa81 req-acd766d5-dc30-4d1c-88d3-6fb62ef0bb0c service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Refreshing network info cache for port 86318321-0dae-41ca-b65d-420d34a4524d {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:53:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:53:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:53:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:53:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:53:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:53:58 user nova-compute[75080]: DEBUG nova.network.neutron [req-8cb3d202-6b3c-4db1-a78f-cab1a0e7fa81 req-acd766d5-dc30-4d1c-88d3-6fb62ef0bb0c service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Updated VIF entry in instance network info cache for port 86318321-0dae-41ca-b65d-420d34a4524d. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:53:58 user nova-compute[75080]: DEBUG nova.network.neutron [req-8cb3d202-6b3c-4db1-a78f-cab1a0e7fa81 req-acd766d5-dc30-4d1c-88d3-6fb62ef0bb0c service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Updating instance_info_cache with network_info: [{"id": "86318321-0dae-41ca-b65d-420d34a4524d", "address": "fa:16:3e:0b:ba:19", "network": {"id": "a7d887a3-0434-4d0a-933b-5e2605ccc742", "bridge": "br-int", "label": "tempest-TestShelveInstance-763789771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e19ed3436a3f43a3b4a69e81a76bb263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86318321-0d", "ovs_interfaceid": "86318321-0dae-41ca-b65d-420d34a4524d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:53:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:53:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:53:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-8cb3d202-6b3c-4db1-a78f-cab1a0e7fa81 req-acd766d5-dc30-4d1c-88d3-6fb62ef0bb0c service nova] Releasing lock "refresh_cache-329c6583-54c9-4cb4-a747-89986c2b1878" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:53:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Acquiring lock "329c6583-54c9-4cb4-a747-89986c2b1878" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:53:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lock "329c6583-54c9-4cb4-a747-89986c2b1878" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:53:58 user nova-compute[75080]: INFO nova.compute.manager [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Shelve offloading
Dec 05 15:53:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:53:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:53:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:53:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:53:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:53:58 user nova-compute[75080]: DEBUG nova.compute.manager [req-587ac7f2-32f5-4ebf-83fb-433c51c54959 req-2fb33ac9-994b-4f60-af2d-fc356cc331a9 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Received event network-vif-unplugged-86318321-0dae-41ca-b65d-420d34a4524d {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:53:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-587ac7f2-32f5-4ebf-83fb-433c51c54959 req-2fb33ac9-994b-4f60-af2d-fc356cc331a9 service nova] Acquiring lock "329c6583-54c9-4cb4-a747-89986c2b1878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:53:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-587ac7f2-32f5-4ebf-83fb-433c51c54959 req-2fb33ac9-994b-4f60-af2d-fc356cc331a9 service nova] Lock "329c6583-54c9-4cb4-a747-89986c2b1878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:53:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-587ac7f2-32f5-4ebf-83fb-433c51c54959 req-2fb33ac9-994b-4f60-af2d-fc356cc331a9 service nova] Lock "329c6583-54c9-4cb4-a747-89986c2b1878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:53:58 user nova-compute[75080]: DEBUG nova.compute.manager [req-587ac7f2-32f5-4ebf-83fb-433c51c54959 req-2fb33ac9-994b-4f60-af2d-fc356cc331a9 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] No waiting events found dispatching network-vif-unplugged-86318321-0dae-41ca-b65d-420d34a4524d {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:53:58 user nova-compute[75080]: WARNING nova.compute.manager [req-587ac7f2-32f5-4ebf-83fb-433c51c54959 req-2fb33ac9-994b-4f60-af2d-fc356cc331a9 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Received unexpected event network-vif-unplugged-86318321-0dae-41ca-b65d-420d34a4524d for instance with vm_state active and task_state shelving.
Dec 05 15:53:58 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:53:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:53:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:53:58 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:53:59 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Instance destroyed successfully.
Dec 05 15:53:59 user nova-compute[75080]: DEBUG nova.compute.manager [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:53:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Acquiring lock "refresh_cache-329c6583-54c9-4cb4-a747-89986c2b1878" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:53:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Acquired lock "refresh_cache-329c6583-54c9-4cb4-a747-89986c2b1878" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:53:59 user nova-compute[75080]: DEBUG nova.network.neutron [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:53:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:53:59 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk (vdb) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:53:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:53:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:53:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:53:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:53:59 user nova-compute[75080]: DEBUG nova.network.neutron [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Updating instance_info_cache with network_info: [{"id": "86318321-0dae-41ca-b65d-420d34a4524d", "address": "fa:16:3e:0b:ba:19", "network": {"id": "a7d887a3-0434-4d0a-933b-5e2605ccc742", "bridge": "br-int", "label": "tempest-TestShelveInstance-763789771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e19ed3436a3f43a3b4a69e81a76bb263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86318321-0d", "ovs_interfaceid": "86318321-0dae-41ca-b65d-420d34a4524d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:53:59 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:53:59 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:53:59 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=8669MB free_disk=24.92205047607422GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:53:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:53:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:53:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Releasing lock "refresh_cache-329c6583-54c9-4cb4-a747-89986c2b1878" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance db0fde77-eb40-4acb-93f7-66b5b76c8eea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 8608d2cf-476d-43b8-a124-c44507459a1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 329c6583-54c9-4cb4-a747-89986c2b1878 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing inventories for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Updating ProviderTree inventory for provider 21b770fa-b774-46c9-9415-db26064ccd0f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Updating inventory in ProviderTree for provider 21b770fa-b774-46c9-9415-db26064ccd0f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing aggregate associations for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f, aggregates: None {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing trait associations for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f, traits: COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.554s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75080) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 05 15:54:00 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Instance destroyed successfully.
Dec 05 15:54:00 user nova-compute[75080]: DEBUG nova.objects.instance [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lazy-loading 'resources' on Instance uuid 329c6583-54c9-4cb4-a747-89986c2b1878 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:52:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1630400400',display_name='tempest-TestShelveInstance-server-1630400400',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1630400400',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmKfgAKgMU6IomiZs7rO+j8BLtupVV252Mpj3PRlhKsLoH3JO7LcuKNG35YGaZ/sdpoln2GZLbf+bTXedFhdkFU932m2Eaw3wJf2Gfx9vPzyGtXMYVdjuBSvDTqkEncGQ==',key_name='tempest-TestShelveInstance-951166409',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:52:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e19ed3436a3f43a3b4a69e81a76bb263',ramdisk_id='',reservation_id='r-15caxesf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1198767828',owner_user_name='tempest-TestShelveInstance-1198767828-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:52:21Z,user_data=None,user_id='dc433b4ab35c404f83f8729ee04fb164',uuid=329c6583-54c9-4cb4-a747-89986c2b1878,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86318321-0dae-41ca-b65d-420d34a4524d", "address": "fa:16:3e:0b:ba:19", "network": {"id": "a7d887a3-0434-4d0a-933b-5e2605ccc742", "bridge": "br-int", "label": "tempest-TestShelveInstance-763789771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e19ed3436a3f43a3b4a69e81a76bb263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86318321-0d", "ovs_interfaceid": "86318321-0dae-41ca-b65d-420d34a4524d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Converting VIF {"id": "86318321-0dae-41ca-b65d-420d34a4524d", "address": "fa:16:3e:0b:ba:19", "network": {"id": "a7d887a3-0434-4d0a-933b-5e2605ccc742", "bridge": "br-int", "label": "tempest-TestShelveInstance-763789771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e19ed3436a3f43a3b4a69e81a76bb263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86318321-0d", "ovs_interfaceid": "86318321-0dae-41ca-b65d-420d34a4524d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ba:19,bridge_name='br-int',has_traffic_filtering=True,id=86318321-0dae-41ca-b65d-420d34a4524d,network=Network(a7d887a3-0434-4d0a-933b-5e2605ccc742),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86318321-0d') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG os_vif [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ba:19,bridge_name='br-int',has_traffic_filtering=True,id=86318321-0dae-41ca-b65d-420d34a4524d,network=Network(a7d887a3-0434-4d0a-933b-5e2605ccc742),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86318321-0d') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86318321-0d, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=32577afb-604d-4526-afc2-412a325980b8) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG nova.compute.manager [req-c7954a6a-7e21-406b-9a22-4bec3ed2357d req-65fa12dd-063c-4303-a0e4-0862ef287af2 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Received event network-changed-86318321-0dae-41ca-b65d-420d34a4524d {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG nova.compute.manager [req-c7954a6a-7e21-406b-9a22-4bec3ed2357d req-65fa12dd-063c-4303-a0e4-0862ef287af2 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Refreshing instance network info cache due to event network-changed-86318321-0dae-41ca-b65d-420d34a4524d. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c7954a6a-7e21-406b-9a22-4bec3ed2357d req-65fa12dd-063c-4303-a0e4-0862ef287af2 service nova] Acquiring lock "refresh_cache-329c6583-54c9-4cb4-a747-89986c2b1878" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c7954a6a-7e21-406b-9a22-4bec3ed2357d req-65fa12dd-063c-4303-a0e4-0862ef287af2 service nova] Acquired lock "refresh_cache-329c6583-54c9-4cb4-a747-89986c2b1878" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG nova.network.neutron [req-c7954a6a-7e21-406b-9a22-4bec3ed2357d req-65fa12dd-063c-4303-a0e4-0862ef287af2 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Refreshing network info cache for port 86318321-0dae-41ca-b65d-420d34a4524d {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:54:00 user nova-compute[75080]: INFO os_vif [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ba:19,bridge_name='br-int',has_traffic_filtering=True,id=86318321-0dae-41ca-b65d-420d34a4524d,network=Network(a7d887a3-0434-4d0a-933b-5e2605ccc742),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86318321-0d')
Dec 05 15:54:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNlcUJVW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:54:00 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:54:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG nova.compute.manager [req-a828a12e-c394-46ea-a342-a2c975f06537 req-39be9e41-49c0-44e0-abaf-65fc5408b494 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Received event network-vif-plugged-86318321-0dae-41ca-b65d-420d34a4524d {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a828a12e-c394-46ea-a342-a2c975f06537 req-39be9e41-49c0-44e0-abaf-65fc5408b494 service nova] Acquiring lock "329c6583-54c9-4cb4-a747-89986c2b1878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a828a12e-c394-46ea-a342-a2c975f06537 req-39be9e41-49c0-44e0-abaf-65fc5408b494 service nova] Lock "329c6583-54c9-4cb4-a747-89986c2b1878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a828a12e-c394-46ea-a342-a2c975f06537 req-39be9e41-49c0-44e0-abaf-65fc5408b494 service nova] Lock "329c6583-54c9-4cb4-a747-89986c2b1878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG nova.compute.manager [req-a828a12e-c394-46ea-a342-a2c975f06537 req-39be9e41-49c0-44e0-abaf-65fc5408b494 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] No waiting events found dispatching network-vif-plugged-86318321-0dae-41ca-b65d-420d34a4524d {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:54:00 user nova-compute[75080]: WARNING nova.compute.manager [req-a828a12e-c394-46ea-a342-a2c975f06537 req-39be9e41-49c0-44e0-abaf-65fc5408b494 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Received unexpected event network-vif-plugged-86318321-0dae-41ca-b65d-420d34a4524d for instance with vm_state active and task_state shelving.
Dec 05 15:54:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14dbbe4-c67f-4de4-9bce-3ece25e56fef]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:54:00 user nova-compute[75080]: No targets found.
Dec 05 15:54:00 user nova-compute[75080]: iSNS:
Dec 05 15:54:00 user nova-compute[75080]: No targets found.
Dec 05 15:54:00 user nova-compute[75080]: STATIC:
Dec 05 15:54:00 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55
Dec 05 15:54:00 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:54:00 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:54:00 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439
Dec 05 15:54:00 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:54:00 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:54:00 user nova-compute[75080]: FIRMWARE:
Dec 05 15:54:00 user nova-compute[75080]: No targets found.
Dec 05 15:54:00 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:54:00 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:54:00 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[967c4f08-14f3-4d0f-9c7b-81ba9d2a6dd9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[052de174-2552-4a06-9945-798dcf307ca7]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 (non-flash)
Dec 05 15:54:00 user nova-compute[75080]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55 (non-flash)
Dec 05 15:54:00 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 (non-flash)
Dec 05 15:54:00 user nova-compute[75080]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55 (non-flash)
Dec 05 15:54:00 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f66383179a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439'): ({'sdb'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Removing single pathed devices sdb {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[11618a3a-0749-4b28-8708-7317f49ea005]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd7a3f7-352d-4f00-8275-326d8327847d]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Flushing IO for device /dev/sdb {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[208174bf-f105-4c38-bd87-472dcddd065c]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c76490-f14f-42bd-a894-3421a6f4c8a1]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[00635041-d44c-4a66-ac27-880e7bded946]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[813b4f77-ac6c-46d6-b467-955a13367b3f]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439, portal: 172.16.0.220,3260]
Dec 05 15:54:00 user nova-compute[75080]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439, portal: 172.16.0.220,3260] successful.
Dec 05 15:54:00 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a427b5fd-73f1-4dc7-9ddd-4a6cf1af5895]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] <== disconnect_volume: return (334ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:54:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:54:00 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Deleting instance files /opt/stack/data/nova/instances/329c6583-54c9-4cb4-a747-89986c2b1878_del
Dec 05 15:54:00 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Deletion of /opt/stack/data/nova/instances/329c6583-54c9-4cb4-a747-89986c2b1878_del complete
Dec 05 15:54:01 user nova-compute[75080]: DEBUG nova.network.neutron [req-c7954a6a-7e21-406b-9a22-4bec3ed2357d req-65fa12dd-063c-4303-a0e4-0862ef287af2 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Updated VIF entry in instance network info cache for port 86318321-0dae-41ca-b65d-420d34a4524d. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:54:01 user nova-compute[75080]: DEBUG nova.network.neutron [req-c7954a6a-7e21-406b-9a22-4bec3ed2357d req-65fa12dd-063c-4303-a0e4-0862ef287af2 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Updating instance_info_cache with network_info: [{"id": "86318321-0dae-41ca-b65d-420d34a4524d", "address": "fa:16:3e:0b:ba:19", "network": {"id": "a7d887a3-0434-4d0a-933b-5e2605ccc742", "bridge": null, "label": "tempest-TestShelveInstance-763789771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e19ed3436a3f43a3b4a69e81a76bb263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap86318321-0d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:54:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c7954a6a-7e21-406b-9a22-4bec3ed2357d req-65fa12dd-063c-4303-a0e4-0862ef287af2 service nova] Releasing lock "refresh_cache-329c6583-54c9-4cb4-a747-89986c2b1878" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:54:01 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:54:01 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:54:01 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:54:01 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:54:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-8608d2cf-476d-43b8-a124-c44507459a1e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:54:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-8608d2cf-476d-43b8-a124-c44507459a1e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:54:01 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 15:54:01 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Updating instance_info_cache with network_info: [{"id": "9a4d35f3-f184-49ba-b94d-5fcdd955f572", "address": "fa:16:3e:22:37:f1", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a4d35f3-f1", "ovs_interfaceid": "9a4d35f3-f184-49ba-b94d-5fcdd955f572", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:54:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-8608d2cf-476d-43b8-a124-c44507459a1e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:54:01 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 15:54:02 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Deleted allocations for instance 329c6583-54c9-4cb4-a747-89986c2b1878
Dec 05 15:54:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:54:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:54:02 user nova-compute[75080]: DEBUG nova.objects.instance [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lazy-loading 'numa_topology' on Instance uuid 329c6583-54c9-4cb4-a747-89986c2b1878 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:54:02 user nova-compute[75080]: DEBUG nova.objects.base [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Object Instance<329c6583-54c9-4cb4-a747-89986c2b1878> lazy-loaded attributes: resources,numa_topology {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:54:02 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:54:02 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:54:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.166s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:54:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ac1ca785-a694-4f80-aed3-06cc4c280da4 tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lock "329c6583-54c9-4cb4-a747-89986c2b1878" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.088s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:54:02 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:54:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:54:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:54:07 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:54:07 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:54:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:54:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:54:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:54:15 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:54:20 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:54:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:54:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:54:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 15:54:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:54:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:54:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:54:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:54:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:54:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:54:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:54:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:54:45 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:54:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:54:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:54:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 15:54:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:54:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:54:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:54:53 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:54:53 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Triggering sync for uuid db0fde77-eb40-4acb-93f7-66b5b76c8eea {{(pid=75080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 15:54:53 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Triggering sync for uuid 8608d2cf-476d-43b8-a124-c44507459a1e {{(pid=75080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 15:54:53 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Triggering sync for uuid 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274 {{(pid=75080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 15:54:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:54:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:54:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "8608d2cf-476d-43b8-a124-c44507459a1e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:54:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "8608d2cf-476d-43b8-a124-c44507459a1e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:54:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:54:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:54:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:54:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "8608d2cf-476d-43b8-a124-c44507459a1e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:54:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:54:54 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:54:54 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:54:55 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:54:55 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:54:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:54:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:54:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 15:54:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:54:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:54:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:54:58 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:54:59 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:54:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:54:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:54:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:54:59 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:54:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:54:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:54:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:54:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:54:59 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:55:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:55:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:55:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:55:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:55:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:55:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:55:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:55:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk (vdb) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:55:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:55:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:55:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:55:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:55:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:55:01 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:55:01 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:55:01 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=8837MB free_disk=24.921180725097656GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:55:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:55:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:55:01 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance db0fde77-eb40-4acb-93f7-66b5b76c8eea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:55:01 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 8608d2cf-476d-43b8-a124-c44507459a1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:55:01 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:55:01 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:55:01 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:55:01 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:55:01 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:55:01 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:55:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.273s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:55:02 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:55:02 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:55:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:55:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:55:02 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 15:55:03 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Updating instance_info_cache with network_info: [{"id": "22ddcc5a-537d-41ac-b4c7-e4a702d84748", "address": "fa:16:3e:2f:f6:98", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ddcc5a-53", "ovs_interfaceid": "22ddcc5a-537d-41ac-b4c7-e4a702d84748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:55:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:55:03 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 15:55:03 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:55:03 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:55:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:55:09 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:55:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:55:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:55:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 15:55:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:55:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:55:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:55:15 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:55:19 user nova-compute[75080]: INFO nova.compute.manager [None req-2bbe2c98-3e61-4a7e-9930-b12eabe409db tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Unrescuing
Dec 05 15:55:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2bbe2c98-3e61-4a7e-9930-b12eabe409db tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "refresh_cache-7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:55:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2bbe2c98-3e61-4a7e-9930-b12eabe409db tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquired lock "refresh_cache-7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:55:19 user nova-compute[75080]: DEBUG nova.network.neutron [None req-2bbe2c98-3e61-4a7e-9930-b12eabe409db tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:55:20 user nova-compute[75080]: DEBUG nova.network.neutron [None req-2bbe2c98-3e61-4a7e-9930-b12eabe409db tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Updating instance_info_cache with network_info: [{"id": "22ddcc5a-537d-41ac-b4c7-e4a702d84748", "address": "fa:16:3e:2f:f6:98", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ddcc5a-53", "ovs_interfaceid": "22ddcc5a-537d-41ac-b4c7-e4a702d84748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:55:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2bbe2c98-3e61-4a7e-9930-b12eabe409db tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Releasing lock "refresh_cache-7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:55:20 user nova-compute[75080]: DEBUG nova.objects.instance [None req-2bbe2c98-3e61-4a7e-9930-b12eabe409db tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lazy-loading 'flavor' on Instance uuid 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:55:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:55:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:55:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:55:20 user nova-compute[75080]: DEBUG nova.compute.manager [req-c52e9d8c-714d-47d9-9a38-950cfacfdfee req-ab79d4fe-ddec-4f3a-9859-0ee802f3796e service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Received event network-vif-unplugged-22ddcc5a-537d-41ac-b4c7-e4a702d84748 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:55:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c52e9d8c-714d-47d9-9a38-950cfacfdfee req-ab79d4fe-ddec-4f3a-9859-0ee802f3796e service nova] Acquiring lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:55:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c52e9d8c-714d-47d9-9a38-950cfacfdfee req-ab79d4fe-ddec-4f3a-9859-0ee802f3796e service nova] Lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:55:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c52e9d8c-714d-47d9-9a38-950cfacfdfee req-ab79d4fe-ddec-4f3a-9859-0ee802f3796e service nova] Lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:55:20 user nova-compute[75080]: DEBUG nova.compute.manager [req-c52e9d8c-714d-47d9-9a38-950cfacfdfee req-ab79d4fe-ddec-4f3a-9859-0ee802f3796e service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] No waiting events found dispatching network-vif-unplugged-22ddcc5a-537d-41ac-b4c7-e4a702d84748 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:55:20 user nova-compute[75080]: WARNING nova.compute.manager [req-c52e9d8c-714d-47d9-9a38-950cfacfdfee req-ab79d4fe-ddec-4f3a-9859-0ee802f3796e service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Received unexpected event network-vif-unplugged-22ddcc5a-537d-41ac-b4c7-e4a702d84748 for instance with vm_state rescued and task_state unrescuing.
Dec 05 15:55:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:55:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:55:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:55:20 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Instance destroyed successfully.
Dec 05 15:55:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:55:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:55:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:55:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:55:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:55:22 user nova-compute[75080]: DEBUG nova.compute.manager [req-36e36d1e-3a99-4e9b-bc8b-a67294b6d2e9 req-a79a647c-eaec-4b7e-b39e-89fc8c64253f service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Received event network-vif-plugged-22ddcc5a-537d-41ac-b4c7-e4a702d84748 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:55:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-36e36d1e-3a99-4e9b-bc8b-a67294b6d2e9 req-a79a647c-eaec-4b7e-b39e-89fc8c64253f service nova] Acquiring lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:55:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-36e36d1e-3a99-4e9b-bc8b-a67294b6d2e9 req-a79a647c-eaec-4b7e-b39e-89fc8c64253f service nova] Lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:55:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-36e36d1e-3a99-4e9b-bc8b-a67294b6d2e9 req-a79a647c-eaec-4b7e-b39e-89fc8c64253f service nova] Lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:55:22 user nova-compute[75080]: DEBUG nova.compute.manager [req-36e36d1e-3a99-4e9b-bc8b-a67294b6d2e9 req-a79a647c-eaec-4b7e-b39e-89fc8c64253f service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] No waiting events found dispatching network-vif-plugged-22ddcc5a-537d-41ac-b4c7-e4a702d84748 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:55:22 user nova-compute[75080]: WARNING nova.compute.manager [req-36e36d1e-3a99-4e9b-bc8b-a67294b6d2e9 req-a79a647c-eaec-4b7e-b39e-89fc8c64253f service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Received unexpected event network-vif-plugged-22ddcc5a-537d-41ac-b4c7-e4a702d84748 for instance with vm_state rescued and task_state unrescuing.
Dec 05 15:55:22 user nova-compute[75080]: DEBUG nova.compute.manager [req-36e36d1e-3a99-4e9b-bc8b-a67294b6d2e9 req-a79a647c-eaec-4b7e-b39e-89fc8c64253f service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Received event network-vif-plugged-22ddcc5a-537d-41ac-b4c7-e4a702d84748 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:55:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-36e36d1e-3a99-4e9b-bc8b-a67294b6d2e9 req-a79a647c-eaec-4b7e-b39e-89fc8c64253f service nova] Acquiring lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:55:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-36e36d1e-3a99-4e9b-bc8b-a67294b6d2e9 req-a79a647c-eaec-4b7e-b39e-89fc8c64253f service nova] Lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:55:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-36e36d1e-3a99-4e9b-bc8b-a67294b6d2e9 req-a79a647c-eaec-4b7e-b39e-89fc8c64253f service nova] Lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:55:22 user nova-compute[75080]: DEBUG nova.compute.manager [req-36e36d1e-3a99-4e9b-bc8b-a67294b6d2e9 req-a79a647c-eaec-4b7e-b39e-89fc8c64253f service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] No waiting events found dispatching network-vif-plugged-22ddcc5a-537d-41ac-b4c7-e4a702d84748 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:55:22 user nova-compute[75080]: WARNING nova.compute.manager [req-36e36d1e-3a99-4e9b-bc8b-a67294b6d2e9 req-a79a647c-eaec-4b7e-b39e-89fc8c64253f service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Received unexpected event network-vif-plugged-22ddcc5a-537d-41ac-b4c7-e4a702d84748 for instance with vm_state rescued and task_state unrescuing.
Dec 05 15:55:22 user nova-compute[75080]: DEBUG nova.compute.manager [req-36e36d1e-3a99-4e9b-bc8b-a67294b6d2e9 req-a79a647c-eaec-4b7e-b39e-89fc8c64253f service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Received event network-vif-plugged-22ddcc5a-537d-41ac-b4c7-e4a702d84748 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:55:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-36e36d1e-3a99-4e9b-bc8b-a67294b6d2e9 req-a79a647c-eaec-4b7e-b39e-89fc8c64253f service nova] Acquiring lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:55:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-36e36d1e-3a99-4e9b-bc8b-a67294b6d2e9 req-a79a647c-eaec-4b7e-b39e-89fc8c64253f service nova] Lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:55:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-36e36d1e-3a99-4e9b-bc8b-a67294b6d2e9 req-a79a647c-eaec-4b7e-b39e-89fc8c64253f service nova] Lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:55:22 user nova-compute[75080]: DEBUG nova.compute.manager [req-36e36d1e-3a99-4e9b-bc8b-a67294b6d2e9 req-a79a647c-eaec-4b7e-b39e-89fc8c64253f service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] No waiting events found dispatching network-vif-plugged-22ddcc5a-537d-41ac-b4c7-e4a702d84748 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:55:22 user nova-compute[75080]: WARNING nova.compute.manager [req-36e36d1e-3a99-4e9b-bc8b-a67294b6d2e9 req-a79a647c-eaec-4b7e-b39e-89fc8c64253f service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Received unexpected event network-vif-plugged-22ddcc5a-537d-41ac-b4c7-e4a702d84748 for instance with vm_state rescued and task_state unrescuing.
Dec 05 15:55:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:55:24 user nova-compute[75080]: DEBUG nova.compute.manager [None req-2bbe2c98-3e61-4a7e-9930-b12eabe409db tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:55:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:55:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:55:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:55:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:55:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 15:55:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:55:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:55:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:55:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:55:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:55:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:55:45 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:55:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:55:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Acquiring lock "329c6583-54c9-4cb4-a747-89986c2b1878" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:55:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lock "329c6583-54c9-4cb4-a747-89986c2b1878" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:55:49 user nova-compute[75080]: INFO nova.compute.manager [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Unshelving
Dec 05 15:55:49 user nova-compute[75080]: INFO nova.virt.block_device [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Booting with volume 274194ad-2323-4414-a457-ad40d2362439 at /dev/vda
Dec 05 15:55:49 user nova-compute[75080]: DEBUG os_brick.utils [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:55:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:55:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:55:50 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[28efb7c8-cbb0-4576-aea3-feae5f792b21]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:55:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:55:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:55:50 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bd9c91-80ea-401f-9c2c-97e0ec843fca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:55:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:55:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:55:50 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb2b205-d5e5-4e75-8bec-806d4f743f3d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:55:50 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[450b0d9e-bf19-4bc5-9fe6-18d613550149]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:55:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:55:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:55:50 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 15:55:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:55:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 15:55:50 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 15:55:50 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c292cb1c-24fd-4b87-afda-e0a45e8ac84c]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:55:50 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 15:55:50 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 15:55:50 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 15:55:50 user nova-compute[75080]: DEBUG os_brick.utils [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:55:50 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Updating existing volume attachment record: 8c844a11-54c1-47b5-9550-3a328b4c7574 {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 15:55:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:55:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:55:54 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:55:55 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:55:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:55:57 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:55:57 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:55:58 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:55:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:55:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:55:59 user nova-compute[75080]: DEBUG nova.objects.instance [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lazy-loading 'pci_requests' on Instance uuid 329c6583-54c9-4cb4-a747-89986c2b1878 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:55:59 user nova-compute[75080]: DEBUG nova.objects.instance [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lazy-loading 'numa_topology' on Instance uuid 329c6583-54c9-4cb4-a747-89986c2b1878 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:55:59 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 15:55:59 user nova-compute[75080]: INFO nova.compute.claims [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Claim successful on node user
Dec 05 15:55:59 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:55:59 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:55:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.327s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:55:59 user nova-compute[75080]: INFO nova.network.neutron [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Updating port 86318321-0dae-41ca-b65d-420d34a4524d with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Dec 05 15:55:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Acquiring lock "refresh_cache-329c6583-54c9-4cb4-a747-89986c2b1878" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Acquired lock "refresh_cache-329c6583-54c9-4cb4-a747-89986c2b1878" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG nova.network.neutron [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG nova.compute.manager [req-f6283228-8a04-41ba-a788-6cdea16d1d70 req-26a0e106-4467-485f-a8cf-11c56fce02e4 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Received event network-changed-86318321-0dae-41ca-b65d-420d34a4524d {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG nova.compute.manager [req-f6283228-8a04-41ba-a788-6cdea16d1d70 req-26a0e106-4467-485f-a8cf-11c56fce02e4 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Refreshing instance network info cache due to event network-changed-86318321-0dae-41ca-b65d-420d34a4524d. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f6283228-8a04-41ba-a788-6cdea16d1d70 req-26a0e106-4467-485f-a8cf-11c56fce02e4 service nova] Acquiring lock "refresh_cache-329c6583-54c9-4cb4-a747-89986c2b1878" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG nova.network.neutron [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Updating instance_info_cache with network_info: [{"id": "86318321-0dae-41ca-b65d-420d34a4524d", "address": "fa:16:3e:0b:ba:19", "network": {"id": "a7d887a3-0434-4d0a-933b-5e2605ccc742", "bridge": "br-int", "label": "tempest-TestShelveInstance-763789771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e19ed3436a3f43a3b4a69e81a76bb263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86318321-0d", "ovs_interfaceid": "86318321-0dae-41ca-b65d-420d34a4524d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Releasing lock "refresh_cache-329c6583-54c9-4cb4-a747-89986c2b1878" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 15:56:00 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Creating image(s)
Dec 05 15:56:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Did not create local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Ensure instance console log exists: /opt/stack/data/nova/instances/329c6583-54c9-4cb4-a747-89986c2b1878/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Start _get_guest_xml network_info=[{"id": "86318321-0dae-41ca-b65d-420d34a4524d", "address": "fa:16:3e:0b:ba:19", "network": {"id": "a7d887a3-0434-4d0a-933b-5e2605ccc742", "bridge": "br-int", "label": "tempest-TestShelveInstance-763789771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e19ed3436a3f43a3b4a69e81a76bb263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86318321-0d", "ovs_interfaceid": "86318321-0dae-41ca-b65d-420d34a4524d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNlcUJVW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '329c6583-54c9-4cb4-a747-89986c2b1878', 'attached_at': '', 'detached_at': '', 'volume_id': '274194ad-2323-4414-a457-ad40d2362439', 'serial': '274194ad-2323-4414-a457-ad40d2362439'}, 'device_type': 'disk', 'attachment_id': '8c844a11-54c1-47b5-9550-3a328b4c7574', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f6283228-8a04-41ba-a788-6cdea16d1d70 req-26a0e106-4467-485f-a8cf-11c56fce02e4 service nova] Acquired lock "refresh_cache-329c6583-54c9-4cb4-a747-89986c2b1878" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG nova.network.neutron [req-f6283228-8a04-41ba-a788-6cdea16d1d70 req-26a0e106-4467-485f-a8cf-11c56fce02e4 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Refreshing network info cache for port 86318321-0dae-41ca-b65d-420d34a4524d {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:56:00 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:56:00 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:56:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG nova.objects.instance [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lazy-loading 'vcpu_model' on Instance uuid 329c6583-54c9-4cb4-a747-89986c2b1878 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG nova.objects.base [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Object Instance<329c6583-54c9-4cb4-a747-89986c2b1878> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNlcUJVW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:56:00 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:56:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:56:00 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:56:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:56:00 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a158117a-eca7-4c70-9d20-46f7e3384927]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 15:56:00 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e087238-dab7-4a0a-a996-b4469dd2add7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439] added
Dec 05 15:56:00 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afc7d3a-081d-4e29-9ac1-174249986a91]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[679f581f-d7a7-488a-ba24-9151d55b6fd8]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BNlcUJVW {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BNlcUJVW" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f396ec5-b15f-4517-9f4a-f2ca90516bad]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BNlcUJVW'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[19db16d8-f316-4758-a519-b5a5412cc657]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c891dae-774f-4e27-b89d-02e48cb9bd36]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55 (non-flash)
Dec 05 15:56:00 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55 (non-flash)
Dec 05 15:56:00 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4357d770-a4cc-4549-b24b-fb7c20daf6f3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439, portal: 172.16.0.220,3260]
Dec 05 15:56:00 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439, portal: 172.16.0.220,3260] successful.
Dec 05 15:56:00 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f890126f-e077-45ce-8efa-3aa2f27de9bc]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dea3fbf-e65e-4bc3-b9b7-79a2c6ba3c99]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55 (non-flash)
Dec 05 15:56:00 user nova-compute[75080]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 (non-flash)
Dec 05 15:56:00 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55 (non-flash)
Dec 05 15:56:00 user nova-compute[75080]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 (non-flash)
Dec 05 15:56:00 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG nova.network.neutron [req-f6283228-8a04-41ba-a788-6cdea16d1d70 req-26a0e106-4467-485f-a8cf-11c56fce02e4 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Updated VIF entry in instance network info cache for port 86318321-0dae-41ca-b65d-420d34a4524d. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG nova.network.neutron [req-f6283228-8a04-41ba-a788-6cdea16d1d70 req-26a0e106-4467-485f-a8cf-11c56fce02e4 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Updating instance_info_cache with network_info: [{"id": "86318321-0dae-41ca-b65d-420d34a4524d", "address": "fa:16:3e:0b:ba:19", "network": {"id": "a7d887a3-0434-4d0a-933b-5e2605ccc742", "bridge": "br-int", "label": "tempest-TestShelveInstance-763789771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e19ed3436a3f43a3b4a69e81a76bb263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86318321-0d", "ovs_interfaceid": "86318321-0dae-41ca-b65d-420d34a4524d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0df0c3-1d64-4256-afa0-74abf1f9243e]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNlcUJVW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f6283228-8a04-41ba-a788-6cdea16d1d70 req-26a0e106-4467-485f-a8cf-11c56fce02e4 service nova] Releasing lock "refresh_cache-329c6583-54c9-4cb4-a747-89986c2b1878" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:56:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:56:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:56:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:56:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:56:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:56:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:56:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:56:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:56:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:56:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:56:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:56:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:56:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:56:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23035376230396131', 'path': '/dev/sdb'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:56:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035376230396131', 'path': '/dev/sdb'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 15:56:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T15:52:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1630400400',display_name='tempest-TestShelveInstance-server-1630400400',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1630400400',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-951166409',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:52:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e19ed3436a3f43a3b4a69e81a76bb263',ramdisk_id='',reservation_id='r-15caxesf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1198767828',owner_user_name='tempest-TestShelveInstance-1198767828-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:55:50Z,user_data=None,user_id='dc433b4ab35c404f83f8729ee04fb164',uuid=329c6583-54c9-4cb4-a747-89986c2b1878,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "86318321-0dae-41ca-b65d-420d34a4524d", "address": "fa:16:3e:0b:ba:19", "network": {"id": "a7d887a3-0434-4d0a-933b-5e2605ccc742", "bridge": "br-int", "label": "tempest-TestShelveInstance-763789771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e19ed3436a3f43a3b4a69e81a76bb263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86318321-0d", "ovs_interfaceid": "86318321-0dae-41ca-b65d-420d34a4524d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 15:56:02 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Converting VIF {"id": "86318321-0dae-41ca-b65d-420d34a4524d", "address": "fa:16:3e:0b:ba:19", "network": {"id": "a7d887a3-0434-4d0a-933b-5e2605ccc742", "bridge": "br-int", "label": "tempest-TestShelveInstance-763789771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e19ed3436a3f43a3b4a69e81a76bb263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86318321-0d", "ovs_interfaceid": "86318321-0dae-41ca-b65d-420d34a4524d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:56:02 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ba:19,bridge_name='br-int',has_traffic_filtering=True,id=86318321-0dae-41ca-b65d-420d34a4524d,network=Network(a7d887a3-0434-4d0a-933b-5e2605ccc742),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86318321-0d') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:56:02 user nova-compute[75080]: DEBUG nova.objects.instance [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lazy-loading 'pci_devices' on Instance uuid 329c6583-54c9-4cb4-a747-89986c2b1878 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:56:02 user nova-compute[75080]: DEBUG nova.objects.base [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Object Instance<329c6583-54c9-4cb4-a747-89986c2b1878> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 15:56:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] End _get_guest_xml xml=<domain type="kvm">
Dec 05 15:56:02 user nova-compute[75080]:   <uuid>329c6583-54c9-4cb4-a747-89986c2b1878</uuid>
Dec 05 15:56:02 user nova-compute[75080]:   <name>instance-00000030</name>
Dec 05 15:56:02 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 15:56:02 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 15:56:02 user nova-compute[75080]:   <metadata>
Dec 05 15:56:02 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 15:56:02 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 15:56:02 user nova-compute[75080]:       <nova:name>tempest-TestShelveInstance-server-1630400400</nova:name>
Dec 05 15:56:02 user nova-compute[75080]:       <nova:creationTime>2023-12-05 15:56:00</nova:creationTime>
Dec 05 15:56:02 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 15:56:02 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 15:56:02 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 15:56:02 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 15:56:02 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 15:56:02 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 15:56:02 user nova-compute[75080]:       </nova:flavor>
Dec 05 15:56:02 user nova-compute[75080]:       <nova:owner>
Dec 05 15:56:02 user nova-compute[75080]:         <nova:user uuid="dc433b4ab35c404f83f8729ee04fb164">tempest-TestShelveInstance-1198767828-project-member</nova:user>
Dec 05 15:56:02 user nova-compute[75080]:         <nova:project uuid="e19ed3436a3f43a3b4a69e81a76bb263">tempest-TestShelveInstance-1198767828</nova:project>
Dec 05 15:56:02 user nova-compute[75080]:       </nova:owner>
Dec 05 15:56:02 user nova-compute[75080]:       <nova:ports>
Dec 05 15:56:02 user nova-compute[75080]:         <nova:port uuid="86318321-0dae-41ca-b65d-420d34a4524d">
Dec 05 15:56:02 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 05 15:56:02 user nova-compute[75080]:         </nova:port>
Dec 05 15:56:02 user nova-compute[75080]:       </nova:ports>
Dec 05 15:56:02 user nova-compute[75080]:     </nova:instance>
Dec 05 15:56:02 user nova-compute[75080]:   </metadata>
Dec 05 15:56:02 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 15:56:02 user nova-compute[75080]:     <system>
Dec 05 15:56:02 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 15:56:02 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 15:56:02 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 15:56:02 user nova-compute[75080]:       <entry name="serial">329c6583-54c9-4cb4-a747-89986c2b1878</entry>
Dec 05 15:56:02 user nova-compute[75080]:       <entry name="uuid">329c6583-54c9-4cb4-a747-89986c2b1878</entry>
Dec 05 15:56:02 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 15:56:02 user nova-compute[75080]:     </system>
Dec 05 15:56:02 user nova-compute[75080]:   </sysinfo>
Dec 05 15:56:02 user nova-compute[75080]:   <os>
Dec 05 15:56:02 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 15:56:02 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 15:56:02 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 15:56:02 user nova-compute[75080]:   </os>
Dec 05 15:56:02 user nova-compute[75080]:   <features>
Dec 05 15:56:02 user nova-compute[75080]:     <acpi/>
Dec 05 15:56:02 user nova-compute[75080]:     <apic/>
Dec 05 15:56:02 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 15:56:02 user nova-compute[75080]:   </features>
Dec 05 15:56:02 user nova-compute[75080]:   <clock offset="utc">
Dec 05 15:56:02 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 15:56:02 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 15:56:02 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 15:56:02 user nova-compute[75080]:   </clock>
Dec 05 15:56:02 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 15:56:02 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 15:56:02 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 15:56:02 user nova-compute[75080]:   </cpu>
Dec 05 15:56:02 user nova-compute[75080]:   <devices>
Dec 05 15:56:02 user nova-compute[75080]:     <disk type="block" device="disk">
Dec 05 15:56:02 user nova-compute[75080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:56:02 user nova-compute[75080]:       <source dev="/dev/sdb"/>
Dec 05 15:56:02 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 15:56:02 user nova-compute[75080]:       <serial>274194ad-2323-4414-a457-ad40d2362439</serial>
Dec 05 15:56:02 user nova-compute[75080]:     </disk>
Dec 05 15:56:02 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 15:56:02 user nova-compute[75080]:       <mac address="fa:16:3e:0b:ba:19"/>
Dec 05 15:56:02 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:56:02 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 15:56:02 user nova-compute[75080]:       <target dev="tap86318321-0d"/>
Dec 05 15:56:02 user nova-compute[75080]:     </interface>
Dec 05 15:56:02 user nova-compute[75080]:     <serial type="pty">
Dec 05 15:56:02 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/329c6583-54c9-4cb4-a747-89986c2b1878/console.log" append="off"/>
Dec 05 15:56:02 user nova-compute[75080]:     </serial>
Dec 05 15:56:02 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 15:56:02 user nova-compute[75080]:     <video>
Dec 05 15:56:02 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 15:56:02 user nova-compute[75080]:     </video>
Dec 05 15:56:02 user nova-compute[75080]:     <rng model="virtio">
Dec 05 15:56:02 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 15:56:02 user nova-compute[75080]:     </rng>
Dec 05 15:56:02 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 15:56:02 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 15:56:02 user nova-compute[75080]:       <stats period="10"/>
Dec 05 15:56:02 user nova-compute[75080]:     </memballoon>
Dec 05 15:56:02 user nova-compute[75080]:   </devices>
Dec 05 15:56:02 user nova-compute[75080]: </domain>
Dec 05 15:56:02 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 15:56:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T15:52:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1630400400',display_name='tempest-TestShelveInstance-server-1630400400',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1630400400',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-951166409',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:52:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e19ed3436a3f43a3b4a69e81a76bb263',ramdisk_id='',reservation_id='r-15caxesf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1198767828',owner_user_name='tempest-TestShelveInstance-1198767828-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:55:50Z,user_data=None,user_id='dc433b4ab35c404f83f8729ee04fb164',uuid=329c6583-54c9-4cb4-a747-89986c2b1878,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "86318321-0dae-41ca-b65d-420d34a4524d", "address": "fa:16:3e:0b:ba:19", "network": {"id": "a7d887a3-0434-4d0a-933b-5e2605ccc742", "bridge": "br-int", "label": "tempest-TestShelveInstance-763789771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e19ed3436a3f43a3b4a69e81a76bb263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86318321-0d", "ovs_interfaceid": "86318321-0dae-41ca-b65d-420d34a4524d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 15:56:02 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Converting VIF {"id": "86318321-0dae-41ca-b65d-420d34a4524d", "address": "fa:16:3e:0b:ba:19", "network": {"id": "a7d887a3-0434-4d0a-933b-5e2605ccc742", "bridge": "br-int", "label": "tempest-TestShelveInstance-763789771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e19ed3436a3f43a3b4a69e81a76bb263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86318321-0d", "ovs_interfaceid": "86318321-0dae-41ca-b65d-420d34a4524d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:56:02 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ba:19,bridge_name='br-int',has_traffic_filtering=True,id=86318321-0dae-41ca-b65d-420d34a4524d,network=Network(a7d887a3-0434-4d0a-933b-5e2605ccc742),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86318321-0d') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:56:02 user nova-compute[75080]: DEBUG os_vif [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ba:19,bridge_name='br-int',has_traffic_filtering=True,id=86318321-0dae-41ca-b65d-420d34a4524d,network=Network(a7d887a3-0434-4d0a-933b-5e2605ccc742),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86318321-0d') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 15:56:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:56:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:56:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 15:56:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:56:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e77ba76f-a5e7-5a7d-b8c9-954bcbbbb4f5', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:56:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:56:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:56:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:56:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86318321-0d, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:56:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap86318321-0d, col_values=(('qos', UUID('0227a072-c4e8-4b05-9207-3c8f0712e693')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:56:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap86318321-0d, col_values=(('external_ids', {'iface-id': '86318321-0dae-41ca-b65d-420d34a4524d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:ba:19', 'vm-uuid': '329c6583-54c9-4cb4-a747-89986c2b1878'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:56:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:56:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:56:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:56:02 user nova-compute[75080]: INFO os_vif [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ba:19,bridge_name='br-int',has_traffic_filtering=True,id=86318321-0dae-41ca-b65d-420d34a4524d,network=Network(a7d887a3-0434-4d0a-933b-5e2605ccc742),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86318321-0d')
Dec 05 15:56:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:56:02 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:56:02 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:56:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=8824MB free_disk=24.919715881347656GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:56:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:56:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:56:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 15:56:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] No VIF found with MAC fa:16:3e:0b:ba:19, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 15:56:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance db0fde77-eb40-4acb-93f7-66b5b76c8eea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:56:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 8608d2cf-476d-43b8-a124-c44507459a1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:56:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:56:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 329c6583-54c9-4cb4-a747-89986c2b1878 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:56:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:56:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:56:02 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:56:02 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:56:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:56:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.268s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:56:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:56:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:56:03 user nova-compute[75080]: DEBUG nova.compute.manager [req-7bcdcd7c-1d6b-404c-8605-10da83d875b7 req-acfe05a5-529c-40cc-ac4e-c0cb75859518 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Received event network-vif-plugged-86318321-0dae-41ca-b65d-420d34a4524d {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:56:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7bcdcd7c-1d6b-404c-8605-10da83d875b7 req-acfe05a5-529c-40cc-ac4e-c0cb75859518 service nova] Acquiring lock "329c6583-54c9-4cb4-a747-89986c2b1878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:56:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7bcdcd7c-1d6b-404c-8605-10da83d875b7 req-acfe05a5-529c-40cc-ac4e-c0cb75859518 service nova] Lock "329c6583-54c9-4cb4-a747-89986c2b1878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:56:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7bcdcd7c-1d6b-404c-8605-10da83d875b7 req-acfe05a5-529c-40cc-ac4e-c0cb75859518 service nova] Lock "329c6583-54c9-4cb4-a747-89986c2b1878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:56:03 user nova-compute[75080]: DEBUG nova.compute.manager [req-7bcdcd7c-1d6b-404c-8605-10da83d875b7 req-acfe05a5-529c-40cc-ac4e-c0cb75859518 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] No waiting events found dispatching network-vif-plugged-86318321-0dae-41ca-b65d-420d34a4524d {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:56:03 user nova-compute[75080]: WARNING nova.compute.manager [req-7bcdcd7c-1d6b-404c-8605-10da83d875b7 req-acfe05a5-529c-40cc-ac4e-c0cb75859518 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Received unexpected event network-vif-plugged-86318321-0dae-41ca-b65d-420d34a4524d for instance with vm_state shelved_offloaded and task_state spawning.
Dec 05 15:56:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:56:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:56:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:56:04 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:56:04 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:56:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-329c6583-54c9-4cb4-a747-89986c2b1878" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:56:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-329c6583-54c9-4cb4-a747-89986c2b1878" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:56:04 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 15:56:05 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Updating instance_info_cache with network_info: [{"id": "86318321-0dae-41ca-b65d-420d34a4524d", "address": "fa:16:3e:0b:ba:19", "network": {"id": "a7d887a3-0434-4d0a-933b-5e2605ccc742", "bridge": "br-int", "label": "tempest-TestShelveInstance-763789771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e19ed3436a3f43a3b4a69e81a76bb263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86318321-0d", "ovs_interfaceid": "86318321-0dae-41ca-b65d-420d34a4524d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:56:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-329c6583-54c9-4cb4-a747-89986c2b1878" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:56:05 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 15:56:05 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:56:05 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:56:05 user nova-compute[75080]: DEBUG nova.compute.manager [req-453c257a-cc6c-43d7-93aa-d2113db83f85 req-fd859304-2be3-49f8-8dfa-40f398a2c688 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Received event network-vif-plugged-86318321-0dae-41ca-b65d-420d34a4524d {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:56:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-453c257a-cc6c-43d7-93aa-d2113db83f85 req-fd859304-2be3-49f8-8dfa-40f398a2c688 service nova] Acquiring lock "329c6583-54c9-4cb4-a747-89986c2b1878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:56:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-453c257a-cc6c-43d7-93aa-d2113db83f85 req-fd859304-2be3-49f8-8dfa-40f398a2c688 service nova] Lock "329c6583-54c9-4cb4-a747-89986c2b1878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:56:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-453c257a-cc6c-43d7-93aa-d2113db83f85 req-fd859304-2be3-49f8-8dfa-40f398a2c688 service nova] Lock "329c6583-54c9-4cb4-a747-89986c2b1878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:56:05 user nova-compute[75080]: DEBUG nova.compute.manager [req-453c257a-cc6c-43d7-93aa-d2113db83f85 req-fd859304-2be3-49f8-8dfa-40f398a2c688 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] No waiting events found dispatching network-vif-plugged-86318321-0dae-41ca-b65d-420d34a4524d {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:56:05 user nova-compute[75080]: WARNING nova.compute.manager [req-453c257a-cc6c-43d7-93aa-d2113db83f85 req-fd859304-2be3-49f8-8dfa-40f398a2c688 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Received unexpected event network-vif-plugged-86318321-0dae-41ca-b65d-420d34a4524d for instance with vm_state shelved_offloaded and task_state spawning.
Dec 05 15:56:05 user nova-compute[75080]: DEBUG nova.compute.manager [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 15:56:05 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 15:56:05 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Instance spawned successfully.
Dec 05 15:56:05 user nova-compute[75080]: DEBUG nova.compute.manager [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 15:56:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-dc2c6a03-697a-4e9f-91b2-cbd6940e531a tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lock "329c6583-54c9-4cb4-a747-89986c2b1878" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 16.104s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:56:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:56:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:56:11 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:56:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:56:12 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:56:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:56:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:56:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:56:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:56:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:56:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:56:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:56:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:56:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:56:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:56:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:56:54 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:56:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:56:57 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:56:58 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:56:59 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:56:59 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:57:00 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:57:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:57:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:57:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:57:00 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:57:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:57:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:57:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:57:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:57:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:57:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:57:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:57:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:57:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:57:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:57:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:57:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:57:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:57:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 15:57:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:57:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:57:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:57:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:57:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:57:02 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:57:02 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:57:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=8691MB free_disk=24.918354034423828GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:57:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:57:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:57:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance db0fde77-eb40-4acb-93f7-66b5b76c8eea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:57:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 8608d2cf-476d-43b8-a124-c44507459a1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:57:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:57:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 329c6583-54c9-4cb4-a747-89986c2b1878 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:57:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:57:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:57:02 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:57:02 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:57:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:57:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.281s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:57:04 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:57:04 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:57:05 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:57:05 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:57:05 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Rebuilding the list of instances to heal {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 15:57:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-db0fde77-eb40-4acb-93f7-66b5b76c8eea" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:57:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-db0fde77-eb40-4acb-93f7-66b5b76c8eea" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:57:05 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 15:57:05 user nova-compute[75080]: DEBUG nova.objects.instance [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lazy-loading 'info_cache' on Instance uuid db0fde77-eb40-4acb-93f7-66b5b76c8eea {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:57:05 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Updating instance_info_cache with network_info: [{"id": "09233cd3-602f-4eb8-a74c-7d592a1a3906", "address": "fa:16:3e:44:84:7c", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09233cd3-60", "ovs_interfaceid": "09233cd3-602f-4eb8-a74c-7d592a1a3906", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:57:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-db0fde77-eb40-4acb-93f7-66b5b76c8eea" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:57:05 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 15:57:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:57:11 user nova-compute[75080]: DEBUG nova.compute.manager [req-a740717f-f36b-4a75-91c7-08e4f4d4504a req-b9edf033-db74-4823-9702-773a4913eb99 service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Received event network-changed-22ddcc5a-537d-41ac-b4c7-e4a702d84748 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:57:11 user nova-compute[75080]: DEBUG nova.compute.manager [req-a740717f-f36b-4a75-91c7-08e4f4d4504a req-b9edf033-db74-4823-9702-773a4913eb99 service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Refreshing instance network info cache due to event network-changed-22ddcc5a-537d-41ac-b4c7-e4a702d84748. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:57:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a740717f-f36b-4a75-91c7-08e4f4d4504a req-b9edf033-db74-4823-9702-773a4913eb99 service nova] Acquiring lock "refresh_cache-7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:57:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a740717f-f36b-4a75-91c7-08e4f4d4504a req-b9edf033-db74-4823-9702-773a4913eb99 service nova] Acquired lock "refresh_cache-7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:57:11 user nova-compute[75080]: DEBUG nova.network.neutron [req-a740717f-f36b-4a75-91c7-08e4f4d4504a req-b9edf033-db74-4823-9702-773a4913eb99 service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Refreshing network info cache for port 22ddcc5a-537d-41ac-b4c7-e4a702d84748 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:57:12 user nova-compute[75080]: DEBUG nova.network.neutron [req-a740717f-f36b-4a75-91c7-08e4f4d4504a req-b9edf033-db74-4823-9702-773a4913eb99 service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Updated VIF entry in instance network info cache for port 22ddcc5a-537d-41ac-b4c7-e4a702d84748. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:57:12 user nova-compute[75080]: DEBUG nova.network.neutron [req-a740717f-f36b-4a75-91c7-08e4f4d4504a req-b9edf033-db74-4823-9702-773a4913eb99 service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Updating instance_info_cache with network_info: [{"id": "22ddcc5a-537d-41ac-b4c7-e4a702d84748", "address": "fa:16:3e:2f:f6:98", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ddcc5a-53", "ovs_interfaceid": "22ddcc5a-537d-41ac-b4c7-e4a702d84748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:57:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a740717f-f36b-4a75-91c7-08e4f4d4504a req-b9edf033-db74-4823-9702-773a4913eb99 service nova] Releasing lock "refresh_cache-7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:57:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-42e56e8f-3424-4b08-840e-eb6917df50a9 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:57:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-42e56e8f-3424-4b08-840e-eb6917df50a9 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:57:12 user nova-compute[75080]: INFO nova.compute.manager [None req-42e56e8f-3424-4b08-840e-eb6917df50a9 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Detaching volume 02cc512a-4437-4f1a-8dfe-07e55fba1d55
Dec 05 15:57:12 user nova-compute[75080]: INFO nova.virt.block_device [None req-42e56e8f-3424-4b08-840e-eb6917df50a9 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Attempting to driver detach volume 02cc512a-4437-4f1a-8dfe-07e55fba1d55 from mountpoint /dev/vdb
Dec 05 15:57:12 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-42e56e8f-3424-4b08-840e-eb6917df50a9 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Attempting to detach device vdb from instance 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274 from the persistent domain config. {{(pid=75080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 15:57:12 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-42e56e8f-3424-4b08-840e-eb6917df50a9 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:57:12 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:57:12 user nova-compute[75080]:   <source dev="/dev/sdc"/>
Dec 05 15:57:12 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:57:12 user nova-compute[75080]:   <serial>02cc512a-4437-4f1a-8dfe-07e55fba1d55</serial>
Dec 05 15:57:12 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 15:57:12 user nova-compute[75080]: </disk>
Dec 05 15:57:12 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:57:12 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-42e56e8f-3424-4b08-840e-eb6917df50a9 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Successfully detached device vdb from instance 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274 from the persistent domain config.
Dec 05 15:57:12 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-42e56e8f-3424-4b08-840e-eb6917df50a9 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274 from the live domain config. {{(pid=75080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 15:57:12 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-42e56e8f-3424-4b08-840e-eb6917df50a9 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 15:57:12 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 15:57:12 user nova-compute[75080]:   <source dev="/dev/sdc"/>
Dec 05 15:57:12 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 15:57:12 user nova-compute[75080]:   <serial>02cc512a-4437-4f1a-8dfe-07e55fba1d55</serial>
Dec 05 15:57:12 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 15:57:12 user nova-compute[75080]: </disk>
Dec 05 15:57:12 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 15:57:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:57:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:57:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 15:57:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:57:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:57:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:57:12 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-42e56e8f-3424-4b08-840e-eb6917df50a9 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274 {{(pid=75080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 15:57:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:57:13 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:57:13 user nova-compute[75080]: DEBUG nova.compute.manager [req-e5cb2d68-67f7-416b-ad92-2f384ddb592b req-0f7bef90-a7f5-45fc-8cf7-bfd71507f5b8 service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Received event network-changed-22ddcc5a-537d-41ac-b4c7-e4a702d84748 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:57:13 user nova-compute[75080]: DEBUG nova.compute.manager [req-e5cb2d68-67f7-416b-ad92-2f384ddb592b req-0f7bef90-a7f5-45fc-8cf7-bfd71507f5b8 service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Refreshing instance network info cache due to event network-changed-22ddcc5a-537d-41ac-b4c7-e4a702d84748. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:57:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-e5cb2d68-67f7-416b-ad92-2f384ddb592b req-0f7bef90-a7f5-45fc-8cf7-bfd71507f5b8 service nova] Acquiring lock "refresh_cache-7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:57:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-e5cb2d68-67f7-416b-ad92-2f384ddb592b req-0f7bef90-a7f5-45fc-8cf7-bfd71507f5b8 service nova] Acquired lock "refresh_cache-7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:57:13 user nova-compute[75080]: DEBUG nova.network.neutron [req-e5cb2d68-67f7-416b-ad92-2f384ddb592b req-0f7bef90-a7f5-45fc-8cf7-bfd71507f5b8 service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Refreshing network info cache for port 22ddcc5a-537d-41ac-b4c7-e4a702d84748 {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:57:14 user nova-compute[75080]: DEBUG nova.network.neutron [req-e5cb2d68-67f7-416b-ad92-2f384ddb592b req-0f7bef90-a7f5-45fc-8cf7-bfd71507f5b8 service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Updated VIF entry in instance network info cache for port 22ddcc5a-537d-41ac-b4c7-e4a702d84748. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:57:14 user nova-compute[75080]: DEBUG nova.network.neutron [req-e5cb2d68-67f7-416b-ad92-2f384ddb592b req-0f7bef90-a7f5-45fc-8cf7-bfd71507f5b8 service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Updating instance_info_cache with network_info: [{"id": "22ddcc5a-537d-41ac-b4c7-e4a702d84748", "address": "fa:16:3e:2f:f6:98", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ddcc5a-53", "ovs_interfaceid": "22ddcc5a-537d-41ac-b4c7-e4a702d84748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:57:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-e5cb2d68-67f7-416b-ad92-2f384ddb592b req-0f7bef90-a7f5-45fc-8cf7-bfd71507f5b8 service nova] Releasing lock "refresh_cache-7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:57:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:57:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:57:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:57:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 15:57:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:57:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:57:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:57:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:57:32 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-42e56e8f-3424-4b08-840e-eb6917df50a9 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274 is timed out.
Dec 05 15:57:32 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-42e56e8f-3424-4b08-840e-eb6917df50a9 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Successfully detached device vdb from instance 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274 from the live domain config.
Dec 05 15:57:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42e56e8f-3424-4b08-840e-eb6917df50a9 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e56e8f-3424-4b08-840e-eb6917df50a9 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IaAtsfmw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:57:32 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-42e56e8f-3424-4b08-840e-eb6917df50a9 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:57:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-42e56e8f-3424-4b08-840e-eb6917df50a9 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-42e56e8f-3424-4b08-840e-eb6917df50a9 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd3b7f2-ab64-480f-b7cc-2aca71b16563]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e56e8f-3424-4b08-840e-eb6917df50a9 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:57:32 user nova-compute[75080]: No targets found.
Dec 05 15:57:32 user nova-compute[75080]: iSNS:
Dec 05 15:57:32 user nova-compute[75080]: No targets found.
Dec 05 15:57:32 user nova-compute[75080]: STATIC:
Dec 05 15:57:32 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55
Dec 05 15:57:32 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:57:32 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:57:32 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439
Dec 05 15:57:32 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:57:32 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:57:32 user nova-compute[75080]: FIRMWARE:
Dec 05 15:57:32 user nova-compute[75080]: No targets found.
Dec 05 15:57:32 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e56e8f-3424-4b08-840e-eb6917df50a9 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:57:32 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:57:32 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e56e8f-3424-4b08-840e-eb6917df50a9 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[190d5404-5271-4052-8258-e57fe63f8f6f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eef3110-e657-426b-9c74-e1310758e632]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e56e8f-3424-4b08-840e-eb6917df50a9 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55 (non-flash)
Dec 05 15:57:32 user nova-compute[75080]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 (non-flash)
Dec 05 15:57:32 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e56e8f-3424-4b08-840e-eb6917df50a9 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55 (non-flash)
Dec 05 15:57:32 user nova-compute[75080]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 (non-flash)
Dec 05 15:57:32 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e56e8f-3424-4b08-840e-eb6917df50a9 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f663833ba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55'): ({'sdc'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-42e56e8f-3424-4b08-840e-eb6917df50a9 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Removing single pathed devices sdc {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0015980-e5f0-49e4-a547-2a01da491481]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d1f7f2-fb03-4143-b078-c39e9b3d6c5d]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-42e56e8f-3424-4b08-840e-eb6917df50a9 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Flushing IO for device /dev/sdc {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfc26b0-5bb1-4dcf-a7d2-65935d25507a]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-42e56e8f-3424-4b08-840e-eb6917df50a9 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfabb550-8152-4f2f-8246-db14c0c14406]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-42e56e8f-3424-4b08-840e-eb6917df50a9 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-42e56e8f-3424-4b08-840e-eb6917df50a9 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] SCSI volumes sdc have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e56e8f-3424-4b08-840e-eb6917df50a9 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e50d43-73b9-4fb9-b2eb-88b9e3b2b76f]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e56e8f-3424-4b08-840e-eb6917df50a9 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:57:32 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55 -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:57:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:57:33 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca7e38d-7dde-466d-9c62-fe26b03734f8]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:57:33 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e56e8f-3424-4b08-840e-eb6917df50a9 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55, portal: 172.16.0.220,3260]
Dec 05 15:57:33 user nova-compute[75080]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55, portal: 172.16.0.220,3260] successful.
Dec 05 15:57:33 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:57:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55 -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:57:33 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02cc512a-4437-4f1a-8dfe-07e55fba1d55 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:57:33 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6605356-2f12-45ed-898e-28f468ad3f22]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:57:33 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e56e8f-3424-4b08-840e-eb6917df50a9 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:57:33 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-42e56e8f-3424-4b08-840e-eb6917df50a9 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:57:33 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e56e8f-3424-4b08-840e-eb6917df50a9 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] <== disconnect_volume: return (323ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:57:33 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42e56e8f-3424-4b08-840e-eb6917df50a9 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:57:33 user nova-compute[75080]: DEBUG nova.objects.instance [None req-42e56e8f-3424-4b08-840e-eb6917df50a9 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lazy-loading 'flavor' on Instance uuid 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:57:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-42e56e8f-3424-4b08-840e-eb6917df50a9 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.713s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:57:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:57:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:57:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 15:57:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:57:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 15:57:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:57:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:57:40 user nova-compute[75080]: DEBUG nova.compute.manager [req-0790def7-4150-4e8d-ae8f-cc9bc25b1380 req-2e29fece-eff3-4d94-8b53-67e96f957300 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Received event network-changed-86318321-0dae-41ca-b65d-420d34a4524d {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:57:40 user nova-compute[75080]: DEBUG nova.compute.manager [req-0790def7-4150-4e8d-ae8f-cc9bc25b1380 req-2e29fece-eff3-4d94-8b53-67e96f957300 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Refreshing instance network info cache due to event network-changed-86318321-0dae-41ca-b65d-420d34a4524d. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 15:57:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0790def7-4150-4e8d-ae8f-cc9bc25b1380 req-2e29fece-eff3-4d94-8b53-67e96f957300 service nova] Acquiring lock "refresh_cache-329c6583-54c9-4cb4-a747-89986c2b1878" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:57:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0790def7-4150-4e8d-ae8f-cc9bc25b1380 req-2e29fece-eff3-4d94-8b53-67e96f957300 service nova] Acquired lock "refresh_cache-329c6583-54c9-4cb4-a747-89986c2b1878" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:57:40 user nova-compute[75080]: DEBUG nova.network.neutron [req-0790def7-4150-4e8d-ae8f-cc9bc25b1380 req-2e29fece-eff3-4d94-8b53-67e96f957300 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Refreshing network info cache for port 86318321-0dae-41ca-b65d-420d34a4524d {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 15:57:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Acquiring lock "329c6583-54c9-4cb4-a747-89986c2b1878" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:57:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lock "329c6583-54c9-4cb4-a747-89986c2b1878" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:57:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Acquiring lock "329c6583-54c9-4cb4-a747-89986c2b1878-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:57:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lock "329c6583-54c9-4cb4-a747-89986c2b1878-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:57:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lock "329c6583-54c9-4cb4-a747-89986c2b1878-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:57:40 user nova-compute[75080]: INFO nova.compute.manager [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Terminating instance
Dec 05 15:57:40 user nova-compute[75080]: DEBUG nova.compute.manager [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG nova.network.neutron [req-0790def7-4150-4e8d-ae8f-cc9bc25b1380 req-2e29fece-eff3-4d94-8b53-67e96f957300 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Updated VIF entry in instance network info cache for port 86318321-0dae-41ca-b65d-420d34a4524d. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG nova.network.neutron [req-0790def7-4150-4e8d-ae8f-cc9bc25b1380 req-2e29fece-eff3-4d94-8b53-67e96f957300 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Updating instance_info_cache with network_info: [{"id": "86318321-0dae-41ca-b65d-420d34a4524d", "address": "fa:16:3e:0b:ba:19", "network": {"id": "a7d887a3-0434-4d0a-933b-5e2605ccc742", "bridge": "br-int", "label": "tempest-TestShelveInstance-763789771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e19ed3436a3f43a3b4a69e81a76bb263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86318321-0d", "ovs_interfaceid": "86318321-0dae-41ca-b65d-420d34a4524d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0790def7-4150-4e8d-ae8f-cc9bc25b1380 req-2e29fece-eff3-4d94-8b53-67e96f957300 service nova] Releasing lock "refresh_cache-329c6583-54c9-4cb4-a747-89986c2b1878" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG nova.compute.manager [req-557e5cd5-e9b3-4a74-a8c9-f8b708726a50 req-b05ebc5b-db07-4109-a79b-2efce19cab0a service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Received event network-vif-unplugged-86318321-0dae-41ca-b65d-420d34a4524d {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-557e5cd5-e9b3-4a74-a8c9-f8b708726a50 req-b05ebc5b-db07-4109-a79b-2efce19cab0a service nova] Acquiring lock "329c6583-54c9-4cb4-a747-89986c2b1878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-557e5cd5-e9b3-4a74-a8c9-f8b708726a50 req-b05ebc5b-db07-4109-a79b-2efce19cab0a service nova] Lock "329c6583-54c9-4cb4-a747-89986c2b1878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-557e5cd5-e9b3-4a74-a8c9-f8b708726a50 req-b05ebc5b-db07-4109-a79b-2efce19cab0a service nova] Lock "329c6583-54c9-4cb4-a747-89986c2b1878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG nova.compute.manager [req-557e5cd5-e9b3-4a74-a8c9-f8b708726a50 req-b05ebc5b-db07-4109-a79b-2efce19cab0a service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] No waiting events found dispatching network-vif-unplugged-86318321-0dae-41ca-b65d-420d34a4524d {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG nova.compute.manager [req-557e5cd5-e9b3-4a74-a8c9-f8b708726a50 req-b05ebc5b-db07-4109-a79b-2efce19cab0a service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Received event network-vif-unplugged-86318321-0dae-41ca-b65d-420d34a4524d for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:57:41 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Instance destroyed successfully.
Dec 05 15:57:41 user nova-compute[75080]: DEBUG nova.objects.instance [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lazy-loading 'resources' on Instance uuid 329c6583-54c9-4cb4-a747-89986c2b1878 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T15:52:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1630400400',display_name='tempest-TestShelveInstance-server-1630400400',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1630400400',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmKfgAKgMU6IomiZs7rO+j8BLtupVV252Mpj3PRlhKsLoH3JO7LcuKNG35YGaZ/sdpoln2GZLbf+bTXedFhdkFU932m2Eaw3wJf2Gfx9vPzyGtXMYVdjuBSvDTqkEncGQ==',key_name='tempest-TestShelveInstance-951166409',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:56:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e19ed3436a3f43a3b4a69e81a76bb263',ramdisk_id='',reservation_id='r-15caxesf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1198767828',owner_user_name='tempest-TestShelveInstance-1198767828-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:56:06Z,user_data=None,user_id='dc433b4ab35c404f83f8729ee04fb164',uuid=329c6583-54c9-4cb4-a747-89986c2b1878,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86318321-0dae-41ca-b65d-420d34a4524d", "address": "fa:16:3e:0b:ba:19", "network": {"id": "a7d887a3-0434-4d0a-933b-5e2605ccc742", "bridge": "br-int", "label": "tempest-TestShelveInstance-763789771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e19ed3436a3f43a3b4a69e81a76bb263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86318321-0d", "ovs_interfaceid": "86318321-0dae-41ca-b65d-420d34a4524d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Converting VIF {"id": "86318321-0dae-41ca-b65d-420d34a4524d", "address": "fa:16:3e:0b:ba:19", "network": {"id": "a7d887a3-0434-4d0a-933b-5e2605ccc742", "bridge": "br-int", "label": "tempest-TestShelveInstance-763789771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e19ed3436a3f43a3b4a69e81a76bb263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86318321-0d", "ovs_interfaceid": "86318321-0dae-41ca-b65d-420d34a4524d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:ba:19,bridge_name='br-int',has_traffic_filtering=True,id=86318321-0dae-41ca-b65d-420d34a4524d,network=Network(a7d887a3-0434-4d0a-933b-5e2605ccc742),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86318321-0d') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG os_vif [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:ba:19,bridge_name='br-int',has_traffic_filtering=True,id=86318321-0dae-41ca-b65d-420d34a4524d,network=Network(a7d887a3-0434-4d0a-933b-5e2605ccc742),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86318321-0d') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86318321-0d, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0227a072-c4e8-4b05-9207-3c8f0712e693) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:57:41 user nova-compute[75080]: INFO os_vif [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:ba:19,bridge_name='br-int',has_traffic_filtering=True,id=86318321-0dae-41ca-b65d-420d34a4524d,network=Network(a7d887a3-0434-4d0a-933b-5e2605ccc742),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86318321-0d')
Dec 05 15:57:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNlcUJVW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 15:57:41 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 15:57:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[113d9a40-7dbd-4f37-a06d-45585ae40121]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 15:57:41 user nova-compute[75080]: No targets found.
Dec 05 15:57:41 user nova-compute[75080]: iSNS:
Dec 05 15:57:41 user nova-compute[75080]: No targets found.
Dec 05 15:57:41 user nova-compute[75080]: STATIC:
Dec 05 15:57:41 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439
Dec 05 15:57:41 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 15:57:41 user nova-compute[75080]:                 Iface Name: default
Dec 05 15:57:41 user nova-compute[75080]: FIRMWARE:
Dec 05 15:57:41 user nova-compute[75080]: No targets found.
Dec 05 15:57:41 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 15:57:41 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 15:57:41 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee18fb0-e884-4bd0-afaa-063db711fbd9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[de77b0f4-7236-432e-8888-8c40a2a616b6]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 (non-flash)
Dec 05 15:57:41 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 (non-flash)
Dec 05 15:57:41 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f663833b880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439'): ({'sdb'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Removing single pathed devices sdb {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[32df61fd-2460-4a67-aea3-85261ae9cd08]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f41daf-b44b-45a6-b0d7-be8053976e7f]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Flushing IO for device /dev/sdb {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75b066b-fb74-41f5-8e2c-0227a09e7f3e]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9763d01-290b-45e1-9221-bcd47e1c5ad6]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO60811d98-057b09a1975a99c4', '/dev/disk/by-id/scsi-23035376230396131', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_60811d98') {{(pid=86242) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 05 15:57:41 user nova-compute[75080]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO60811d98-057b09a1975a99c4
Dec 05 15:57:41 user nova-compute[75080]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23035376230396131
Dec 05 15:57:41 user nova-compute[75080]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_60811d98
Dec 05 15:57:41 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f851d77-02ed-4acc-ba89-3b00b1af90b4]: (4, None) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bd8bfb-4bc1-4f42-8934-5b8e4db6db35]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[245af87e-67b4-4b57-86c6-429e56e3e4db]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:57:41 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439, portal: 172.16.0.220,3260]
Dec 05 15:57:41 user nova-compute[75080]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439, portal: 172.16.0.220,3260] successful.
Dec 05 15:57:41 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:57:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:57:42 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274194ad-2323-4414-a457-ad40d2362439 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:57:42 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e84490b-0e33-43d5-918f-8c7f1daba3e7]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 15:57:42 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 15:57:42 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 15:57:42 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] <== disconnect_volume: return (292ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 15:57:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 15:57:42 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Deleting instance files /opt/stack/data/nova/instances/329c6583-54c9-4cb4-a747-89986c2b1878_del
Dec 05 15:57:42 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Deletion of /opt/stack/data/nova/instances/329c6583-54c9-4cb4-a747-89986c2b1878_del complete
Dec 05 15:57:42 user nova-compute[75080]: INFO nova.compute.manager [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Took 1.14 seconds to destroy the instance on the hypervisor.
Dec 05 15:57:42 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:57:42 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:57:42 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:57:42 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:57:42 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Took 0.44 seconds to deallocate network for instance.
Dec 05 15:57:42 user nova-compute[75080]: DEBUG nova.compute.manager [req-eb288fcb-e6eb-4cf9-9edb-1544a37f75ed req-3ebe2c3a-61a7-4997-906a-e814e6b4174e service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Received event network-vif-deleted-86318321-0dae-41ca-b65d-420d34a4524d {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:57:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:57:43 user nova-compute[75080]: INFO nova.compute.manager [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Took 0.91 seconds to detach 1 volumes for instance.
Dec 05 15:57:43 user nova-compute[75080]: DEBUG nova.compute.manager [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Deleting volume: 274194ad-2323-4414-a457-ad40d2362439 {{(pid=75080) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 05 15:57:43 user nova-compute[75080]: DEBUG nova.compute.manager [req-4d134fe1-c5e3-4120-b9ca-23cd189dd09f req-f4dd23b9-b720-4487-a754-9bfbe2901342 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Received event network-vif-plugged-86318321-0dae-41ca-b65d-420d34a4524d {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:57:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4d134fe1-c5e3-4120-b9ca-23cd189dd09f req-f4dd23b9-b720-4487-a754-9bfbe2901342 service nova] Acquiring lock "329c6583-54c9-4cb4-a747-89986c2b1878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:57:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4d134fe1-c5e3-4120-b9ca-23cd189dd09f req-f4dd23b9-b720-4487-a754-9bfbe2901342 service nova] Lock "329c6583-54c9-4cb4-a747-89986c2b1878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:57:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-4d134fe1-c5e3-4120-b9ca-23cd189dd09f req-f4dd23b9-b720-4487-a754-9bfbe2901342 service nova] Lock "329c6583-54c9-4cb4-a747-89986c2b1878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:57:43 user nova-compute[75080]: DEBUG nova.compute.manager [req-4d134fe1-c5e3-4120-b9ca-23cd189dd09f req-f4dd23b9-b720-4487-a754-9bfbe2901342 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] No waiting events found dispatching network-vif-plugged-86318321-0dae-41ca-b65d-420d34a4524d {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:57:43 user nova-compute[75080]: WARNING nova.compute.manager [req-4d134fe1-c5e3-4120-b9ca-23cd189dd09f req-f4dd23b9-b720-4487-a754-9bfbe2901342 service nova] [instance: 329c6583-54c9-4cb4-a747-89986c2b1878] Received unexpected event network-vif-plugged-86318321-0dae-41ca-b65d-420d34a4524d for instance with vm_state active and task_state deleting.
Dec 05 15:57:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:57:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:57:43 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:57:43 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:57:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.179s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:57:43 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Deleted allocations for instance 329c6583-54c9-4cb4-a747-89986c2b1878
Dec 05 15:57:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-8303ade5-e2f1-460a-9311-e3955f1b035d tempest-TestShelveInstance-1198767828 tempest-TestShelveInstance-1198767828-project-member] Lock "329c6583-54c9-4cb4-a747-89986c2b1878" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.935s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:57:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:57:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:57:54 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:57:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:57:58 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:57:59 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:58:00 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:58:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:58:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:58:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:58:00 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:58:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:58:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:58:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:58:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:58:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:58:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:58:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:58:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:58:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:58:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:58:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:58:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:58:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:58:01 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:58:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:58:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:58:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:58:02 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:58:02 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:58:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=8821MB free_disk=24.917308807373047GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:58:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:58:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:58:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance db0fde77-eb40-4acb-93f7-66b5b76c8eea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:58:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 8608d2cf-476d-43b8-a124-c44507459a1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:58:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:58:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:58:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:58:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1293e674-c536-4d13-8982-66121aa6a34f tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:58:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1293e674-c536-4d13-8982-66121aa6a34f tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:58:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1293e674-c536-4d13-8982-66121aa6a34f tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:58:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1293e674-c536-4d13-8982-66121aa6a34f tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:58:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1293e674-c536-4d13-8982-66121aa6a34f tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:58:02 user nova-compute[75080]: INFO nova.compute.manager [None req-1293e674-c536-4d13-8982-66121aa6a34f tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Terminating instance
Dec 05 15:58:02 user nova-compute[75080]: DEBUG nova.compute.manager [None req-1293e674-c536-4d13-8982-66121aa6a34f tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:58:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:58:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:58:02 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:58:02 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:58:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:58:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.289s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:58:02 user nova-compute[75080]: DEBUG nova.compute.manager [req-64bd863a-2a4f-4610-a1bd-bfd34690383d req-7e6251ef-fbb7-4216-b3a7-c59a713851f8 service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Received event network-vif-unplugged-22ddcc5a-537d-41ac-b4c7-e4a702d84748 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:58:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-64bd863a-2a4f-4610-a1bd-bfd34690383d req-7e6251ef-fbb7-4216-b3a7-c59a713851f8 service nova] Acquiring lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:58:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-64bd863a-2a4f-4610-a1bd-bfd34690383d req-7e6251ef-fbb7-4216-b3a7-c59a713851f8 service nova] Lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:58:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-64bd863a-2a4f-4610-a1bd-bfd34690383d req-7e6251ef-fbb7-4216-b3a7-c59a713851f8 service nova] Lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:58:02 user nova-compute[75080]: DEBUG nova.compute.manager [req-64bd863a-2a4f-4610-a1bd-bfd34690383d req-7e6251ef-fbb7-4216-b3a7-c59a713851f8 service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] No waiting events found dispatching network-vif-unplugged-22ddcc5a-537d-41ac-b4c7-e4a702d84748 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:58:02 user nova-compute[75080]: DEBUG nova.compute.manager [req-64bd863a-2a4f-4610-a1bd-bfd34690383d req-7e6251ef-fbb7-4216-b3a7-c59a713851f8 service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Received event network-vif-unplugged-22ddcc5a-537d-41ac-b4c7-e4a702d84748 for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:58:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:58:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:58:03 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Instance destroyed successfully.
Dec 05 15:58:03 user nova-compute[75080]: DEBUG nova.objects.instance [None req-1293e674-c536-4d13-8982-66121aa6a34f tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lazy-loading 'resources' on Instance uuid 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:58:03 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-1293e674-c536-4d13-8982-66121aa6a34f tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:51:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-199249757',display_name='tempest-ServerRescueNegativeTestJSON-server-199249757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-199249757',id=47,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAgxSWkE/X5Qmy90sb5F3iA/7Io6ebkQVGemg7IdToZcm2LVt34tO/RkaNoO/5BDm6wpIZMOgIbznVpPEpc/oyLgJQw+s1ZWNaskbKmcyuJfpER0nfleTcXApBfkK9c+6A==',key_name='tempest-keypair-1096119825',keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:53:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cea1ac008cfd499a8df635aac9b1342d',ramdisk_id='',reservation_id='r-ukmdqv62',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1626475760',owner_user_name='tempest-ServerRescueNegativeTestJSON-1626475760-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:55:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1afa4590c69f423d97f7cd485e193b0f',uuid=7b2885bd-b61d-4e6f-9a6b-ba5939ae6274,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22ddcc5a-537d-41ac-b4c7-e4a702d84748", "address": "fa:16:3e:2f:f6:98", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ddcc5a-53", "ovs_interfaceid": "22ddcc5a-537d-41ac-b4c7-e4a702d84748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:58:03 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-1293e674-c536-4d13-8982-66121aa6a34f tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Converting VIF {"id": "22ddcc5a-537d-41ac-b4c7-e4a702d84748", "address": "fa:16:3e:2f:f6:98", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ddcc5a-53", "ovs_interfaceid": "22ddcc5a-537d-41ac-b4c7-e4a702d84748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:58:03 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-1293e674-c536-4d13-8982-66121aa6a34f tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:f6:98,bridge_name='br-int',has_traffic_filtering=True,id=22ddcc5a-537d-41ac-b4c7-e4a702d84748,network=Network(c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22ddcc5a-53') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:58:03 user nova-compute[75080]: DEBUG os_vif [None req-1293e674-c536-4d13-8982-66121aa6a34f tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:f6:98,bridge_name='br-int',has_traffic_filtering=True,id=22ddcc5a-537d-41ac-b4c7-e4a702d84748,network=Network(c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22ddcc5a-53') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:58:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:58:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22ddcc5a-53, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:58:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:58:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:58:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:58:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d75c5a9c-5fbc-4a3e-b270-996a04b836e2) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:58:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:58:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:58:03 user nova-compute[75080]: INFO os_vif [None req-1293e674-c536-4d13-8982-66121aa6a34f tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:f6:98,bridge_name='br-int',has_traffic_filtering=True,id=22ddcc5a-537d-41ac-b4c7-e4a702d84748,network=Network(c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22ddcc5a-53')
Dec 05 15:58:03 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-1293e674-c536-4d13-8982-66121aa6a34f tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Deleting instance files /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274_del
Dec 05 15:58:03 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-1293e674-c536-4d13-8982-66121aa6a34f tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Deletion of /opt/stack/data/nova/instances/7b2885bd-b61d-4e6f-9a6b-ba5939ae6274_del complete
Dec 05 15:58:03 user nova-compute[75080]: INFO nova.compute.manager [None req-1293e674-c536-4d13-8982-66121aa6a34f tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Took 0.84 seconds to destroy the instance on the hypervisor.
Dec 05 15:58:03 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-1293e674-c536-4d13-8982-66121aa6a34f tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:58:03 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:58:03 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:58:03 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:58:03 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:58:03 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:58:04 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:58:04 user nova-compute[75080]: DEBUG nova.compute.manager [req-5573f314-9688-4d51-a62f-3d75b4ceaeeb req-265d64d0-b8ce-4edd-b00c-b9de95359a6d service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Received event network-vif-deleted-22ddcc5a-537d-41ac-b4c7-e4a702d84748 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:58:04 user nova-compute[75080]: INFO nova.compute.manager [req-5573f314-9688-4d51-a62f-3d75b4ceaeeb req-265d64d0-b8ce-4edd-b00c-b9de95359a6d service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Neutron deleted interface 22ddcc5a-537d-41ac-b4c7-e4a702d84748; detaching it from the instance and deleting it from the info cache
Dec 05 15:58:04 user nova-compute[75080]: DEBUG nova.network.neutron [req-5573f314-9688-4d51-a62f-3d75b4ceaeeb req-265d64d0-b8ce-4edd-b00c-b9de95359a6d service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:58:04 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Took 0.91 seconds to deallocate network for instance.
Dec 05 15:58:04 user nova-compute[75080]: DEBUG nova.compute.manager [req-5573f314-9688-4d51-a62f-3d75b4ceaeeb req-265d64d0-b8ce-4edd-b00c-b9de95359a6d service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Detach interface failed, port_id=22ddcc5a-537d-41ac-b4c7-e4a702d84748, reason: Instance 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274 could not be found. {{(pid=75080) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 15:58:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1293e674-c536-4d13-8982-66121aa6a34f tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:58:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1293e674-c536-4d13-8982-66121aa6a34f tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:58:04 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-1293e674-c536-4d13-8982-66121aa6a34f tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:58:04 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-1293e674-c536-4d13-8982-66121aa6a34f tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:58:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1293e674-c536-4d13-8982-66121aa6a34f tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.207s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:58:04 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-1293e674-c536-4d13-8982-66121aa6a34f tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Deleted allocations for instance 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274
Dec 05 15:58:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1293e674-c536-4d13-8982-66121aa6a34f tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.202s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:58:04 user nova-compute[75080]: DEBUG nova.compute.manager [req-46b51df3-4249-4fb9-ba93-9e57c5ff2f20 req-2068224f-c0f4-4e18-aaf1-bef58ae0547d service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Received event network-vif-plugged-22ddcc5a-537d-41ac-b4c7-e4a702d84748 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:58:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-46b51df3-4249-4fb9-ba93-9e57c5ff2f20 req-2068224f-c0f4-4e18-aaf1-bef58ae0547d service nova] Acquiring lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:58:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-46b51df3-4249-4fb9-ba93-9e57c5ff2f20 req-2068224f-c0f4-4e18-aaf1-bef58ae0547d service nova] Lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:58:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-46b51df3-4249-4fb9-ba93-9e57c5ff2f20 req-2068224f-c0f4-4e18-aaf1-bef58ae0547d service nova] Lock "7b2885bd-b61d-4e6f-9a6b-ba5939ae6274-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:58:04 user nova-compute[75080]: DEBUG nova.compute.manager [req-46b51df3-4249-4fb9-ba93-9e57c5ff2f20 req-2068224f-c0f4-4e18-aaf1-bef58ae0547d service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] No waiting events found dispatching network-vif-plugged-22ddcc5a-537d-41ac-b4c7-e4a702d84748 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:58:04 user nova-compute[75080]: WARNING nova.compute.manager [req-46b51df3-4249-4fb9-ba93-9e57c5ff2f20 req-2068224f-c0f4-4e18-aaf1-bef58ae0547d service nova] [instance: 7b2885bd-b61d-4e6f-9a6b-ba5939ae6274] Received unexpected event network-vif-plugged-22ddcc5a-537d-41ac-b4c7-e4a702d84748 for instance with vm_state deleted and task_state None.
Dec 05 15:58:06 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:58:07 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:58:07 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:58:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-8608d2cf-476d-43b8-a124-c44507459a1e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 15:58:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-8608d2cf-476d-43b8-a124-c44507459a1e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 15:58:07 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 15:58:07 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Updating instance_info_cache with network_info: [{"id": "9a4d35f3-f184-49ba-b94d-5fcdd955f572", "address": "fa:16:3e:22:37:f1", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a4d35f3-f1", "ovs_interfaceid": "9a4d35f3-f184-49ba-b94d-5fcdd955f572", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:58:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-8608d2cf-476d-43b8-a124-c44507459a1e" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 15:58:07 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 15:58:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:58:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:58:15 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:58:17 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:58:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:58:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:58:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:58:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:58:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:58:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:58:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:58:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:58:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:58:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:58:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:58:54 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:58:54 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Cleaning up deleted instances {{(pid=75080) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 05 15:58:54 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] There are 0 instances to clean {{(pid=75080) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 05 15:58:56 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:58:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:58:58 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:58:59 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:59:00 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:59:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:59:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:59:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:59:00 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 15:59:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:59:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:59:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:59:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:59:00 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:59:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:59:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:59:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:59:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:59:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:59:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 15:59:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 15:59:02 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:59:02 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 15:59:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=8980MB free_disk=24.944114685058594GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 15:59:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:59:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:59:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance db0fde77-eb40-4acb-93f7-66b5b76c8eea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:59:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 8608d2cf-476d-43b8-a124-c44507459a1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 15:59:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 15:59:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 15:59:02 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing inventories for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 05 15:59:02 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Updating ProviderTree inventory for provider 21b770fa-b774-46c9-9415-db26064ccd0f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 05 15:59:02 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Updating inventory in ProviderTree for provider 21b770fa-b774-46c9-9415-db26064ccd0f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 15:59:02 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing aggregate associations for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f, aggregates: None {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 05 15:59:02 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing trait associations for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f, traits: COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 05 15:59:02 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:59:02 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:59:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 15:59:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.571s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:59:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6eba010c-8fbe-47c4-877f-26054586eea5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "8608d2cf-476d-43b8-a124-c44507459a1e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:59:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6eba010c-8fbe-47c4-877f-26054586eea5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "8608d2cf-476d-43b8-a124-c44507459a1e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:59:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6eba010c-8fbe-47c4-877f-26054586eea5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "8608d2cf-476d-43b8-a124-c44507459a1e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:59:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6eba010c-8fbe-47c4-877f-26054586eea5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "8608d2cf-476d-43b8-a124-c44507459a1e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:59:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6eba010c-8fbe-47c4-877f-26054586eea5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "8608d2cf-476d-43b8-a124-c44507459a1e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:59:02 user nova-compute[75080]: INFO nova.compute.manager [None req-6eba010c-8fbe-47c4-877f-26054586eea5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Terminating instance
Dec 05 15:59:02 user nova-compute[75080]: DEBUG nova.compute.manager [None req-6eba010c-8fbe-47c4-877f-26054586eea5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:59:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:59:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:59:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:59:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:59:03 user nova-compute[75080]: DEBUG nova.compute.manager [req-d6dcbc36-7d26-4f39-9aeb-610b9fea95bf req-bae9fc90-78a6-4572-97ca-107a6a624a79 service nova] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Received event network-vif-unplugged-9a4d35f3-f184-49ba-b94d-5fcdd955f572 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:59:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d6dcbc36-7d26-4f39-9aeb-610b9fea95bf req-bae9fc90-78a6-4572-97ca-107a6a624a79 service nova] Acquiring lock "8608d2cf-476d-43b8-a124-c44507459a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:59:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d6dcbc36-7d26-4f39-9aeb-610b9fea95bf req-bae9fc90-78a6-4572-97ca-107a6a624a79 service nova] Lock "8608d2cf-476d-43b8-a124-c44507459a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:59:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-d6dcbc36-7d26-4f39-9aeb-610b9fea95bf req-bae9fc90-78a6-4572-97ca-107a6a624a79 service nova] Lock "8608d2cf-476d-43b8-a124-c44507459a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:59:03 user nova-compute[75080]: DEBUG nova.compute.manager [req-d6dcbc36-7d26-4f39-9aeb-610b9fea95bf req-bae9fc90-78a6-4572-97ca-107a6a624a79 service nova] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] No waiting events found dispatching network-vif-unplugged-9a4d35f3-f184-49ba-b94d-5fcdd955f572 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:59:03 user nova-compute[75080]: DEBUG nova.compute.manager [req-d6dcbc36-7d26-4f39-9aeb-610b9fea95bf req-bae9fc90-78a6-4572-97ca-107a6a624a79 service nova] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Received event network-vif-unplugged-9a4d35f3-f184-49ba-b94d-5fcdd955f572 for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:59:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:59:03 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Instance destroyed successfully.
Dec 05 15:59:03 user nova-compute[75080]: DEBUG nova.objects.instance [None req-6eba010c-8fbe-47c4-877f-26054586eea5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lazy-loading 'resources' on Instance uuid 8608d2cf-476d-43b8-a124-c44507459a1e {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:59:03 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-6eba010c-8fbe-47c4-877f-26054586eea5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:42:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-791550701',display_name='tempest-ServerRescueNegativeTestJSON-server-791550701',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-791550701',id=44,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:44:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cea1ac008cfd499a8df635aac9b1342d',ramdisk_id='',reservation_id='r-ih68cpqu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1626475760',owner_user_name='tempest-ServerRescueNegativeTestJSON-1626475760-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:44:49Z,user_data=None,user_id='1afa4590c69f423d97f7cd485e193b0f',uuid=8608d2cf-476d-43b8-a124-c44507459a1e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "9a4d35f3-f184-49ba-b94d-5fcdd955f572", "address": "fa:16:3e:22:37:f1", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a4d35f3-f1", "ovs_interfaceid": "9a4d35f3-f184-49ba-b94d-5fcdd955f572", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:59:03 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-6eba010c-8fbe-47c4-877f-26054586eea5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Converting VIF {"id": "9a4d35f3-f184-49ba-b94d-5fcdd955f572", "address": "fa:16:3e:22:37:f1", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a4d35f3-f1", "ovs_interfaceid": "9a4d35f3-f184-49ba-b94d-5fcdd955f572", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:59:03 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-6eba010c-8fbe-47c4-877f-26054586eea5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:37:f1,bridge_name='br-int',has_traffic_filtering=True,id=9a4d35f3-f184-49ba-b94d-5fcdd955f572,network=Network(c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a4d35f3-f1') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:59:03 user nova-compute[75080]: DEBUG os_vif [None req-6eba010c-8fbe-47c4-877f-26054586eea5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:37:f1,bridge_name='br-int',has_traffic_filtering=True,id=9a4d35f3-f184-49ba-b94d-5fcdd955f572,network=Network(c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a4d35f3-f1') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:59:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:59:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a4d35f3-f1, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:59:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:59:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:59:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:59:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6c3d0b48-0081-4c56-9b83-0d55a0094dac) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:59:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:59:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:59:03 user nova-compute[75080]: INFO os_vif [None req-6eba010c-8fbe-47c4-877f-26054586eea5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:37:f1,bridge_name='br-int',has_traffic_filtering=True,id=9a4d35f3-f184-49ba-b94d-5fcdd955f572,network=Network(c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a4d35f3-f1')
Dec 05 15:59:03 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-6eba010c-8fbe-47c4-877f-26054586eea5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Deleting instance files /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e_del
Dec 05 15:59:03 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-6eba010c-8fbe-47c4-877f-26054586eea5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Deletion of /opt/stack/data/nova/instances/8608d2cf-476d-43b8-a124-c44507459a1e_del complete
Dec 05 15:59:03 user nova-compute[75080]: INFO nova.compute.manager [None req-6eba010c-8fbe-47c4-877f-26054586eea5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Took 0.67 seconds to destroy the instance on the hypervisor.
Dec 05 15:59:03 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-6eba010c-8fbe-47c4-877f-26054586eea5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:59:03 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:59:03 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:59:03 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:59:03 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Took 0.46 seconds to deallocate network for instance.
Dec 05 15:59:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6eba010c-8fbe-47c4-877f-26054586eea5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:59:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6eba010c-8fbe-47c4-877f-26054586eea5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:59:04 user nova-compute[75080]: DEBUG nova.compute.manager [req-ed5db548-46b7-48b6-9ccd-8950dc8dccda req-0dd0c854-9086-4e63-a39e-2573bce90573 service nova] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Received event network-vif-deleted-9a4d35f3-f184-49ba-b94d-5fcdd955f572 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:59:04 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-6eba010c-8fbe-47c4-877f-26054586eea5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:59:04 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-6eba010c-8fbe-47c4-877f-26054586eea5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:59:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6eba010c-8fbe-47c4-877f-26054586eea5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.150s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:59:04 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-6eba010c-8fbe-47c4-877f-26054586eea5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Deleted allocations for instance 8608d2cf-476d-43b8-a124-c44507459a1e
Dec 05 15:59:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-6eba010c-8fbe-47c4-877f-26054586eea5 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "8608d2cf-476d-43b8-a124-c44507459a1e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.481s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:59:04 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:59:04 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 15:59:04 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:59:04 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75080) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 05 15:59:05 user nova-compute[75080]: DEBUG nova.compute.manager [req-3cc8752d-01e5-48af-9896-c75299df7680 req-459ce3aa-a45e-4e05-9d1b-5f54ddc45b4b service nova] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Received event network-vif-plugged-9a4d35f3-f184-49ba-b94d-5fcdd955f572 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:59:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-3cc8752d-01e5-48af-9896-c75299df7680 req-459ce3aa-a45e-4e05-9d1b-5f54ddc45b4b service nova] Acquiring lock "8608d2cf-476d-43b8-a124-c44507459a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:59:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-3cc8752d-01e5-48af-9896-c75299df7680 req-459ce3aa-a45e-4e05-9d1b-5f54ddc45b4b service nova] Lock "8608d2cf-476d-43b8-a124-c44507459a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:59:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-3cc8752d-01e5-48af-9896-c75299df7680 req-459ce3aa-a45e-4e05-9d1b-5f54ddc45b4b service nova] Lock "8608d2cf-476d-43b8-a124-c44507459a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:59:05 user nova-compute[75080]: DEBUG nova.compute.manager [req-3cc8752d-01e5-48af-9896-c75299df7680 req-459ce3aa-a45e-4e05-9d1b-5f54ddc45b4b service nova] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] No waiting events found dispatching network-vif-plugged-9a4d35f3-f184-49ba-b94d-5fcdd955f572 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:59:05 user nova-compute[75080]: WARNING nova.compute.manager [req-3cc8752d-01e5-48af-9896-c75299df7680 req-459ce3aa-a45e-4e05-9d1b-5f54ddc45b4b service nova] [instance: 8608d2cf-476d-43b8-a124-c44507459a1e] Received unexpected event network-vif-plugged-9a4d35f3-f184-49ba-b94d-5fcdd955f572 for instance with vm_state deleted and task_state None.
Dec 05 15:59:05 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:59:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:59:08 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:59:09 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:59:09 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 15:59:09 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Didn't find any instances for network info cache update. {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 15:59:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:59:15 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:59:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:59:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:59:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:59:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:59:33 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:59:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:59:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:59:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:59:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-20f79c73-a217-4dcd-9f37-47d41f8ee792 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:59:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-20f79c73-a217-4dcd-9f37-47d41f8ee792 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:59:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-20f79c73-a217-4dcd-9f37-47d41f8ee792 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:59:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-20f79c73-a217-4dcd-9f37-47d41f8ee792 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:59:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-20f79c73-a217-4dcd-9f37-47d41f8ee792 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:59:53 user nova-compute[75080]: INFO nova.compute.manager [None req-20f79c73-a217-4dcd-9f37-47d41f8ee792 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Terminating instance
Dec 05 15:59:53 user nova-compute[75080]: DEBUG nova.compute.manager [None req-20f79c73-a217-4dcd-9f37-47d41f8ee792 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 15:59:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:59:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:59:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:59:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:59:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:59:53 user nova-compute[75080]: DEBUG nova.compute.manager [req-5d38fbe6-a9d0-492e-bead-15aa1c08d61e req-be312ff7-d373-41d7-a4ab-27c585e90a3a service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Received event network-vif-unplugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:59:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5d38fbe6-a9d0-492e-bead-15aa1c08d61e req-be312ff7-d373-41d7-a4ab-27c585e90a3a service nova] Acquiring lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:59:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5d38fbe6-a9d0-492e-bead-15aa1c08d61e req-be312ff7-d373-41d7-a4ab-27c585e90a3a service nova] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:59:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5d38fbe6-a9d0-492e-bead-15aa1c08d61e req-be312ff7-d373-41d7-a4ab-27c585e90a3a service nova] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:59:53 user nova-compute[75080]: DEBUG nova.compute.manager [req-5d38fbe6-a9d0-492e-bead-15aa1c08d61e req-be312ff7-d373-41d7-a4ab-27c585e90a3a service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] No waiting events found dispatching network-vif-unplugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:59:53 user nova-compute[75080]: DEBUG nova.compute.manager [req-5d38fbe6-a9d0-492e-bead-15aa1c08d61e req-be312ff7-d373-41d7-a4ab-27c585e90a3a service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Received event network-vif-unplugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 15:59:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:59:54 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Instance destroyed successfully.
Dec 05 15:59:54 user nova-compute[75080]: DEBUG nova.objects.instance [None req-20f79c73-a217-4dcd-9f37-47d41f8ee792 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lazy-loading 'resources' on Instance uuid db0fde77-eb40-4acb-93f7-66b5b76c8eea {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 15:59:54 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-20f79c73-a217-4dcd-9f37-47d41f8ee792 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T15:42:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-435850721',display_name='tempest-ServerRescueNegativeTestJSON-server-435850721',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-435850721',id=43,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T15:47:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cea1ac008cfd499a8df635aac9b1342d',ramdisk_id='',reservation_id='r-p7nnlu30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1626475760',owner_user_name='tempest-ServerRescueNegativeTestJSON-1626475760-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T15:49:34Z,user_data=None,user_id='1afa4590c69f423d97f7cd485e193b0f',uuid=db0fde77-eb40-4acb-93f7-66b5b76c8eea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09233cd3-602f-4eb8-a74c-7d592a1a3906", "address": "fa:16:3e:44:84:7c", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09233cd3-60", "ovs_interfaceid": "09233cd3-602f-4eb8-a74c-7d592a1a3906", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 15:59:54 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-20f79c73-a217-4dcd-9f37-47d41f8ee792 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Converting VIF {"id": "09233cd3-602f-4eb8-a74c-7d592a1a3906", "address": "fa:16:3e:44:84:7c", "network": {"id": "c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-287961581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea1ac008cfd499a8df635aac9b1342d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09233cd3-60", "ovs_interfaceid": "09233cd3-602f-4eb8-a74c-7d592a1a3906", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 15:59:54 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-20f79c73-a217-4dcd-9f37-47d41f8ee792 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:84:7c,bridge_name='br-int',has_traffic_filtering=True,id=09233cd3-602f-4eb8-a74c-7d592a1a3906,network=Network(c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09233cd3-60') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 15:59:54 user nova-compute[75080]: DEBUG os_vif [None req-20f79c73-a217-4dcd-9f37-47d41f8ee792 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:84:7c,bridge_name='br-int',has_traffic_filtering=True,id=09233cd3-602f-4eb8-a74c-7d592a1a3906,network=Network(c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09233cd3-60') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 15:59:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:59:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09233cd3-60, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:59:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:59:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:59:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:59:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aa7e4628-d41c-4d01-aafb-d010a734055a) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 15:59:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:59:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 15:59:54 user nova-compute[75080]: INFO os_vif [None req-20f79c73-a217-4dcd-9f37-47d41f8ee792 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:84:7c,bridge_name='br-int',has_traffic_filtering=True,id=09233cd3-602f-4eb8-a74c-7d592a1a3906,network=Network(c1d8c3cd-2b7e-43ae-9ff7-f7d200b3c0a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09233cd3-60')
Dec 05 15:59:54 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-20f79c73-a217-4dcd-9f37-47d41f8ee792 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Deleting instance files /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea_del
Dec 05 15:59:54 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-20f79c73-a217-4dcd-9f37-47d41f8ee792 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Deletion of /opt/stack/data/nova/instances/db0fde77-eb40-4acb-93f7-66b5b76c8eea_del complete
Dec 05 15:59:54 user nova-compute[75080]: INFO nova.compute.manager [None req-20f79c73-a217-4dcd-9f37-47d41f8ee792 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Took 0.98 seconds to destroy the instance on the hypervisor.
Dec 05 15:59:54 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-20f79c73-a217-4dcd-9f37-47d41f8ee792 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 15:59:54 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 15:59:54 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 15:59:55 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:59:55 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Took 0.80 seconds to deallocate network for instance.
Dec 05 15:59:55 user nova-compute[75080]: DEBUG nova.compute.manager [req-281ac996-8ddf-41ab-8947-34dd1f588d71 req-7a37d1b2-b087-4e3b-bf64-79b64c0434d3 service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Received event network-vif-deleted-09233cd3-602f-4eb8-a74c-7d592a1a3906 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:59:55 user nova-compute[75080]: INFO nova.compute.manager [req-281ac996-8ddf-41ab-8947-34dd1f588d71 req-7a37d1b2-b087-4e3b-bf64-79b64c0434d3 service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Neutron deleted interface 09233cd3-602f-4eb8-a74c-7d592a1a3906; detaching it from the instance and deleting it from the info cache
Dec 05 15:59:55 user nova-compute[75080]: DEBUG nova.network.neutron [req-281ac996-8ddf-41ab-8947-34dd1f588d71 req-7a37d1b2-b087-4e3b-bf64-79b64c0434d3 service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 15:59:55 user nova-compute[75080]: DEBUG nova.compute.manager [req-281ac996-8ddf-41ab-8947-34dd1f588d71 req-7a37d1b2-b087-4e3b-bf64-79b64c0434d3 service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Detach interface failed, port_id=09233cd3-602f-4eb8-a74c-7d592a1a3906, reason: Instance db0fde77-eb40-4acb-93f7-66b5b76c8eea could not be found. {{(pid=75080) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 15:59:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-20f79c73-a217-4dcd-9f37-47d41f8ee792 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:59:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-20f79c73-a217-4dcd-9f37-47d41f8ee792 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:59:55 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-20f79c73-a217-4dcd-9f37-47d41f8ee792 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 15:59:55 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-20f79c73-a217-4dcd-9f37-47d41f8ee792 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 15:59:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-20f79c73-a217-4dcd-9f37-47d41f8ee792 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:59:55 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-20f79c73-a217-4dcd-9f37-47d41f8ee792 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Deleted allocations for instance db0fde77-eb40-4acb-93f7-66b5b76c8eea
Dec 05 15:59:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-20f79c73-a217-4dcd-9f37-47d41f8ee792 tempest-ServerRescueNegativeTestJSON-1626475760 tempest-ServerRescueNegativeTestJSON-1626475760-project-member] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.072s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:59:55 user nova-compute[75080]: DEBUG nova.compute.manager [req-c1b3a86d-7b8f-42d8-9bcc-9baedcc6f339 req-61508a18-a7b2-4512-a772-ebfa6a59b376 service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Received event network-vif-plugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 15:59:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c1b3a86d-7b8f-42d8-9bcc-9baedcc6f339 req-61508a18-a7b2-4512-a772-ebfa6a59b376 service nova] Acquiring lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 15:59:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c1b3a86d-7b8f-42d8-9bcc-9baedcc6f339 req-61508a18-a7b2-4512-a772-ebfa6a59b376 service nova] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 15:59:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c1b3a86d-7b8f-42d8-9bcc-9baedcc6f339 req-61508a18-a7b2-4512-a772-ebfa6a59b376 service nova] Lock "db0fde77-eb40-4acb-93f7-66b5b76c8eea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 15:59:55 user nova-compute[75080]: DEBUG nova.compute.manager [req-c1b3a86d-7b8f-42d8-9bcc-9baedcc6f339 req-61508a18-a7b2-4512-a772-ebfa6a59b376 service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] No waiting events found dispatching network-vif-plugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 15:59:55 user nova-compute[75080]: WARNING nova.compute.manager [req-c1b3a86d-7b8f-42d8-9bcc-9baedcc6f339 req-61508a18-a7b2-4512-a772-ebfa6a59b376 service nova] [instance: db0fde77-eb40-4acb-93f7-66b5b76c8eea] Received unexpected event network-vif-plugged-09233cd3-602f-4eb8-a74c-7d592a1a3906 for instance with vm_state deleted and task_state None.
Dec 05 15:59:56 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 15:59:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 15:59:59 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:00:00 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:00:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:00:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:00:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:00:00 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 16:00:00 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:00:00 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:00:00 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=9170MB free_disk=24.999767303466797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 16:00:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:00:00 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:00:00 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 16:00:00 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 16:00:00 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 16:00:01 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 16:00:01 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 16:00:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:00:02 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:00:02 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:00:02 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 16:00:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:00:05 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:00:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:00:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:00:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:00:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:00:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:00:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:00:10 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:00:11 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:00:11 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 16:00:11 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Rebuilding the list of instances to heal {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 16:00:11 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Didn't find any instances for network info cache update. {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 16:00:14 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:00:16 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:00:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:00:21 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:00:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:00:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:00:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:00:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:00:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:00:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:00:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:00:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:00:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:00:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:00:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:00:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:00:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:00:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:00:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:00:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:00:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:00:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "7bbdd293-b776-4840-9127-840f093eca19" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:00:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "7bbdd293-b776-4840-9127-840f093eca19" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:00:55 user nova-compute[75080]: DEBUG nova.compute.manager [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 16:00:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:00:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:00:55 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 16:00:55 user nova-compute[75080]: INFO nova.compute.claims [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Claim successful on node user
Dec 05 16:00:56 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 16:00:56 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 16:00:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.214s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:00:56 user nova-compute[75080]: DEBUG nova.compute.manager [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 16:00:56 user nova-compute[75080]: DEBUG nova.compute.manager [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 16:00:56 user nova-compute[75080]: DEBUG nova.network.neutron [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 16:00:56 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 16:00:56 user nova-compute[75080]: DEBUG nova.compute.manager [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 16:00:56 user nova-compute[75080]: DEBUG nova.policy [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bf39da2be27240a8b3e89e4484b9a99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c62808660324e5aa23e8618f7d32ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 16:00:56 user nova-compute[75080]: DEBUG nova.compute.manager [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 16:00:56 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 16:00:56 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Creating image(s)
Dec 05 16:00:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "/opt/stack/data/nova/instances/7bbdd293-b776-4840-9127-840f093eca19/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:00:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "/opt/stack/data/nova/instances/7bbdd293-b776-4840-9127-840f093eca19/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:00:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "/opt/stack/data/nova/instances/7bbdd293-b776-4840-9127-840f093eca19/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:00:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:00:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.175s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:00:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:00:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:00:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:00:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.185s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:00:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/7bbdd293-b776-4840-9127-840f093eca19/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:00:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/7bbdd293-b776-4840-9127-840f093eca19/disk 1073741824" returned: 0 in 0.063s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:00:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:00:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:00:56 user nova-compute[75080]: DEBUG nova.network.neutron [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Successfully created port: 0ada633a-17ff-4082-a498-b4594478a9ef {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 16:00:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.184s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:00:56 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7bbdd293-b776-4840-9127-840f093eca19/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 16:00:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bbdd293-b776-4840-9127-840f093eca19/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:00:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bbdd293-b776-4840-9127-840f093eca19/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:00:57 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Cannot resize image /opt/stack/data/nova/instances/7bbdd293-b776-4840-9127-840f093eca19/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 16:00:57 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 16:00:57 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Ensure instance console log exists: /opt/stack/data/nova/instances/7bbdd293-b776-4840-9127-840f093eca19/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 16:00:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:00:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:00:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:00:57 user nova-compute[75080]: DEBUG nova.network.neutron [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Successfully updated port: 0ada633a-17ff-4082-a498-b4594478a9ef {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 16:00:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "refresh_cache-7bbdd293-b776-4840-9127-840f093eca19" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 16:00:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquired lock "refresh_cache-7bbdd293-b776-4840-9127-840f093eca19" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 16:00:57 user nova-compute[75080]: DEBUG nova.network.neutron [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 16:00:57 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:00:57 user nova-compute[75080]: DEBUG nova.compute.manager [req-f81b6517-26f2-4c37-b055-04880c1ce504 req-7c9c8f6f-62d4-447a-9673-388729878597 service nova] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Received event network-changed-0ada633a-17ff-4082-a498-b4594478a9ef {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 16:00:57 user nova-compute[75080]: DEBUG nova.compute.manager [req-f81b6517-26f2-4c37-b055-04880c1ce504 req-7c9c8f6f-62d4-447a-9673-388729878597 service nova] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Refreshing instance network info cache due to event network-changed-0ada633a-17ff-4082-a498-b4594478a9ef. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 16:00:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f81b6517-26f2-4c37-b055-04880c1ce504 req-7c9c8f6f-62d4-447a-9673-388729878597 service nova] Acquiring lock "refresh_cache-7bbdd293-b776-4840-9127-840f093eca19" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 16:00:57 user nova-compute[75080]: DEBUG nova.network.neutron [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 16:00:57 user nova-compute[75080]: DEBUG nova.network.neutron [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Updating instance_info_cache with network_info: [{"id": "0ada633a-17ff-4082-a498-b4594478a9ef", "address": "fa:16:3e:0b:2a:15", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ada633a-17", "ovs_interfaceid": "0ada633a-17ff-4082-a498-b4594478a9ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 16:00:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Releasing lock "refresh_cache-7bbdd293-b776-4840-9127-840f093eca19" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 16:00:57 user nova-compute[75080]: DEBUG nova.compute.manager [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Instance network_info: |[{"id": "0ada633a-17ff-4082-a498-b4594478a9ef", "address": "fa:16:3e:0b:2a:15", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ada633a-17", "ovs_interfaceid": "0ada633a-17ff-4082-a498-b4594478a9ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 16:00:57 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f81b6517-26f2-4c37-b055-04880c1ce504 req-7c9c8f6f-62d4-447a-9673-388729878597 service nova] Acquired lock "refresh_cache-7bbdd293-b776-4840-9127-840f093eca19" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 16:00:57 user nova-compute[75080]: DEBUG nova.network.neutron [req-f81b6517-26f2-4c37-b055-04880c1ce504 req-7c9c8f6f-62d4-447a-9673-388729878597 service nova] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Refreshing network info cache for port 0ada633a-17ff-4082-a498-b4594478a9ef {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 16:00:57 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Start _get_guest_xml network_info=[{"id": "0ada633a-17ff-4082-a498-b4594478a9ef", "address": "fa:16:3e:0b:2a:15", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ada633a-17", "ovs_interfaceid": "0ada633a-17ff-4082-a498-b4594478a9ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 16:00:58 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:00:58 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:00:58 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T16:00:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1484290688',display_name='tempest-AttachVolumeNegativeTest-server-1484290688',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1484290688',id=49,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCUrasWaGIW91sB0twQJtGQzG/9Yww6FG4iooOsPaBdX+1Qo5Pte4kWY5PLtzkBL1prGu6kckKwNizAqmLi52hsLjVLnvJOa6rae5Jrr6onfRwn+f97yspr6mz3JSNxBQ==',key_name='tempest-keypair-809672843',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c62808660324e5aa23e8618f7d32ae4',ramdisk_id='',reservation_id='r-gh2nuf2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-329346343',owner_user_name='tempest-AttachVolumeNegativeTest-329346343-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T16:00:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf39da2be27240a8b3e89e4484b9a99b',uuid=7bbdd293-b776-4840-9127-840f093eca19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ada633a-17ff-4082-a498-b4594478a9ef", "address": "fa:16:3e:0b:2a:15", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ada633a-17", "ovs_interfaceid": "0ada633a-17ff-4082-a498-b4594478a9ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Converting VIF {"id": "0ada633a-17ff-4082-a498-b4594478a9ef", "address": "fa:16:3e:0b:2a:15", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ada633a-17", "ovs_interfaceid": "0ada633a-17ff-4082-a498-b4594478a9ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:2a:15,bridge_name='br-int',has_traffic_filtering=True,id=0ada633a-17ff-4082-a498-b4594478a9ef,network=Network(72069664-17d2-4963-9f71-559dd80df9ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ada633a-17') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG nova.objects.instance [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lazy-loading 'pci_devices' on Instance uuid 7bbdd293-b776-4840-9127-840f093eca19 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] End _get_guest_xml xml=<domain type="kvm">
Dec 05 16:00:58 user nova-compute[75080]:   <uuid>7bbdd293-b776-4840-9127-840f093eca19</uuid>
Dec 05 16:00:58 user nova-compute[75080]:   <name>instance-00000031</name>
Dec 05 16:00:58 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 16:00:58 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 16:00:58 user nova-compute[75080]:   <metadata>
Dec 05 16:00:58 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 16:00:58 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 16:00:58 user nova-compute[75080]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1484290688</nova:name>
Dec 05 16:00:58 user nova-compute[75080]:       <nova:creationTime>2023-12-05 16:00:58</nova:creationTime>
Dec 05 16:00:58 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 16:00:58 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 16:00:58 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 16:00:58 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 16:00:58 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 16:00:58 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 16:00:58 user nova-compute[75080]:       </nova:flavor>
Dec 05 16:00:58 user nova-compute[75080]:       <nova:owner>
Dec 05 16:00:58 user nova-compute[75080]:         <nova:user uuid="bf39da2be27240a8b3e89e4484b9a99b">tempest-AttachVolumeNegativeTest-329346343-project-member</nova:user>
Dec 05 16:00:58 user nova-compute[75080]:         <nova:project uuid="1c62808660324e5aa23e8618f7d32ae4">tempest-AttachVolumeNegativeTest-329346343</nova:project>
Dec 05 16:00:58 user nova-compute[75080]:       </nova:owner>
Dec 05 16:00:58 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 16:00:58 user nova-compute[75080]:       <nova:ports>
Dec 05 16:00:58 user nova-compute[75080]:         <nova:port uuid="0ada633a-17ff-4082-a498-b4594478a9ef">
Dec 05 16:00:58 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 05 16:00:58 user nova-compute[75080]:         </nova:port>
Dec 05 16:00:58 user nova-compute[75080]:       </nova:ports>
Dec 05 16:00:58 user nova-compute[75080]:     </nova:instance>
Dec 05 16:00:58 user nova-compute[75080]:   </metadata>
Dec 05 16:00:58 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 16:00:58 user nova-compute[75080]:     <system>
Dec 05 16:00:58 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 16:00:58 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 16:00:58 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 16:00:58 user nova-compute[75080]:       <entry name="serial">7bbdd293-b776-4840-9127-840f093eca19</entry>
Dec 05 16:00:58 user nova-compute[75080]:       <entry name="uuid">7bbdd293-b776-4840-9127-840f093eca19</entry>
Dec 05 16:00:58 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 16:00:58 user nova-compute[75080]:     </system>
Dec 05 16:00:58 user nova-compute[75080]:   </sysinfo>
Dec 05 16:00:58 user nova-compute[75080]:   <os>
Dec 05 16:00:58 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 16:00:58 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 16:00:58 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 16:00:58 user nova-compute[75080]:   </os>
Dec 05 16:00:58 user nova-compute[75080]:   <features>
Dec 05 16:00:58 user nova-compute[75080]:     <acpi/>
Dec 05 16:00:58 user nova-compute[75080]:     <apic/>
Dec 05 16:00:58 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 16:00:58 user nova-compute[75080]:   </features>
Dec 05 16:00:58 user nova-compute[75080]:   <clock offset="utc">
Dec 05 16:00:58 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 16:00:58 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 16:00:58 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 16:00:58 user nova-compute[75080]:   </clock>
Dec 05 16:00:58 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 16:00:58 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 16:00:58 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 16:00:58 user nova-compute[75080]:   </cpu>
Dec 05 16:00:58 user nova-compute[75080]:   <devices>
Dec 05 16:00:58 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 16:00:58 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 16:00:58 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/7bbdd293-b776-4840-9127-840f093eca19/disk"/>
Dec 05 16:00:58 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 16:00:58 user nova-compute[75080]:     </disk>
Dec 05 16:00:58 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 16:00:58 user nova-compute[75080]:       <mac address="fa:16:3e:0b:2a:15"/>
Dec 05 16:00:58 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 16:00:58 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 16:00:58 user nova-compute[75080]:       <target dev="tap0ada633a-17"/>
Dec 05 16:00:58 user nova-compute[75080]:     </interface>
Dec 05 16:00:58 user nova-compute[75080]:     <serial type="pty">
Dec 05 16:00:58 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/7bbdd293-b776-4840-9127-840f093eca19/console.log" append="off"/>
Dec 05 16:00:58 user nova-compute[75080]:     </serial>
Dec 05 16:00:58 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 16:00:58 user nova-compute[75080]:     <video>
Dec 05 16:00:58 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 16:00:58 user nova-compute[75080]:     </video>
Dec 05 16:00:58 user nova-compute[75080]:     <rng model="virtio">
Dec 05 16:00:58 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 16:00:58 user nova-compute[75080]:     </rng>
Dec 05 16:00:58 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 16:00:58 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 16:00:58 user nova-compute[75080]:       <stats period="10"/>
Dec 05 16:00:58 user nova-compute[75080]:     </memballoon>
Dec 05 16:00:58 user nova-compute[75080]:   </devices>
Dec 05 16:00:58 user nova-compute[75080]: </domain>
Dec 05 16:00:58 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T16:00:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1484290688',display_name='tempest-AttachVolumeNegativeTest-server-1484290688',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1484290688',id=49,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCUrasWaGIW91sB0twQJtGQzG/9Yww6FG4iooOsPaBdX+1Qo5Pte4kWY5PLtzkBL1prGu6kckKwNizAqmLi52hsLjVLnvJOa6rae5Jrr6onfRwn+f97yspr6mz3JSNxBQ==',key_name='tempest-keypair-809672843',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c62808660324e5aa23e8618f7d32ae4',ramdisk_id='',reservation_id='r-gh2nuf2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-329346343',owner_user_name='tempest-AttachVolumeNegativeTest-329346343-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T16:00:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf39da2be27240a8b3e89e4484b9a99b',uuid=7bbdd293-b776-4840-9127-840f093eca19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ada633a-17ff-4082-a498-b4594478a9ef", "address": "fa:16:3e:0b:2a:15", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ada633a-17", "ovs_interfaceid": "0ada633a-17ff-4082-a498-b4594478a9ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Converting VIF {"id": "0ada633a-17ff-4082-a498-b4594478a9ef", "address": "fa:16:3e:0b:2a:15", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ada633a-17", "ovs_interfaceid": "0ada633a-17ff-4082-a498-b4594478a9ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:2a:15,bridge_name='br-int',has_traffic_filtering=True,id=0ada633a-17ff-4082-a498-b4594478a9ef,network=Network(72069664-17d2-4963-9f71-559dd80df9ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ada633a-17') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG os_vif [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:2a:15,bridge_name='br-int',has_traffic_filtering=True,id=0ada633a-17ff-4082-a498-b4594478a9ef,network=Network(72069664-17d2-4963-9f71-559dd80df9ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ada633a-17') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3847d88a-5e7e-56ed-a829-ef1b733a656f', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ada633a-17, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ada633a-17, col_values=(('qos', UUID('5d6dcf60-a68d-41d4-849f-d962e4433d10')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ada633a-17, col_values=(('external_ids', {'iface-id': '0ada633a-17ff-4082-a498-b4594478a9ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:2a:15', 'vm-uuid': '7bbdd293-b776-4840-9127-840f093eca19'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:00:58 user nova-compute[75080]: INFO os_vif [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:2a:15,bridge_name='br-int',has_traffic_filtering=True,id=0ada633a-17ff-4082-a498-b4594478a9ef,network=Network(72069664-17d2-4963-9f71-559dd80df9ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ada633a-17')
Dec 05 16:00:58 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] No VIF found with MAC fa:16:3e:0b:2a:15, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG nova.network.neutron [req-f81b6517-26f2-4c37-b055-04880c1ce504 req-7c9c8f6f-62d4-447a-9673-388729878597 service nova] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Updated VIF entry in instance network info cache for port 0ada633a-17ff-4082-a498-b4594478a9ef. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG nova.network.neutron [req-f81b6517-26f2-4c37-b055-04880c1ce504 req-7c9c8f6f-62d4-447a-9673-388729878597 service nova] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Updating instance_info_cache with network_info: [{"id": "0ada633a-17ff-4082-a498-b4594478a9ef", "address": "fa:16:3e:0b:2a:15", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ada633a-17", "ovs_interfaceid": "0ada633a-17ff-4082-a498-b4594478a9ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 16:00:58 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-f81b6517-26f2-4c37-b055-04880c1ce504 req-7c9c8f6f-62d4-447a-9673-388729878597 service nova] Releasing lock "refresh_cache-7bbdd293-b776-4840-9127-840f093eca19" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 16:00:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:00:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:00:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:00:59 user nova-compute[75080]: DEBUG nova.compute.manager [req-dd2a6faf-4474-4b8a-b4bf-421ed9f0b91d req-24ee7114-886e-4fb8-b857-2cd4e243ae2f service nova] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Received event network-vif-plugged-0ada633a-17ff-4082-a498-b4594478a9ef {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 16:00:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-dd2a6faf-4474-4b8a-b4bf-421ed9f0b91d req-24ee7114-886e-4fb8-b857-2cd4e243ae2f service nova] Acquiring lock "7bbdd293-b776-4840-9127-840f093eca19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:00:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-dd2a6faf-4474-4b8a-b4bf-421ed9f0b91d req-24ee7114-886e-4fb8-b857-2cd4e243ae2f service nova] Lock "7bbdd293-b776-4840-9127-840f093eca19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:00:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-dd2a6faf-4474-4b8a-b4bf-421ed9f0b91d req-24ee7114-886e-4fb8-b857-2cd4e243ae2f service nova] Lock "7bbdd293-b776-4840-9127-840f093eca19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:00:59 user nova-compute[75080]: DEBUG nova.compute.manager [req-dd2a6faf-4474-4b8a-b4bf-421ed9f0b91d req-24ee7114-886e-4fb8-b857-2cd4e243ae2f service nova] [instance: 7bbdd293-b776-4840-9127-840f093eca19] No waiting events found dispatching network-vif-plugged-0ada633a-17ff-4082-a498-b4594478a9ef {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 16:00:59 user nova-compute[75080]: WARNING nova.compute.manager [req-dd2a6faf-4474-4b8a-b4bf-421ed9f0b91d req-24ee7114-886e-4fb8-b857-2cd4e243ae2f service nova] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Received unexpected event network-vif-plugged-0ada633a-17ff-4082-a498-b4594478a9ef for instance with vm_state building and task_state spawning.
Dec 05 16:00:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:01:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:01:01 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:01:01 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:01:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:01:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:01:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:01:01 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 16:01:01 user nova-compute[75080]: DEBUG nova.compute.manager [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 16:01:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 16:01:01 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Instance spawned successfully.
Dec 05 16:01:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 16:01:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 16:01:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 16:01:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 16:01:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 16:01:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 16:01:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 16:01:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bbdd293-b776-4840-9127-840f093eca19/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:01:01 user nova-compute[75080]: DEBUG nova.compute.manager [req-aed597e4-878d-4a52-9e6d-81d904c73ebe req-dac33cf3-b362-49b0-bc92-781169c0482f service nova] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Received event network-vif-plugged-0ada633a-17ff-4082-a498-b4594478a9ef {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 16:01:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-aed597e4-878d-4a52-9e6d-81d904c73ebe req-dac33cf3-b362-49b0-bc92-781169c0482f service nova] Acquiring lock "7bbdd293-b776-4840-9127-840f093eca19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:01:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-aed597e4-878d-4a52-9e6d-81d904c73ebe req-dac33cf3-b362-49b0-bc92-781169c0482f service nova] Lock "7bbdd293-b776-4840-9127-840f093eca19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:01:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-aed597e4-878d-4a52-9e6d-81d904c73ebe req-dac33cf3-b362-49b0-bc92-781169c0482f service nova] Lock "7bbdd293-b776-4840-9127-840f093eca19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:01:01 user nova-compute[75080]: DEBUG nova.compute.manager [req-aed597e4-878d-4a52-9e6d-81d904c73ebe req-dac33cf3-b362-49b0-bc92-781169c0482f service nova] [instance: 7bbdd293-b776-4840-9127-840f093eca19] No waiting events found dispatching network-vif-plugged-0ada633a-17ff-4082-a498-b4594478a9ef {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 16:01:01 user nova-compute[75080]: WARNING nova.compute.manager [req-aed597e4-878d-4a52-9e6d-81d904c73ebe req-dac33cf3-b362-49b0-bc92-781169c0482f service nova] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Received unexpected event network-vif-plugged-0ada633a-17ff-4082-a498-b4594478a9ef for instance with vm_state building and task_state spawning.
Dec 05 16:01:01 user nova-compute[75080]: INFO nova.compute.manager [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Took 5.37 seconds to spawn the instance on the hypervisor.
Dec 05 16:01:01 user nova-compute[75080]: DEBUG nova.compute.manager [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 16:01:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bbdd293-b776-4840-9127-840f093eca19/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:01:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bbdd293-b776-4840-9127-840f093eca19/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:01:01 user nova-compute[75080]: INFO nova.compute.manager [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Took 5.98 seconds to build instance.
Dec 05 16:01:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-a6c9937d-fba7-4baa-8f31-10f2fac432df tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "7bbdd293-b776-4840-9127-840f093eca19" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.141s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:01:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bbdd293-b776-4840-9127-840f093eca19/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:01:02 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:01:02 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:01:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=9107MB free_disk=24.997459411621094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 16:01:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:01:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:01:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 7bbdd293-b776-4840-9127-840f093eca19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 16:01:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 16:01:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 16:01:02 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 16:01:02 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 16:01:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 16:01:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:01:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:01:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:01:03 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:01:03 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:01:03 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 16:01:06 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:01:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:01:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:01:10 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:01:11 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:01:11 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 16:01:11 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Rebuilding the list of instances to heal {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 16:01:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-7bbdd293-b776-4840-9127-840f093eca19" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 16:01:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-7bbdd293-b776-4840-9127-840f093eca19" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 16:01:11 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 16:01:11 user nova-compute[75080]: DEBUG nova.objects.instance [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lazy-loading 'info_cache' on Instance uuid 7bbdd293-b776-4840-9127-840f093eca19 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:01:11 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Updating instance_info_cache with network_info: [{"id": "0ada633a-17ff-4082-a498-b4594478a9ef", "address": "fa:16:3e:0b:2a:15", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ada633a-17", "ovs_interfaceid": "0ada633a-17ff-4082-a498-b4594478a9ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 16:01:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-7bbdd293-b776-4840-9127-840f093eca19" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 16:01:11 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 16:01:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:01:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:01:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:01:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:01:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:01:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:01:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:01:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:01:18 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:01:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:01:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:01:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:01:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:01:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:01:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:01:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:01:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:01:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:01:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:01:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:01:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:01:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:01:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:01:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:01:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:01:58 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:02:01 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:02:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:02:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:02:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:02:01 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 16:02:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bbdd293-b776-4840-9127-840f093eca19/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:02:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bbdd293-b776-4840-9127-840f093eca19/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:02:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bbdd293-b776-4840-9127-840f093eca19/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:02:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bbdd293-b776-4840-9127-840f093eca19/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:02:02 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:02:02 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:02:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=9032MB free_disk=24.968982696533203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 16:02:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:02:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:02:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 7bbdd293-b776-4840-9127-840f093eca19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 16:02:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 16:02:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 16:02:02 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 16:02:02 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 16:02:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 16:02:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:02:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:02:03 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:02:04 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:02:04 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:02:04 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 16:02:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:02:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:02:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:02:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:02:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:02:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:02:08 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:02:10 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:02:11 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:02:11 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 16:02:11 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Rebuilding the list of instances to heal {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 16:02:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-7bbdd293-b776-4840-9127-840f093eca19" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 16:02:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-7bbdd293-b776-4840-9127-840f093eca19" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 16:02:11 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 16:02:11 user nova-compute[75080]: DEBUG nova.objects.instance [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lazy-loading 'info_cache' on Instance uuid 7bbdd293-b776-4840-9127-840f093eca19 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:02:11 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Updating instance_info_cache with network_info: [{"id": "0ada633a-17ff-4082-a498-b4594478a9ef", "address": "fa:16:3e:0b:2a:15", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ada633a-17", "ovs_interfaceid": "0ada633a-17ff-4082-a498-b4594478a9ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 16:02:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-7bbdd293-b776-4840-9127-840f093eca19" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 16:02:11 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 16:02:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:02:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:02:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:02:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:02:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:02:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:02:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:02:20 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:02:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:02:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:02:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:02:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:02:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:02:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:02:23 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:02:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:02:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:02:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:02:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:02:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:02:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:02:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:02:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:02:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:02:46 user nova-compute[75080]: DEBUG nova.compute.manager [req-ea3575ea-d8b2-46dc-8afc-2f321da917cf req-40b4c85a-ff57-48e9-a50a-36004703105a service nova] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Received event network-changed-0ada633a-17ff-4082-a498-b4594478a9ef {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 16:02:46 user nova-compute[75080]: DEBUG nova.compute.manager [req-ea3575ea-d8b2-46dc-8afc-2f321da917cf req-40b4c85a-ff57-48e9-a50a-36004703105a service nova] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Refreshing instance network info cache due to event network-changed-0ada633a-17ff-4082-a498-b4594478a9ef. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 16:02:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-ea3575ea-d8b2-46dc-8afc-2f321da917cf req-40b4c85a-ff57-48e9-a50a-36004703105a service nova] Acquiring lock "refresh_cache-7bbdd293-b776-4840-9127-840f093eca19" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 16:02:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-ea3575ea-d8b2-46dc-8afc-2f321da917cf req-40b4c85a-ff57-48e9-a50a-36004703105a service nova] Acquired lock "refresh_cache-7bbdd293-b776-4840-9127-840f093eca19" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 16:02:46 user nova-compute[75080]: DEBUG nova.network.neutron [req-ea3575ea-d8b2-46dc-8afc-2f321da917cf req-40b4c85a-ff57-48e9-a50a-36004703105a service nova] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Refreshing network info cache for port 0ada633a-17ff-4082-a498-b4594478a9ef {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 16:02:47 user nova-compute[75080]: DEBUG nova.network.neutron [req-ea3575ea-d8b2-46dc-8afc-2f321da917cf req-40b4c85a-ff57-48e9-a50a-36004703105a service nova] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Updated VIF entry in instance network info cache for port 0ada633a-17ff-4082-a498-b4594478a9ef. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 16:02:47 user nova-compute[75080]: DEBUG nova.network.neutron [req-ea3575ea-d8b2-46dc-8afc-2f321da917cf req-40b4c85a-ff57-48e9-a50a-36004703105a service nova] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Updating instance_info_cache with network_info: [{"id": "0ada633a-17ff-4082-a498-b4594478a9ef", "address": "fa:16:3e:0b:2a:15", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ada633a-17", "ovs_interfaceid": "0ada633a-17ff-4082-a498-b4594478a9ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 16:02:47 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-ea3575ea-d8b2-46dc-8afc-2f321da917cf req-40b4c85a-ff57-48e9-a50a-36004703105a service nova] Releasing lock "refresh_cache-7bbdd293-b776-4840-9127-840f093eca19" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 16:02:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:02:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:02:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "7bbdd293-b776-4840-9127-840f093eca19" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:02:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "7bbdd293-b776-4840-9127-840f093eca19" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:02:49 user nova-compute[75080]: DEBUG nova.objects.instance [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lazy-loading 'flavor' on Instance uuid 7bbdd293-b776-4840-9127-840f093eca19 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:02:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "7bbdd293-b776-4840-9127-840f093eca19" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:02:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "7bbdd293-b776-4840-9127-840f093eca19" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:02:49 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "7bbdd293-b776-4840-9127-840f093eca19" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:02:49 user nova-compute[75080]: INFO nova.compute.manager [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Attaching volume 850d7004-01e7-48d2-b568-610413d9186c to /dev/vdb
Dec 05 16:02:49 user nova-compute[75080]: DEBUG os_brick.utils [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 16:02:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:02:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:02:49 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b2fe7a-f432-40c4-8907-48eec4360e38]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:02:49 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:02:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:02:50 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1990f1f7-1b0a-450e-8d0a-2e7b6cb285d9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:02:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:02:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:02:50 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d8ade8-ce26-4c0e-bbff-bdad336247ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:02:50 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc64123-3c4a-4c5e-bacb-f81f80a0b453]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:02:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:02:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 16:02:50 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 16:02:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:02:50 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 16:02:50 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 16:02:50 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8a5c67-ef9a-4ea1-8324-dd18a01236e3]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:02:50 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 16:02:50 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 16:02:50 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 16:02:50 user nova-compute[75080]: DEBUG os_brick.utils [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 16:02:50 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Updating existing volume attachment record: ef15a9b9-c6d8-441c-ae07-cec32e1c5714 {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 16:02:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:02:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:02:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:02:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:02:58 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:03:01 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:03:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:03:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:03:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:03:01 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 16:03:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bbdd293-b776-4840-9127-840f093eca19/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:03:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bbdd293-b776-4840-9127-840f093eca19/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:03:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bbdd293-b776-4840-9127-840f093eca19/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:03:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bbdd293-b776-4840-9127-840f093eca19/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'niFbcRhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 16:03:02 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 16:03:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 16:03:02 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 16:03:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 16:03:02 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 16:03:02 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:03:02 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:03:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=9050MB free_disk=24.968135833740234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbee189-05da-4c50-a037-25ba262e91e2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 16:03:02 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[86389583-b66d-4081-94e1-bcebbae8ada8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c] added
Dec 05 16:03:02 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24ab75b-b0d2-4614-9609-7bb1b9ecdd89]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 7bbdd293-b776-4840-9127-840f093eca19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[71128555-d249-40e4-b92e-f3dc2ecc1831]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v niFbcRhI {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v niFbcRhI" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7969cad0-4903-4d7a-8e08-851102b09c3c]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'niFbcRhI'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e789956-6243-4bf2-833d-ba5fbe80f31b]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bd5d94-64c1-4d9f-b6c8-a8d341cf6e6a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 05 16:03:02 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 05 16:03:02 user nova-compute[75080]:  {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 16:03:02 user nova-compute[75080]: WARNING os_brick.initiator.connectors.iscsi [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 05 16:03:02 user nova-compute[75080]: 
Dec 05 16:03:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5963b647-6fb8-437e-b328-f2b1952f7054]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c, portal: 172.16.0.220,3260]
Dec 05 16:03:02 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c, portal: 172.16.0.220,3260] successful.
Dec 05 16:03:02 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[569dc47a-8659-46f5-8265-f8e12ee04cde]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37ce41d-a50a-4b92-9c84-47393dcf51b3]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c (non-flash)
Dec 05 16:03:02 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c (non-flash)
Dec 05 16:03:02 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8476639-f4c8-49ad-a23c-a90299b4fd57]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 16:03:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'niFbcRhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 16:03:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:03:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:03:03 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 16:03:03 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23562313836373230', 'path': '/dev/sdb'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 16:03:03 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562313836373230', 'path': '/dev/sdb'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 16:03:03 user nova-compute[75080]: DEBUG nova.objects.instance [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lazy-loading 'flavor' on Instance uuid 7bbdd293-b776-4840-9127-840f093eca19 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:03:03 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 16:03:03 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 16:03:03 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 16:03:03 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 16:03:03 user nova-compute[75080]:   <serial>850d7004-01e7-48d2-b568-610413d9186c</serial>
Dec 05 16:03:03 user nova-compute[75080]: </disk>
Dec 05 16:03:03 user nova-compute[75080]:  {{(pid=75080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 16:03:04 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 16:03:04 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 16:03:04 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] No VIF found with MAC fa:16:3e:0b:2a:15, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 16:03:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-b74fd223-566f-4b70-88bc-4abc971d9585 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "7bbdd293-b776-4840-9127-840f093eca19" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.573s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:03:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:03:05 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:03:05 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:03:05 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:03:05 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 16:03:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "e83818b7-547d-42e8-8eec-5684b15b924b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:03:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "e83818b7-547d-42e8-8eec-5684b15b924b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:03:07 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 16:03:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:03:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:03:07 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 16:03:07 user nova-compute[75080]: INFO nova.compute.claims [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Claim successful on node user
Dec 05 16:03:07 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 16:03:07 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 16:03:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.225s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:03:07 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 16:03:07 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 16:03:07 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 16:03:07 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 16:03:07 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 16:03:07 user nova-compute[75080]: DEBUG nova.policy [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bf39da2be27240a8b3e89e4484b9a99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c62808660324e5aa23e8618f7d32ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 16:03:07 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 16:03:07 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 16:03:07 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Creating image(s)
Dec 05 16:03:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "/opt/stack/data/nova/instances/e83818b7-547d-42e8-8eec-5684b15b924b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:03:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "/opt/stack/data/nova/instances/e83818b7-547d-42e8-8eec-5684b15b924b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:03:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "/opt/stack/data/nova/instances/e83818b7-547d-42e8-8eec-5684b15b924b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:03:07 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:03:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.179s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:03:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:03:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:03:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:03:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:03:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.183s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:03:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/e83818b7-547d-42e8-8eec-5684b15b924b/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:03:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/e83818b7-547d-42e8-8eec-5684b15b924b/disk 1073741824" returned: 0 in 0.052s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:03:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:03:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:03:08 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Successfully created port: db136a33-916a-45d3-a453-b3781f5e53bd {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 16:03:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.213s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:03:08 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e83818b7-547d-42e8-8eec-5684b15b924b/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 16:03:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e83818b7-547d-42e8-8eec-5684b15b924b/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:03:08 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e83818b7-547d-42e8-8eec-5684b15b924b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:03:08 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Cannot resize image /opt/stack/data/nova/instances/e83818b7-547d-42e8-8eec-5684b15b924b/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 16:03:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 16:03:08 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Ensure instance console log exists: /opt/stack/data/nova/instances/e83818b7-547d-42e8-8eec-5684b15b924b/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 16:03:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:03:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:03:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Successfully updated port: db136a33-916a-45d3-a453-b3781f5e53bd {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "refresh_cache-e83818b7-547d-42e8-8eec-5684b15b924b" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquired lock "refresh_cache-e83818b7-547d-42e8-8eec-5684b15b924b" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG nova.compute.manager [req-1d529566-2e26-43a0-bc57-094846bb25d7 req-4492284c-45d0-4beb-9a41-39cc5503ffb8 service nova] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Received event network-changed-db136a33-916a-45d3-a453-b3781f5e53bd {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG nova.compute.manager [req-1d529566-2e26-43a0-bc57-094846bb25d7 req-4492284c-45d0-4beb-9a41-39cc5503ffb8 service nova] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Refreshing instance network info cache due to event network-changed-db136a33-916a-45d3-a453-b3781f5e53bd. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-1d529566-2e26-43a0-bc57-094846bb25d7 req-4492284c-45d0-4beb-9a41-39cc5503ffb8 service nova] Acquiring lock "refresh_cache-e83818b7-547d-42e8-8eec-5684b15b924b" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Updating instance_info_cache with network_info: [{"id": "db136a33-916a-45d3-a453-b3781f5e53bd", "address": "fa:16:3e:3d:25:2b", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb136a33-91", "ovs_interfaceid": "db136a33-916a-45d3-a453-b3781f5e53bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Releasing lock "refresh_cache-e83818b7-547d-42e8-8eec-5684b15b924b" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Instance network_info: |[{"id": "db136a33-916a-45d3-a453-b3781f5e53bd", "address": "fa:16:3e:3d:25:2b", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb136a33-91", "ovs_interfaceid": "db136a33-916a-45d3-a453-b3781f5e53bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-1d529566-2e26-43a0-bc57-094846bb25d7 req-4492284c-45d0-4beb-9a41-39cc5503ffb8 service nova] Acquired lock "refresh_cache-e83818b7-547d-42e8-8eec-5684b15b924b" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG nova.network.neutron [req-1d529566-2e26-43a0-bc57-094846bb25d7 req-4492284c-45d0-4beb-9a41-39cc5503ffb8 service nova] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Refreshing network info cache for port db136a33-916a-45d3-a453-b3781f5e53bd {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Start _get_guest_xml network_info=[{"id": "db136a33-916a-45d3-a453-b3781f5e53bd", "address": "fa:16:3e:3d:25:2b", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb136a33-91", "ovs_interfaceid": "db136a33-916a-45d3-a453-b3781f5e53bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 16:03:09 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:03:09 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:03:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T16:03:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-835465073',display_name='tempest-AttachVolumeNegativeTest-server-835465073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-835465073',id=50,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKzcOD6YE0CGHX09yT1ptWmZPQEMKB0d7cpju3oXJTLRMkaLospNbPpAD3hJx4mN6Vg+JP6o/Le9J/ZMD7ZxMck+uxc/IC5IhARKQ5cI+8tsLHVLmM04RpVUUGugqUwmA==',key_name='tempest-keypair-64603320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c62808660324e5aa23e8618f7d32ae4',ramdisk_id='',reservation_id='r-wfierfcv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-329346343',owner_user_name='tempest-AttachVolumeNegativeTest-329346343-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T16:03:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf39da2be27240a8b3e89e4484b9a99b',uuid=e83818b7-547d-42e8-8eec-5684b15b924b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db136a33-916a-45d3-a453-b3781f5e53bd", "address": "fa:16:3e:3d:25:2b", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb136a33-91", "ovs_interfaceid": "db136a33-916a-45d3-a453-b3781f5e53bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Converting VIF {"id": "db136a33-916a-45d3-a453-b3781f5e53bd", "address": "fa:16:3e:3d:25:2b", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb136a33-91", "ovs_interfaceid": "db136a33-916a-45d3-a453-b3781f5e53bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:25:2b,bridge_name='br-int',has_traffic_filtering=True,id=db136a33-916a-45d3-a453-b3781f5e53bd,network=Network(72069664-17d2-4963-9f71-559dd80df9ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb136a33-91') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG nova.objects.instance [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lazy-loading 'pci_devices' on Instance uuid e83818b7-547d-42e8-8eec-5684b15b924b {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] End _get_guest_xml xml=<domain type="kvm">
Dec 05 16:03:09 user nova-compute[75080]:   <uuid>e83818b7-547d-42e8-8eec-5684b15b924b</uuid>
Dec 05 16:03:09 user nova-compute[75080]:   <name>instance-00000032</name>
Dec 05 16:03:09 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 16:03:09 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 16:03:09 user nova-compute[75080]:   <metadata>
Dec 05 16:03:09 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 16:03:09 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 16:03:09 user nova-compute[75080]:       <nova:name>tempest-AttachVolumeNegativeTest-server-835465073</nova:name>
Dec 05 16:03:09 user nova-compute[75080]:       <nova:creationTime>2023-12-05 16:03:09</nova:creationTime>
Dec 05 16:03:09 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 16:03:09 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 16:03:09 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 16:03:09 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 16:03:09 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 16:03:09 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 16:03:09 user nova-compute[75080]:       </nova:flavor>
Dec 05 16:03:09 user nova-compute[75080]:       <nova:owner>
Dec 05 16:03:09 user nova-compute[75080]:         <nova:user uuid="bf39da2be27240a8b3e89e4484b9a99b">tempest-AttachVolumeNegativeTest-329346343-project-member</nova:user>
Dec 05 16:03:09 user nova-compute[75080]:         <nova:project uuid="1c62808660324e5aa23e8618f7d32ae4">tempest-AttachVolumeNegativeTest-329346343</nova:project>
Dec 05 16:03:09 user nova-compute[75080]:       </nova:owner>
Dec 05 16:03:09 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 16:03:09 user nova-compute[75080]:       <nova:ports>
Dec 05 16:03:09 user nova-compute[75080]:         <nova:port uuid="db136a33-916a-45d3-a453-b3781f5e53bd">
Dec 05 16:03:09 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 05 16:03:09 user nova-compute[75080]:         </nova:port>
Dec 05 16:03:09 user nova-compute[75080]:       </nova:ports>
Dec 05 16:03:09 user nova-compute[75080]:     </nova:instance>
Dec 05 16:03:09 user nova-compute[75080]:   </metadata>
Dec 05 16:03:09 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 16:03:09 user nova-compute[75080]:     <system>
Dec 05 16:03:09 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 16:03:09 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 16:03:09 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 16:03:09 user nova-compute[75080]:       <entry name="serial">e83818b7-547d-42e8-8eec-5684b15b924b</entry>
Dec 05 16:03:09 user nova-compute[75080]:       <entry name="uuid">e83818b7-547d-42e8-8eec-5684b15b924b</entry>
Dec 05 16:03:09 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 16:03:09 user nova-compute[75080]:     </system>
Dec 05 16:03:09 user nova-compute[75080]:   </sysinfo>
Dec 05 16:03:09 user nova-compute[75080]:   <os>
Dec 05 16:03:09 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 16:03:09 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 16:03:09 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 16:03:09 user nova-compute[75080]:   </os>
Dec 05 16:03:09 user nova-compute[75080]:   <features>
Dec 05 16:03:09 user nova-compute[75080]:     <acpi/>
Dec 05 16:03:09 user nova-compute[75080]:     <apic/>
Dec 05 16:03:09 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 16:03:09 user nova-compute[75080]:   </features>
Dec 05 16:03:09 user nova-compute[75080]:   <clock offset="utc">
Dec 05 16:03:09 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 16:03:09 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 16:03:09 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 16:03:09 user nova-compute[75080]:   </clock>
Dec 05 16:03:09 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 16:03:09 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 16:03:09 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 16:03:09 user nova-compute[75080]:   </cpu>
Dec 05 16:03:09 user nova-compute[75080]:   <devices>
Dec 05 16:03:09 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 16:03:09 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 16:03:09 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/e83818b7-547d-42e8-8eec-5684b15b924b/disk"/>
Dec 05 16:03:09 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 16:03:09 user nova-compute[75080]:     </disk>
Dec 05 16:03:09 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 16:03:09 user nova-compute[75080]:       <mac address="fa:16:3e:3d:25:2b"/>
Dec 05 16:03:09 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 16:03:09 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 16:03:09 user nova-compute[75080]:       <target dev="tapdb136a33-91"/>
Dec 05 16:03:09 user nova-compute[75080]:     </interface>
Dec 05 16:03:09 user nova-compute[75080]:     <serial type="pty">
Dec 05 16:03:09 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/e83818b7-547d-42e8-8eec-5684b15b924b/console.log" append="off"/>
Dec 05 16:03:09 user nova-compute[75080]:     </serial>
Dec 05 16:03:09 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 16:03:09 user nova-compute[75080]:     <video>
Dec 05 16:03:09 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 16:03:09 user nova-compute[75080]:     </video>
Dec 05 16:03:09 user nova-compute[75080]:     <rng model="virtio">
Dec 05 16:03:09 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 16:03:09 user nova-compute[75080]:     </rng>
Dec 05 16:03:09 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 16:03:09 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 16:03:09 user nova-compute[75080]:       <stats period="10"/>
Dec 05 16:03:09 user nova-compute[75080]:     </memballoon>
Dec 05 16:03:09 user nova-compute[75080]:   </devices>
Dec 05 16:03:09 user nova-compute[75080]: </domain>
Dec 05 16:03:09 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T16:03:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-835465073',display_name='tempest-AttachVolumeNegativeTest-server-835465073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-835465073',id=50,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKzcOD6YE0CGHX09yT1ptWmZPQEMKB0d7cpju3oXJTLRMkaLospNbPpAD3hJx4mN6Vg+JP6o/Le9J/ZMD7ZxMck+uxc/IC5IhARKQ5cI+8tsLHVLmM04RpVUUGugqUwmA==',key_name='tempest-keypair-64603320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c62808660324e5aa23e8618f7d32ae4',ramdisk_id='',reservation_id='r-wfierfcv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-329346343',owner_user_name='tempest-AttachVolumeNegativeTest-329346343-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T16:03:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf39da2be27240a8b3e89e4484b9a99b',uuid=e83818b7-547d-42e8-8eec-5684b15b924b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db136a33-916a-45d3-a453-b3781f5e53bd", "address": "fa:16:3e:3d:25:2b", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb136a33-91", "ovs_interfaceid": "db136a33-916a-45d3-a453-b3781f5e53bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Converting VIF {"id": "db136a33-916a-45d3-a453-b3781f5e53bd", "address": "fa:16:3e:3d:25:2b", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb136a33-91", "ovs_interfaceid": "db136a33-916a-45d3-a453-b3781f5e53bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:25:2b,bridge_name='br-int',has_traffic_filtering=True,id=db136a33-916a-45d3-a453-b3781f5e53bd,network=Network(72069664-17d2-4963-9f71-559dd80df9ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb136a33-91') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG os_vif [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:25:2b,bridge_name='br-int',has_traffic_filtering=True,id=db136a33-916a-45d3-a453-b3781f5e53bd,network=Network(72069664-17d2-4963-9f71-559dd80df9ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb136a33-91') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5c8fb12f-4e9e-563d-8435-9f25db6ef1c2', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb136a33-91, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdb136a33-91, col_values=(('qos', UUID('f77901c8-e0da-485d-8c6a-af162cf20d96')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdb136a33-91, col_values=(('external_ids', {'iface-id': 'db136a33-916a-45d3-a453-b3781f5e53bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:25:2b', 'vm-uuid': 'e83818b7-547d-42e8-8eec-5684b15b924b'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:03:09 user nova-compute[75080]: INFO os_vif [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:25:2b,bridge_name='br-int',has_traffic_filtering=True,id=db136a33-916a-45d3-a453-b3781f5e53bd,network=Network(72069664-17d2-4963-9f71-559dd80df9ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb136a33-91')
Dec 05 16:03:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] No VIF found with MAC fa:16:3e:3d:25:2b, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG nova.network.neutron [req-1d529566-2e26-43a0-bc57-094846bb25d7 req-4492284c-45d0-4beb-9a41-39cc5503ffb8 service nova] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Updated VIF entry in instance network info cache for port db136a33-916a-45d3-a453-b3781f5e53bd. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG nova.network.neutron [req-1d529566-2e26-43a0-bc57-094846bb25d7 req-4492284c-45d0-4beb-9a41-39cc5503ffb8 service nova] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Updating instance_info_cache with network_info: [{"id": "db136a33-916a-45d3-a453-b3781f5e53bd", "address": "fa:16:3e:3d:25:2b", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb136a33-91", "ovs_interfaceid": "db136a33-916a-45d3-a453-b3781f5e53bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 16:03:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-1d529566-2e26-43a0-bc57-094846bb25d7 req-4492284c-45d0-4beb-9a41-39cc5503ffb8 service nova] Releasing lock "refresh_cache-e83818b7-547d-42e8-8eec-5684b15b924b" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 16:03:10 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:03:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:03:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:03:10 user nova-compute[75080]: DEBUG nova.compute.manager [req-dd8ca9ec-bb9a-419d-b4d3-373e5a02bc64 req-89e0c6a1-7a21-4546-875c-fa9933cb4c49 service nova] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Received event network-vif-plugged-db136a33-916a-45d3-a453-b3781f5e53bd {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 16:03:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-dd8ca9ec-bb9a-419d-b4d3-373e5a02bc64 req-89e0c6a1-7a21-4546-875c-fa9933cb4c49 service nova] Acquiring lock "e83818b7-547d-42e8-8eec-5684b15b924b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:03:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-dd8ca9ec-bb9a-419d-b4d3-373e5a02bc64 req-89e0c6a1-7a21-4546-875c-fa9933cb4c49 service nova] Lock "e83818b7-547d-42e8-8eec-5684b15b924b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:03:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-dd8ca9ec-bb9a-419d-b4d3-373e5a02bc64 req-89e0c6a1-7a21-4546-875c-fa9933cb4c49 service nova] Lock "e83818b7-547d-42e8-8eec-5684b15b924b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:03:10 user nova-compute[75080]: DEBUG nova.compute.manager [req-dd8ca9ec-bb9a-419d-b4d3-373e5a02bc64 req-89e0c6a1-7a21-4546-875c-fa9933cb4c49 service nova] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] No waiting events found dispatching network-vif-plugged-db136a33-916a-45d3-a453-b3781f5e53bd {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 16:03:10 user nova-compute[75080]: WARNING nova.compute.manager [req-dd8ca9ec-bb9a-419d-b4d3-373e5a02bc64 req-89e0c6a1-7a21-4546-875c-fa9933cb4c49 service nova] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Received unexpected event network-vif-plugged-db136a33-916a-45d3-a453-b3781f5e53bd for instance with vm_state building and task_state spawning.
Dec 05 16:03:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:03:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:03:11 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:03:12 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 16:03:12 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 16:03:12 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Instance spawned successfully.
Dec 05 16:03:12 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 16:03:12 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 16:03:12 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 16:03:12 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 16:03:12 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 16:03:12 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 16:03:12 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 16:03:12 user nova-compute[75080]: INFO nova.compute.manager [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Took 5.02 seconds to spawn the instance on the hypervisor.
Dec 05 16:03:12 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 16:03:12 user nova-compute[75080]: DEBUG nova.compute.manager [req-7bfc963d-9e31-4311-a2a7-1613b6f851f8 req-9d21fcc0-73b7-4eeb-8073-6e7d25a67768 service nova] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Received event network-vif-plugged-db136a33-916a-45d3-a453-b3781f5e53bd {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 16:03:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7bfc963d-9e31-4311-a2a7-1613b6f851f8 req-9d21fcc0-73b7-4eeb-8073-6e7d25a67768 service nova] Acquiring lock "e83818b7-547d-42e8-8eec-5684b15b924b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:03:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7bfc963d-9e31-4311-a2a7-1613b6f851f8 req-9d21fcc0-73b7-4eeb-8073-6e7d25a67768 service nova] Lock "e83818b7-547d-42e8-8eec-5684b15b924b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:03:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7bfc963d-9e31-4311-a2a7-1613b6f851f8 req-9d21fcc0-73b7-4eeb-8073-6e7d25a67768 service nova] Lock "e83818b7-547d-42e8-8eec-5684b15b924b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:03:12 user nova-compute[75080]: DEBUG nova.compute.manager [req-7bfc963d-9e31-4311-a2a7-1613b6f851f8 req-9d21fcc0-73b7-4eeb-8073-6e7d25a67768 service nova] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] No waiting events found dispatching network-vif-plugged-db136a33-916a-45d3-a453-b3781f5e53bd {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 16:03:12 user nova-compute[75080]: WARNING nova.compute.manager [req-7bfc963d-9e31-4311-a2a7-1613b6f851f8 req-9d21fcc0-73b7-4eeb-8073-6e7d25a67768 service nova] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Received unexpected event network-vif-plugged-db136a33-916a-45d3-a453-b3781f5e53bd for instance with vm_state building and task_state spawning.
Dec 05 16:03:13 user nova-compute[75080]: INFO nova.compute.manager [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Took 5.57 seconds to build instance.
Dec 05 16:03:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7e482c33-e425-4297-babd-00183b2031d7 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "e83818b7-547d-42e8-8eec-5684b15b924b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.702s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:03:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:03:13 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:03:13 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 16:03:13 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Rebuilding the list of instances to heal {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 16:03:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-7bbdd293-b776-4840-9127-840f093eca19" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 16:03:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-7bbdd293-b776-4840-9127-840f093eca19" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 16:03:13 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 16:03:13 user nova-compute[75080]: DEBUG nova.objects.instance [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lazy-loading 'info_cache' on Instance uuid 7bbdd293-b776-4840-9127-840f093eca19 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:03:13 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Updating instance_info_cache with network_info: [{"id": "0ada633a-17ff-4082-a498-b4594478a9ef", "address": "fa:16:3e:0b:2a:15", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ada633a-17", "ovs_interfaceid": "0ada633a-17ff-4082-a498-b4594478a9ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 16:03:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-7bbdd293-b776-4840-9127-840f093eca19" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 16:03:13 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 16:03:14 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:03:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:03:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:03:20 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:03:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:03:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:03:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:03:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:03:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:03:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:03:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:03:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:03:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:03:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:03:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:03:58 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:03:58 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Cleaning up deleted instances {{(pid=75080) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 05 16:03:58 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] There are 0 instances to clean {{(pid=75080) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 05 16:03:59 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:03:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:03:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:03:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:03:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:03:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:03:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:04:01 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:04:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:04:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:04:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:04:01 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 16:04:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e83818b7-547d-42e8-8eec-5684b15b924b/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:04:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e83818b7-547d-42e8-8eec-5684b15b924b/disk --force-share --output=json" returned: 0 in 0.306s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:04:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e83818b7-547d-42e8-8eec-5684b15b924b/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:04:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e83818b7-547d-42e8-8eec-5684b15b924b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:04:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bbdd293-b776-4840-9127-840f093eca19/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:04:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bbdd293-b776-4840-9127-840f093eca19/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:04:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bbdd293-b776-4840-9127-840f093eca19/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:04:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bbdd293-b776-4840-9127-840f093eca19/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:04:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 16:04:02 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:04:02 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:04:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=8951MB free_disk=24.930587768554688GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 16:04:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:04:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:04:03 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 7bbdd293-b776-4840-9127-840f093eca19 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 16:04:03 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance e83818b7-547d-42e8-8eec-5684b15b924b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 16:04:03 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 16:04:03 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 16:04:03 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing inventories for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 05 16:04:03 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Updating ProviderTree inventory for provider 21b770fa-b774-46c9-9415-db26064ccd0f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 05 16:04:03 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Updating inventory in ProviderTree for provider 21b770fa-b774-46c9-9415-db26064ccd0f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 16:04:03 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing aggregate associations for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f, aggregates: None {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 05 16:04:03 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing trait associations for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f, traits: COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 05 16:04:03 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 16:04:03 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 16:04:03 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 16:04:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.434s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:04:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:04:06 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:04:06 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:04:06 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:04:06 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 16:04:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:04:10 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:04:12 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:04:14 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:04:14 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 16:04:14 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:04:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-e83818b7-547d-42e8-8eec-5684b15b924b" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 16:04:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-e83818b7-547d-42e8-8eec-5684b15b924b" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 16:04:14 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 16:04:14 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Updating instance_info_cache with network_info: [{"id": "db136a33-916a-45d3-a453-b3781f5e53bd", "address": "fa:16:3e:3d:25:2b", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb136a33-91", "ovs_interfaceid": "db136a33-916a-45d3-a453-b3781f5e53bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 16:04:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-e83818b7-547d-42e8-8eec-5684b15b924b" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 16:04:14 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 16:04:16 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:04:16 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75080) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 05 16:04:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:04:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:04:24 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:04:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:04:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:04:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:04:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:04:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:04:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:04:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:04:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:04:37 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:04:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:04:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:04:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:04:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:04:59 user nova-compute[75080]: DEBUG nova.compute.manager [req-a8887a24-b56b-44a2-a7bf-7c6c15ee4b1b req-469b145a-b2a7-4c7c-9af0-62e5783133b9 service nova] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Received event network-changed-db136a33-916a-45d3-a453-b3781f5e53bd {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 16:04:59 user nova-compute[75080]: DEBUG nova.compute.manager [req-a8887a24-b56b-44a2-a7bf-7c6c15ee4b1b req-469b145a-b2a7-4c7c-9af0-62e5783133b9 service nova] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Refreshing instance network info cache due to event network-changed-db136a33-916a-45d3-a453-b3781f5e53bd. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 16:04:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a8887a24-b56b-44a2-a7bf-7c6c15ee4b1b req-469b145a-b2a7-4c7c-9af0-62e5783133b9 service nova] Acquiring lock "refresh_cache-e83818b7-547d-42e8-8eec-5684b15b924b" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 16:04:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a8887a24-b56b-44a2-a7bf-7c6c15ee4b1b req-469b145a-b2a7-4c7c-9af0-62e5783133b9 service nova] Acquired lock "refresh_cache-e83818b7-547d-42e8-8eec-5684b15b924b" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 16:04:59 user nova-compute[75080]: DEBUG nova.network.neutron [req-a8887a24-b56b-44a2-a7bf-7c6c15ee4b1b req-469b145a-b2a7-4c7c-9af0-62e5783133b9 service nova] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Refreshing network info cache for port db136a33-916a-45d3-a453-b3781f5e53bd {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 16:04:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7cad51b9-3c41-41d2-9918-a7da03c16dc0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "e83818b7-547d-42e8-8eec-5684b15b924b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:04:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7cad51b9-3c41-41d2-9918-a7da03c16dc0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "e83818b7-547d-42e8-8eec-5684b15b924b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:04:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7cad51b9-3c41-41d2-9918-a7da03c16dc0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "e83818b7-547d-42e8-8eec-5684b15b924b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:04:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7cad51b9-3c41-41d2-9918-a7da03c16dc0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "e83818b7-547d-42e8-8eec-5684b15b924b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:04:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7cad51b9-3c41-41d2-9918-a7da03c16dc0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "e83818b7-547d-42e8-8eec-5684b15b924b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:04:59 user nova-compute[75080]: INFO nova.compute.manager [None req-7cad51b9-3c41-41d2-9918-a7da03c16dc0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Terminating instance
Dec 05 16:04:59 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7cad51b9-3c41-41d2-9918-a7da03c16dc0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 16:04:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:04:59 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:04:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:04:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:04:59 user nova-compute[75080]: DEBUG nova.compute.manager [req-05af27a5-e881-4c21-8acf-b530fa27e4c7 req-7528f9c5-f110-4ea2-bbcc-bc92542fe597 service nova] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Received event network-vif-unplugged-db136a33-916a-45d3-a453-b3781f5e53bd {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 16:04:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-05af27a5-e881-4c21-8acf-b530fa27e4c7 req-7528f9c5-f110-4ea2-bbcc-bc92542fe597 service nova] Acquiring lock "e83818b7-547d-42e8-8eec-5684b15b924b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:04:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-05af27a5-e881-4c21-8acf-b530fa27e4c7 req-7528f9c5-f110-4ea2-bbcc-bc92542fe597 service nova] Lock "e83818b7-547d-42e8-8eec-5684b15b924b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:04:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-05af27a5-e881-4c21-8acf-b530fa27e4c7 req-7528f9c5-f110-4ea2-bbcc-bc92542fe597 service nova] Lock "e83818b7-547d-42e8-8eec-5684b15b924b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:04:59 user nova-compute[75080]: DEBUG nova.compute.manager [req-05af27a5-e881-4c21-8acf-b530fa27e4c7 req-7528f9c5-f110-4ea2-bbcc-bc92542fe597 service nova] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] No waiting events found dispatching network-vif-unplugged-db136a33-916a-45d3-a453-b3781f5e53bd {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 16:04:59 user nova-compute[75080]: DEBUG nova.compute.manager [req-05af27a5-e881-4c21-8acf-b530fa27e4c7 req-7528f9c5-f110-4ea2-bbcc-bc92542fe597 service nova] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Received event network-vif-unplugged-db136a33-916a-45d3-a453-b3781f5e53bd for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 16:04:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:04:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:04:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:04:59 user nova-compute[75080]: DEBUG nova.network.neutron [req-a8887a24-b56b-44a2-a7bf-7c6c15ee4b1b req-469b145a-b2a7-4c7c-9af0-62e5783133b9 service nova] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Updated VIF entry in instance network info cache for port db136a33-916a-45d3-a453-b3781f5e53bd. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 16:04:59 user nova-compute[75080]: DEBUG nova.network.neutron [req-a8887a24-b56b-44a2-a7bf-7c6c15ee4b1b req-469b145a-b2a7-4c7c-9af0-62e5783133b9 service nova] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Updating instance_info_cache with network_info: [{"id": "db136a33-916a-45d3-a453-b3781f5e53bd", "address": "fa:16:3e:3d:25:2b", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb136a33-91", "ovs_interfaceid": "db136a33-916a-45d3-a453-b3781f5e53bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 16:04:59 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a8887a24-b56b-44a2-a7bf-7c6c15ee4b1b req-469b145a-b2a7-4c7c-9af0-62e5783133b9 service nova] Releasing lock "refresh_cache-e83818b7-547d-42e8-8eec-5684b15b924b" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 16:04:59 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Instance destroyed successfully.
Dec 05 16:04:59 user nova-compute[75080]: DEBUG nova.objects.instance [None req-7cad51b9-3c41-41d2-9918-a7da03c16dc0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lazy-loading 'resources' on Instance uuid e83818b7-547d-42e8-8eec-5684b15b924b {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:04:59 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-7cad51b9-3c41-41d2-9918-a7da03c16dc0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T16:03:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-835465073',display_name='tempest-AttachVolumeNegativeTest-server-835465073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-835465073',id=50,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKzcOD6YE0CGHX09yT1ptWmZPQEMKB0d7cpju3oXJTLRMkaLospNbPpAD3hJx4mN6Vg+JP6o/Le9J/ZMD7ZxMck+uxc/IC5IhARKQ5cI+8tsLHVLmM04RpVUUGugqUwmA==',key_name='tempest-keypair-64603320',keypairs=<?>,launch_index=0,launched_at=2023-12-05T16:03:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c62808660324e5aa23e8618f7d32ae4',ramdisk_id='',reservation_id='r-wfierfcv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-329346343',owner_user_name='tempest-AttachVolumeNegativeTest-329346343-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T16:03:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf39da2be27240a8b3e89e4484b9a99b',uuid=e83818b7-547d-42e8-8eec-5684b15b924b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db136a33-916a-45d3-a453-b3781f5e53bd", "address": "fa:16:3e:3d:25:2b", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb136a33-91", "ovs_interfaceid": "db136a33-916a-45d3-a453-b3781f5e53bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 16:04:59 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-7cad51b9-3c41-41d2-9918-a7da03c16dc0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Converting VIF {"id": "db136a33-916a-45d3-a453-b3781f5e53bd", "address": "fa:16:3e:3d:25:2b", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb136a33-91", "ovs_interfaceid": "db136a33-916a-45d3-a453-b3781f5e53bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 16:04:59 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-7cad51b9-3c41-41d2-9918-a7da03c16dc0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:25:2b,bridge_name='br-int',has_traffic_filtering=True,id=db136a33-916a-45d3-a453-b3781f5e53bd,network=Network(72069664-17d2-4963-9f71-559dd80df9ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb136a33-91') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 16:04:59 user nova-compute[75080]: DEBUG os_vif [None req-7cad51b9-3c41-41d2-9918-a7da03c16dc0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:25:2b,bridge_name='br-int',has_traffic_filtering=True,id=db136a33-916a-45d3-a453-b3781f5e53bd,network=Network(72069664-17d2-4963-9f71-559dd80df9ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb136a33-91') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 16:04:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:04:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb136a33-91, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 16:04:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:04:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:04:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:04:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f77901c8-e0da-485d-8c6a-af162cf20d96) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 16:04:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:04:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:04:59 user nova-compute[75080]: INFO os_vif [None req-7cad51b9-3c41-41d2-9918-a7da03c16dc0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:25:2b,bridge_name='br-int',has_traffic_filtering=True,id=db136a33-916a-45d3-a453-b3781f5e53bd,network=Network(72069664-17d2-4963-9f71-559dd80df9ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb136a33-91')
Dec 05 16:04:59 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-7cad51b9-3c41-41d2-9918-a7da03c16dc0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Deleting instance files /opt/stack/data/nova/instances/e83818b7-547d-42e8-8eec-5684b15b924b_del
Dec 05 16:04:59 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-7cad51b9-3c41-41d2-9918-a7da03c16dc0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Deletion of /opt/stack/data/nova/instances/e83818b7-547d-42e8-8eec-5684b15b924b_del complete
Dec 05 16:05:00 user nova-compute[75080]: INFO nova.compute.manager [None req-7cad51b9-3c41-41d2-9918-a7da03c16dc0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Took 0.67 seconds to destroy the instance on the hypervisor.
Dec 05 16:05:00 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-7cad51b9-3c41-41d2-9918-a7da03c16dc0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 16:05:00 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 16:05:00 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 16:05:00 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 16:05:00 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Took 0.63 seconds to deallocate network for instance.
Dec 05 16:05:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7cad51b9-3c41-41d2-9918-a7da03c16dc0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:05:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7cad51b9-3c41-41d2-9918-a7da03c16dc0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:05:01 user nova-compute[75080]: DEBUG nova.compute.manager [req-38e16a9d-2762-4a4c-b313-03c5b953d9e8 req-c9dfddbc-d966-4320-9bc3-9faa39758727 service nova] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Received event network-vif-deleted-db136a33-916a-45d3-a453-b3781f5e53bd {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 16:05:01 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7cad51b9-3c41-41d2-9918-a7da03c16dc0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 16:05:01 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7cad51b9-3c41-41d2-9918-a7da03c16dc0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 16:05:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7cad51b9-3c41-41d2-9918-a7da03c16dc0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.219s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:05:01 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-7cad51b9-3c41-41d2-9918-a7da03c16dc0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Deleted allocations for instance e83818b7-547d-42e8-8eec-5684b15b924b
Dec 05 16:05:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7cad51b9-3c41-41d2-9918-a7da03c16dc0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "e83818b7-547d-42e8-8eec-5684b15b924b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.090s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:05:01 user nova-compute[75080]: DEBUG nova.compute.manager [req-3bdf3b92-1bf6-46a3-856c-52f735f95a1d req-88301210-a468-4587-8136-10fa9e71fe89 service nova] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Received event network-vif-plugged-db136a33-916a-45d3-a453-b3781f5e53bd {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 16:05:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-3bdf3b92-1bf6-46a3-856c-52f735f95a1d req-88301210-a468-4587-8136-10fa9e71fe89 service nova] Acquiring lock "e83818b7-547d-42e8-8eec-5684b15b924b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:05:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-3bdf3b92-1bf6-46a3-856c-52f735f95a1d req-88301210-a468-4587-8136-10fa9e71fe89 service nova] Lock "e83818b7-547d-42e8-8eec-5684b15b924b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:05:01 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-3bdf3b92-1bf6-46a3-856c-52f735f95a1d req-88301210-a468-4587-8136-10fa9e71fe89 service nova] Lock "e83818b7-547d-42e8-8eec-5684b15b924b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:05:01 user nova-compute[75080]: DEBUG nova.compute.manager [req-3bdf3b92-1bf6-46a3-856c-52f735f95a1d req-88301210-a468-4587-8136-10fa9e71fe89 service nova] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] No waiting events found dispatching network-vif-plugged-db136a33-916a-45d3-a453-b3781f5e53bd {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 16:05:01 user nova-compute[75080]: WARNING nova.compute.manager [req-3bdf3b92-1bf6-46a3-856c-52f735f95a1d req-88301210-a468-4587-8136-10fa9e71fe89 service nova] [instance: e83818b7-547d-42e8-8eec-5684b15b924b] Received unexpected event network-vif-plugged-db136a33-916a-45d3-a453-b3781f5e53bd for instance with vm_state deleted and task_state None.
Dec 05 16:05:02 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:05:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:05:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:05:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:05:02 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 16:05:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bbdd293-b776-4840-9127-840f093eca19/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:05:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bbdd293-b776-4840-9127-840f093eca19/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:05:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bbdd293-b776-4840-9127-840f093eca19/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:05:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bbdd293-b776-4840-9127-840f093eca19/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:05:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 16:05:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:05:03 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:05:03 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:05:03 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=9042MB free_disk=24.957775115966797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 16:05:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:05:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:05:03 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 7bbdd293-b776-4840-9127-840f093eca19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 16:05:03 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 16:05:03 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 16:05:03 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 16:05:03 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 16:05:03 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 16:05:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.214s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:05:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:05:05 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:05:05 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:05:05 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 16:05:07 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:05:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:05:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:05:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:05:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:05:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:05:09 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:05:12 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:05:12 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:05:14 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:05:16 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:05:16 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 16:05:16 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Rebuilding the list of instances to heal {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 16:05:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-7bbdd293-b776-4840-9127-840f093eca19" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 16:05:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-7bbdd293-b776-4840-9127-840f093eca19" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 16:05:16 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 16:05:16 user nova-compute[75080]: DEBUG nova.objects.instance [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lazy-loading 'info_cache' on Instance uuid 7bbdd293-b776-4840-9127-840f093eca19 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:05:16 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Updating instance_info_cache with network_info: [{"id": "0ada633a-17ff-4082-a498-b4594478a9ef", "address": "fa:16:3e:0b:2a:15", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ada633a-17", "ovs_interfaceid": "0ada633a-17ff-4082-a498-b4594478a9ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 16:05:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-7bbdd293-b776-4840-9127-840f093eca19" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 16:05:16 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 16:05:19 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:05:19 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Triggering sync for uuid 7bbdd293-b776-4840-9127-840f093eca19 {{(pid=75080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 16:05:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "7bbdd293-b776-4840-9127-840f093eca19" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:05:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "7bbdd293-b776-4840-9127-840f093eca19" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:05:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "7bbdd293-b776-4840-9127-840f093eca19" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:05:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:05:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:05:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:05:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:05:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:05:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:05:23 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:05:24 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:05:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:05:34 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:05:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:05:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:05:49 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:05:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:05:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-bd7337bb-78be-4dcb-b774-3c27bd907ba1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "7bbdd293-b776-4840-9127-840f093eca19" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:05:50 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-bd7337bb-78be-4dcb-b774-3c27bd907ba1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "7bbdd293-b776-4840-9127-840f093eca19" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:05:50 user nova-compute[75080]: INFO nova.compute.manager [None req-bd7337bb-78be-4dcb-b774-3c27bd907ba1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Detaching volume 850d7004-01e7-48d2-b568-610413d9186c
Dec 05 16:05:50 user nova-compute[75080]: INFO nova.virt.block_device [None req-bd7337bb-78be-4dcb-b774-3c27bd907ba1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Attempting to driver detach volume 850d7004-01e7-48d2-b568-610413d9186c from mountpoint /dev/vdb
Dec 05 16:05:50 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-bd7337bb-78be-4dcb-b774-3c27bd907ba1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Attempting to detach device vdb from instance 7bbdd293-b776-4840-9127-840f093eca19 from the persistent domain config. {{(pid=75080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 16:05:50 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-bd7337bb-78be-4dcb-b774-3c27bd907ba1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 16:05:50 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 16:05:50 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 16:05:50 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 16:05:50 user nova-compute[75080]:   <serial>850d7004-01e7-48d2-b568-610413d9186c</serial>
Dec 05 16:05:50 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 16:05:50 user nova-compute[75080]: </disk>
Dec 05 16:05:50 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 16:05:50 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-bd7337bb-78be-4dcb-b774-3c27bd907ba1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Successfully detached device vdb from instance 7bbdd293-b776-4840-9127-840f093eca19 from the persistent domain config.
Dec 05 16:05:50 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-bd7337bb-78be-4dcb-b774-3c27bd907ba1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7bbdd293-b776-4840-9127-840f093eca19 from the live domain config. {{(pid=75080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 16:05:50 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-bd7337bb-78be-4dcb-b774-3c27bd907ba1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 16:05:50 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 16:05:50 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 16:05:50 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 16:05:50 user nova-compute[75080]:   <serial>850d7004-01e7-48d2-b568-610413d9186c</serial>
Dec 05 16:05:50 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 16:05:50 user nova-compute[75080]: </disk>
Dec 05 16:05:50 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 16:05:51 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-bd7337bb-78be-4dcb-b774-3c27bd907ba1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7bbdd293-b776-4840-9127-840f093eca19 {{(pid=75080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 16:05:54 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:05:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:05:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:05:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:05:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:05:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:05:59 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:06:01 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:06:03 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:06:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:06:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:06:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:06:03 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 16:06:03 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bbdd293-b776-4840-9127-840f093eca19/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:06:03 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bbdd293-b776-4840-9127-840f093eca19/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:06:03 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bbdd293-b776-4840-9127-840f093eca19/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:06:03 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bbdd293-b776-4840-9127-840f093eca19/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:06:04 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:06:04 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:06:04 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=9053MB free_disk=24.957069396972656GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 16:06:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:06:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:06:04 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 7bbdd293-b776-4840-9127-840f093eca19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 16:06:04 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 16:06:04 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 16:06:04 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 16:06:04 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 16:06:04 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 16:06:04 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:06:04 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:06:07 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:06:07 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:06:07 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:06:07 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 16:06:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:06:11 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-bd7337bb-78be-4dcb-b774-3c27bd907ba1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7bbdd293-b776-4840-9127-840f093eca19 is timed out.
Dec 05 16:06:11 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-bd7337bb-78be-4dcb-b774-3c27bd907ba1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Successfully detached device vdb from instance 7bbdd293-b776-4840-9127-840f093eca19 from the live domain config.
Dec 05 16:06:11 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd7337bb-78be-4dcb-b774-3c27bd907ba1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7337bb-78be-4dcb-b774-3c27bd907ba1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'niFbcRhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 16:06:11 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-bd7337bb-78be-4dcb-b774-3c27bd907ba1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 16:06:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-bd7337bb-78be-4dcb-b774-3c27bd907ba1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-bd7337bb-78be-4dcb-b774-3c27bd907ba1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[198e9ba7-a850-4cf1-b583-f4667475440c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7337bb-78be-4dcb-b774-3c27bd907ba1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 16:06:11 user nova-compute[75080]: No targets found.
Dec 05 16:06:11 user nova-compute[75080]: iSNS:
Dec 05 16:06:11 user nova-compute[75080]: No targets found.
Dec 05 16:06:11 user nova-compute[75080]: STATIC:
Dec 05 16:06:11 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c
Dec 05 16:06:11 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 16:06:11 user nova-compute[75080]:                 Iface Name: default
Dec 05 16:06:11 user nova-compute[75080]: FIRMWARE:
Dec 05 16:06:11 user nova-compute[75080]: No targets found.
Dec 05 16:06:11 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7337bb-78be-4dcb-b774-3c27bd907ba1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 16:06:11 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 16:06:11 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7337bb-78be-4dcb-b774-3c27bd907ba1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd515268-0f15-4935-aab5-9ea6bae2f6de]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1629cb7c-bc0a-4775-a5ad-f919c267df67]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7337bb-78be-4dcb-b774-3c27bd907ba1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c (non-flash)
Dec 05 16:06:11 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7337bb-78be-4dcb-b774-3c27bd907ba1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c (non-flash)
Dec 05 16:06:11 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7337bb-78be-4dcb-b774-3c27bd907ba1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f66383152d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c'): ({'sdb'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-bd7337bb-78be-4dcb-b774-3c27bd907ba1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Removing single pathed devices sdb {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74a35aa-c19c-4402-91ea-d5bcf073d888]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcb2c7d-d5c6-4b8b-af6a-94a9a1e0427b]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-bd7337bb-78be-4dcb-b774-3c27bd907ba1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Flushing IO for device /dev/sdb {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9544d8-8dd9-4e64-a616-c0a1e9db212b]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-bd7337bb-78be-4dcb-b774-3c27bd907ba1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba217c06-a183-41cd-8799-79433d4c5bf5]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-bd7337bb-78be-4dcb-b774-3c27bd907ba1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-bd7337bb-78be-4dcb-b774-3c27bd907ba1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7337bb-78be-4dcb-b774-3c27bd907ba1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea63dfe4-c527-4f1a-8045-de27b1922fa5]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7337bb-78be-4dcb-b774-3c27bd907ba1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0439a196-1d63-42c0-abf6-8a162015d284]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7337bb-78be-4dcb-b774-3c27bd907ba1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c, portal: 172.16.0.220,3260]
Dec 05 16:06:11 user nova-compute[75080]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c, portal: 172.16.0.220,3260] successful.
Dec 05 16:06:11 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850d7004-01e7-48d2-b568-610413d9186c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[df21cb2e-89d1-4937-a3de-b8cf5acd9232]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7337bb-78be-4dcb-b774-3c27bd907ba1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-bd7337bb-78be-4dcb-b774-3c27bd907ba1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7337bb-78be-4dcb-b774-3c27bd907ba1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] <== disconnect_volume: return (298ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 16:06:11 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd7337bb-78be-4dcb-b774-3c27bd907ba1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 16:06:12 user nova-compute[75080]: DEBUG nova.objects.instance [None req-bd7337bb-78be-4dcb-b774-3c27bd907ba1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lazy-loading 'flavor' on Instance uuid 7bbdd293-b776-4840-9127-840f093eca19 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:06:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-bd7337bb-78be-4dcb-b774-3c27bd907ba1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "7bbdd293-b776-4840-9127-840f093eca19" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.738s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:06:12 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:06:13 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:06:15 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:06:17 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:06:17 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 16:06:17 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Rebuilding the list of instances to heal {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 16:06:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-7bbdd293-b776-4840-9127-840f093eca19" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 16:06:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-7bbdd293-b776-4840-9127-840f093eca19" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 16:06:17 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 16:06:17 user nova-compute[75080]: DEBUG nova.objects.instance [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lazy-loading 'info_cache' on Instance uuid 7bbdd293-b776-4840-9127-840f093eca19 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:06:17 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Updating instance_info_cache with network_info: [{"id": "0ada633a-17ff-4082-a498-b4594478a9ef", "address": "fa:16:3e:0b:2a:15", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ada633a-17", "ovs_interfaceid": "0ada633a-17ff-4082-a498-b4594478a9ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 16:06:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-7bbdd293-b776-4840-9127-840f093eca19" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 16:06:17 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 16:06:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:06:24 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:06:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:06:29 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:06:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:06:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:06:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:06:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-350aad39-e710-4e51-a37a-45e28313817d tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "7bbdd293-b776-4840-9127-840f093eca19" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:06:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-350aad39-e710-4e51-a37a-45e28313817d tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "7bbdd293-b776-4840-9127-840f093eca19" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:06:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-350aad39-e710-4e51-a37a-45e28313817d tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "7bbdd293-b776-4840-9127-840f093eca19-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:06:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-350aad39-e710-4e51-a37a-45e28313817d tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "7bbdd293-b776-4840-9127-840f093eca19-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:06:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-350aad39-e710-4e51-a37a-45e28313817d tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "7bbdd293-b776-4840-9127-840f093eca19-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:06:40 user nova-compute[75080]: INFO nova.compute.manager [None req-350aad39-e710-4e51-a37a-45e28313817d tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Terminating instance
Dec 05 16:06:40 user nova-compute[75080]: DEBUG nova.compute.manager [None req-350aad39-e710-4e51-a37a-45e28313817d tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 16:06:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:06:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:06:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:06:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:06:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:06:41 user nova-compute[75080]: DEBUG nova.compute.manager [req-93c11d12-ad04-4322-882f-bb05a1bada8a req-95fceefb-42e6-4d85-b6fe-716fa28543ba service nova] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Received event network-vif-unplugged-0ada633a-17ff-4082-a498-b4594478a9ef {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 16:06:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-93c11d12-ad04-4322-882f-bb05a1bada8a req-95fceefb-42e6-4d85-b6fe-716fa28543ba service nova] Acquiring lock "7bbdd293-b776-4840-9127-840f093eca19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:06:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-93c11d12-ad04-4322-882f-bb05a1bada8a req-95fceefb-42e6-4d85-b6fe-716fa28543ba service nova] Lock "7bbdd293-b776-4840-9127-840f093eca19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:06:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-93c11d12-ad04-4322-882f-bb05a1bada8a req-95fceefb-42e6-4d85-b6fe-716fa28543ba service nova] Lock "7bbdd293-b776-4840-9127-840f093eca19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:06:41 user nova-compute[75080]: DEBUG nova.compute.manager [req-93c11d12-ad04-4322-882f-bb05a1bada8a req-95fceefb-42e6-4d85-b6fe-716fa28543ba service nova] [instance: 7bbdd293-b776-4840-9127-840f093eca19] No waiting events found dispatching network-vif-unplugged-0ada633a-17ff-4082-a498-b4594478a9ef {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 16:06:41 user nova-compute[75080]: DEBUG nova.compute.manager [req-93c11d12-ad04-4322-882f-bb05a1bada8a req-95fceefb-42e6-4d85-b6fe-716fa28543ba service nova] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Received event network-vif-unplugged-0ada633a-17ff-4082-a498-b4594478a9ef for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 16:06:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:06:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:06:41 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Instance destroyed successfully.
Dec 05 16:06:41 user nova-compute[75080]: DEBUG nova.objects.instance [None req-350aad39-e710-4e51-a37a-45e28313817d tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lazy-loading 'resources' on Instance uuid 7bbdd293-b776-4840-9127-840f093eca19 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:06:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-350aad39-e710-4e51-a37a-45e28313817d tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T16:00:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1484290688',display_name='tempest-AttachVolumeNegativeTest-server-1484290688',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1484290688',id=49,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCUrasWaGIW91sB0twQJtGQzG/9Yww6FG4iooOsPaBdX+1Qo5Pte4kWY5PLtzkBL1prGu6kckKwNizAqmLi52hsLjVLnvJOa6rae5Jrr6onfRwn+f97yspr6mz3JSNxBQ==',key_name='tempest-keypair-809672843',keypairs=<?>,launch_index=0,launched_at=2023-12-05T16:01:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c62808660324e5aa23e8618f7d32ae4',ramdisk_id='',reservation_id='r-gh2nuf2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-329346343',owner_user_name='tempest-AttachVolumeNegativeTest-329346343-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T16:01:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf39da2be27240a8b3e89e4484b9a99b',uuid=7bbdd293-b776-4840-9127-840f093eca19,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ada633a-17ff-4082-a498-b4594478a9ef", "address": "fa:16:3e:0b:2a:15", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ada633a-17", "ovs_interfaceid": "0ada633a-17ff-4082-a498-b4594478a9ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 16:06:41 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-350aad39-e710-4e51-a37a-45e28313817d tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Converting VIF {"id": "0ada633a-17ff-4082-a498-b4594478a9ef", "address": "fa:16:3e:0b:2a:15", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ada633a-17", "ovs_interfaceid": "0ada633a-17ff-4082-a498-b4594478a9ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 16:06:41 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-350aad39-e710-4e51-a37a-45e28313817d tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:2a:15,bridge_name='br-int',has_traffic_filtering=True,id=0ada633a-17ff-4082-a498-b4594478a9ef,network=Network(72069664-17d2-4963-9f71-559dd80df9ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ada633a-17') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 16:06:41 user nova-compute[75080]: DEBUG os_vif [None req-350aad39-e710-4e51-a37a-45e28313817d tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:2a:15,bridge_name='br-int',has_traffic_filtering=True,id=0ada633a-17ff-4082-a498-b4594478a9ef,network=Network(72069664-17d2-4963-9f71-559dd80df9ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ada633a-17') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 16:06:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:06:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ada633a-17, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 16:06:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:06:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:06:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:06:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5d6dcf60-a68d-41d4-849f-d962e4433d10) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 16:06:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:06:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:06:41 user nova-compute[75080]: INFO os_vif [None req-350aad39-e710-4e51-a37a-45e28313817d tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:2a:15,bridge_name='br-int',has_traffic_filtering=True,id=0ada633a-17ff-4082-a498-b4594478a9ef,network=Network(72069664-17d2-4963-9f71-559dd80df9ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ada633a-17')
Dec 05 16:06:41 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-350aad39-e710-4e51-a37a-45e28313817d tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Deleting instance files /opt/stack/data/nova/instances/7bbdd293-b776-4840-9127-840f093eca19_del
Dec 05 16:06:41 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-350aad39-e710-4e51-a37a-45e28313817d tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Deletion of /opt/stack/data/nova/instances/7bbdd293-b776-4840-9127-840f093eca19_del complete
Dec 05 16:06:41 user nova-compute[75080]: INFO nova.compute.manager [None req-350aad39-e710-4e51-a37a-45e28313817d tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Took 0.86 seconds to destroy the instance on the hypervisor.
Dec 05 16:06:41 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-350aad39-e710-4e51-a37a-45e28313817d tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 16:06:41 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 16:06:41 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 7bbdd293-b776-4840-9127-840f093eca19] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 16:06:42 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 16:06:42 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Took 0.67 seconds to deallocate network for instance.
Dec 05 16:06:42 user nova-compute[75080]: DEBUG nova.compute.manager [req-24da4006-139f-4089-a4b2-c0b3f4ab0b67 req-7eb43aa4-c6f7-44a5-8cb2-5eb9c2229a5c service nova] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Received event network-vif-deleted-0ada633a-17ff-4082-a498-b4594478a9ef {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 16:06:42 user nova-compute[75080]: INFO nova.compute.manager [req-24da4006-139f-4089-a4b2-c0b3f4ab0b67 req-7eb43aa4-c6f7-44a5-8cb2-5eb9c2229a5c service nova] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Neutron deleted interface 0ada633a-17ff-4082-a498-b4594478a9ef; detaching it from the instance and deleting it from the info cache
Dec 05 16:06:42 user nova-compute[75080]: DEBUG nova.network.neutron [req-24da4006-139f-4089-a4b2-c0b3f4ab0b67 req-7eb43aa4-c6f7-44a5-8cb2-5eb9c2229a5c service nova] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 16:06:42 user nova-compute[75080]: DEBUG nova.compute.manager [req-24da4006-139f-4089-a4b2-c0b3f4ab0b67 req-7eb43aa4-c6f7-44a5-8cb2-5eb9c2229a5c service nova] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Detach interface failed, port_id=0ada633a-17ff-4082-a498-b4594478a9ef, reason: Instance 7bbdd293-b776-4840-9127-840f093eca19 could not be found. {{(pid=75080) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 16:06:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-350aad39-e710-4e51-a37a-45e28313817d tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:06:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-350aad39-e710-4e51-a37a-45e28313817d tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:06:42 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-350aad39-e710-4e51-a37a-45e28313817d tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 16:06:42 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-350aad39-e710-4e51-a37a-45e28313817d tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 16:06:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-350aad39-e710-4e51-a37a-45e28313817d tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.115s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:06:42 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-350aad39-e710-4e51-a37a-45e28313817d tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Deleted allocations for instance 7bbdd293-b776-4840-9127-840f093eca19
Dec 05 16:06:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-350aad39-e710-4e51-a37a-45e28313817d tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "7bbdd293-b776-4840-9127-840f093eca19" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.831s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:06:43 user nova-compute[75080]: DEBUG nova.compute.manager [req-a43d5bca-3cbe-4d42-8dc9-646a8432c770 req-fb96958b-1f9c-41db-b594-4cd824122208 service nova] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Received event network-vif-plugged-0ada633a-17ff-4082-a498-b4594478a9ef {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 16:06:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a43d5bca-3cbe-4d42-8dc9-646a8432c770 req-fb96958b-1f9c-41db-b594-4cd824122208 service nova] Acquiring lock "7bbdd293-b776-4840-9127-840f093eca19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:06:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a43d5bca-3cbe-4d42-8dc9-646a8432c770 req-fb96958b-1f9c-41db-b594-4cd824122208 service nova] Lock "7bbdd293-b776-4840-9127-840f093eca19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:06:43 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a43d5bca-3cbe-4d42-8dc9-646a8432c770 req-fb96958b-1f9c-41db-b594-4cd824122208 service nova] Lock "7bbdd293-b776-4840-9127-840f093eca19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:06:43 user nova-compute[75080]: DEBUG nova.compute.manager [req-a43d5bca-3cbe-4d42-8dc9-646a8432c770 req-fb96958b-1f9c-41db-b594-4cd824122208 service nova] [instance: 7bbdd293-b776-4840-9127-840f093eca19] No waiting events found dispatching network-vif-plugged-0ada633a-17ff-4082-a498-b4594478a9ef {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 16:06:43 user nova-compute[75080]: WARNING nova.compute.manager [req-a43d5bca-3cbe-4d42-8dc9-646a8432c770 req-fb96958b-1f9c-41db-b594-4cd824122208 service nova] [instance: 7bbdd293-b776-4840-9127-840f093eca19] Received unexpected event network-vif-plugged-0ada633a-17ff-4082-a498-b4594478a9ef for instance with vm_state deleted and task_state None.
Dec 05 16:06:46 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:06:51 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:06:56 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:07:01 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:07:02 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:07:05 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:07:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:07:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:07:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:07:05 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 16:07:05 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:07:05 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:07:05 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=9200MB free_disk=24.984291076660156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 16:07:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:07:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:07:05 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 16:07:05 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 16:07:05 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 16:07:05 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 16:07:05 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 16:07:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:07:06 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:07:07 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:07:07 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:07:08 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:07:08 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 16:07:11 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:07:13 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:07:15 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:07:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:07:18 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:07:18 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 16:07:18 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Rebuilding the list of instances to heal {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 16:07:18 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Didn't find any instances for network info cache update. {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 16:07:21 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:07:24 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:07:26 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:07:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:07:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:07:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "a7d753a9-1cdc-469e-9704-c3e546d200d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:07:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "a7d753a9-1cdc-469e-9704-c3e546d200d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:07:35 user nova-compute[75080]: DEBUG nova.compute.manager [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 16:07:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:07:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:07:35 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 16:07:35 user nova-compute[75080]: INFO nova.compute.claims [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Claim successful on node user
Dec 05 16:07:35 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 16:07:35 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 16:07:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.180s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:07:35 user nova-compute[75080]: DEBUG nova.compute.manager [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 16:07:35 user nova-compute[75080]: DEBUG nova.compute.manager [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 16:07:35 user nova-compute[75080]: DEBUG nova.network.neutron [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 16:07:35 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 16:07:35 user nova-compute[75080]: DEBUG nova.compute.manager [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 16:07:35 user nova-compute[75080]: DEBUG nova.policy [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bf39da2be27240a8b3e89e4484b9a99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c62808660324e5aa23e8618f7d32ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 16:07:36 user nova-compute[75080]: DEBUG nova.compute.manager [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 16:07:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 16:07:36 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Creating image(s)
Dec 05 16:07:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "/opt/stack/data/nova/instances/a7d753a9-1cdc-469e-9704-c3e546d200d1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:07:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "/opt/stack/data/nova/instances/a7d753a9-1cdc-469e-9704-c3e546d200d1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:07:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "/opt/stack/data/nova/instances/a7d753a9-1cdc-469e-9704-c3e546d200d1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:07:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:07:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.176s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:07:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:07:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:07:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:07:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.188s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:07:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/a7d753a9-1cdc-469e-9704-c3e546d200d1/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:07:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/a7d753a9-1cdc-469e-9704-c3e546d200d1/disk 1073741824" returned: 0 in 0.050s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:07:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:07:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:07:36 user nova-compute[75080]: DEBUG nova.network.neutron [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Successfully created port: 69abb397-14b2-463c-bf7b-4078d0a6708b {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 16:07:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.185s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:07:36 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a7d753a9-1cdc-469e-9704-c3e546d200d1/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 16:07:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d753a9-1cdc-469e-9704-c3e546d200d1/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:07:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:07:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d753a9-1cdc-469e-9704-c3e546d200d1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:07:36 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Cannot resize image /opt/stack/data/nova/instances/a7d753a9-1cdc-469e-9704-c3e546d200d1/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 16:07:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 16:07:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Ensure instance console log exists: /opt/stack/data/nova/instances/a7d753a9-1cdc-469e-9704-c3e546d200d1/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 16:07:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:07:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:07:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG nova.network.neutron [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Successfully updated port: 69abb397-14b2-463c-bf7b-4078d0a6708b {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "refresh_cache-a7d753a9-1cdc-469e-9704-c3e546d200d1" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquired lock "refresh_cache-a7d753a9-1cdc-469e-9704-c3e546d200d1" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG nova.network.neutron [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG nova.compute.manager [req-7b62ffe6-1329-45d0-91f4-91948d1cf934 req-d2337f80-45bb-49db-b7db-1ba0a7a0c873 service nova] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Received event network-changed-69abb397-14b2-463c-bf7b-4078d0a6708b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG nova.compute.manager [req-7b62ffe6-1329-45d0-91f4-91948d1cf934 req-d2337f80-45bb-49db-b7db-1ba0a7a0c873 service nova] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Refreshing instance network info cache due to event network-changed-69abb397-14b2-463c-bf7b-4078d0a6708b. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7b62ffe6-1329-45d0-91f4-91948d1cf934 req-d2337f80-45bb-49db-b7db-1ba0a7a0c873 service nova] Acquiring lock "refresh_cache-a7d753a9-1cdc-469e-9704-c3e546d200d1" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG nova.network.neutron [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG nova.network.neutron [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Updating instance_info_cache with network_info: [{"id": "69abb397-14b2-463c-bf7b-4078d0a6708b", "address": "fa:16:3e:9a:9b:94", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69abb397-14", "ovs_interfaceid": "69abb397-14b2-463c-bf7b-4078d0a6708b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Releasing lock "refresh_cache-a7d753a9-1cdc-469e-9704-c3e546d200d1" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG nova.compute.manager [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Instance network_info: |[{"id": "69abb397-14b2-463c-bf7b-4078d0a6708b", "address": "fa:16:3e:9a:9b:94", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69abb397-14", "ovs_interfaceid": "69abb397-14b2-463c-bf7b-4078d0a6708b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7b62ffe6-1329-45d0-91f4-91948d1cf934 req-d2337f80-45bb-49db-b7db-1ba0a7a0c873 service nova] Acquired lock "refresh_cache-a7d753a9-1cdc-469e-9704-c3e546d200d1" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG nova.network.neutron [req-7b62ffe6-1329-45d0-91f4-91948d1cf934 req-d2337f80-45bb-49db-b7db-1ba0a7a0c873 service nova] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Refreshing network info cache for port 69abb397-14b2-463c-bf7b-4078d0a6708b {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Start _get_guest_xml network_info=[{"id": "69abb397-14b2-463c-bf7b-4078d0a6708b", "address": "fa:16:3e:9a:9b:94", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69abb397-14", "ovs_interfaceid": "69abb397-14b2-463c-bf7b-4078d0a6708b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 16:07:37 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:07:37 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:07:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T16:07:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1195235563',display_name='tempest-AttachVolumeNegativeTest-server-1195235563',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1195235563',id=51,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhHvo3gr+OdbguMwIPN39TKFdvtUh/246KmyYbGI/RdfBxuJR5spqAKOuPbiHyE39yfznAjGYC+QCIz+wxQSP/fGY49ESfQFmIb2jQeikEXvw0Qt4KvB8O7A8JHSgNXyg==',key_name='tempest-keypair-1857856985',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c62808660324e5aa23e8618f7d32ae4',ramdisk_id='',reservation_id='r-5j4isg0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-329346343',owner_user_name='tempest-AttachVolumeNegativeTest-329346343-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T16:07:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf39da2be27240a8b3e89e4484b9a99b',uuid=a7d753a9-1cdc-469e-9704-c3e546d200d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69abb397-14b2-463c-bf7b-4078d0a6708b", "address": "fa:16:3e:9a:9b:94", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69abb397-14", "ovs_interfaceid": "69abb397-14b2-463c-bf7b-4078d0a6708b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Converting VIF {"id": "69abb397-14b2-463c-bf7b-4078d0a6708b", "address": "fa:16:3e:9a:9b:94", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69abb397-14", "ovs_interfaceid": "69abb397-14b2-463c-bf7b-4078d0a6708b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:9b:94,bridge_name='br-int',has_traffic_filtering=True,id=69abb397-14b2-463c-bf7b-4078d0a6708b,network=Network(72069664-17d2-4963-9f71-559dd80df9ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69abb397-14') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG nova.objects.instance [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lazy-loading 'pci_devices' on Instance uuid a7d753a9-1cdc-469e-9704-c3e546d200d1 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] End _get_guest_xml xml=<domain type="kvm">
Dec 05 16:07:37 user nova-compute[75080]:   <uuid>a7d753a9-1cdc-469e-9704-c3e546d200d1</uuid>
Dec 05 16:07:37 user nova-compute[75080]:   <name>instance-00000033</name>
Dec 05 16:07:37 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 16:07:37 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 16:07:37 user nova-compute[75080]:   <metadata>
Dec 05 16:07:37 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 16:07:37 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 16:07:37 user nova-compute[75080]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1195235563</nova:name>
Dec 05 16:07:37 user nova-compute[75080]:       <nova:creationTime>2023-12-05 16:07:37</nova:creationTime>
Dec 05 16:07:37 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 16:07:37 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 16:07:37 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 16:07:37 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 16:07:37 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 16:07:37 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 16:07:37 user nova-compute[75080]:       </nova:flavor>
Dec 05 16:07:37 user nova-compute[75080]:       <nova:owner>
Dec 05 16:07:37 user nova-compute[75080]:         <nova:user uuid="bf39da2be27240a8b3e89e4484b9a99b">tempest-AttachVolumeNegativeTest-329346343-project-member</nova:user>
Dec 05 16:07:37 user nova-compute[75080]:         <nova:project uuid="1c62808660324e5aa23e8618f7d32ae4">tempest-AttachVolumeNegativeTest-329346343</nova:project>
Dec 05 16:07:37 user nova-compute[75080]:       </nova:owner>
Dec 05 16:07:37 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 16:07:37 user nova-compute[75080]:       <nova:ports>
Dec 05 16:07:37 user nova-compute[75080]:         <nova:port uuid="69abb397-14b2-463c-bf7b-4078d0a6708b">
Dec 05 16:07:37 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 05 16:07:37 user nova-compute[75080]:         </nova:port>
Dec 05 16:07:37 user nova-compute[75080]:       </nova:ports>
Dec 05 16:07:37 user nova-compute[75080]:     </nova:instance>
Dec 05 16:07:37 user nova-compute[75080]:   </metadata>
Dec 05 16:07:37 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 16:07:37 user nova-compute[75080]:     <system>
Dec 05 16:07:37 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 16:07:37 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 16:07:37 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 16:07:37 user nova-compute[75080]:       <entry name="serial">a7d753a9-1cdc-469e-9704-c3e546d200d1</entry>
Dec 05 16:07:37 user nova-compute[75080]:       <entry name="uuid">a7d753a9-1cdc-469e-9704-c3e546d200d1</entry>
Dec 05 16:07:37 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 16:07:37 user nova-compute[75080]:     </system>
Dec 05 16:07:37 user nova-compute[75080]:   </sysinfo>
Dec 05 16:07:37 user nova-compute[75080]:   <os>
Dec 05 16:07:37 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 16:07:37 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 16:07:37 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 16:07:37 user nova-compute[75080]:   </os>
Dec 05 16:07:37 user nova-compute[75080]:   <features>
Dec 05 16:07:37 user nova-compute[75080]:     <acpi/>
Dec 05 16:07:37 user nova-compute[75080]:     <apic/>
Dec 05 16:07:37 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 16:07:37 user nova-compute[75080]:   </features>
Dec 05 16:07:37 user nova-compute[75080]:   <clock offset="utc">
Dec 05 16:07:37 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 16:07:37 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 16:07:37 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 16:07:37 user nova-compute[75080]:   </clock>
Dec 05 16:07:37 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 16:07:37 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 16:07:37 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 16:07:37 user nova-compute[75080]:   </cpu>
Dec 05 16:07:37 user nova-compute[75080]:   <devices>
Dec 05 16:07:37 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 16:07:37 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 16:07:37 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/a7d753a9-1cdc-469e-9704-c3e546d200d1/disk"/>
Dec 05 16:07:37 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 16:07:37 user nova-compute[75080]:     </disk>
Dec 05 16:07:37 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 16:07:37 user nova-compute[75080]:       <mac address="fa:16:3e:9a:9b:94"/>
Dec 05 16:07:37 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 16:07:37 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 16:07:37 user nova-compute[75080]:       <target dev="tap69abb397-14"/>
Dec 05 16:07:37 user nova-compute[75080]:     </interface>
Dec 05 16:07:37 user nova-compute[75080]:     <serial type="pty">
Dec 05 16:07:37 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/a7d753a9-1cdc-469e-9704-c3e546d200d1/console.log" append="off"/>
Dec 05 16:07:37 user nova-compute[75080]:     </serial>
Dec 05 16:07:37 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 16:07:37 user nova-compute[75080]:     <video>
Dec 05 16:07:37 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 16:07:37 user nova-compute[75080]:     </video>
Dec 05 16:07:37 user nova-compute[75080]:     <rng model="virtio">
Dec 05 16:07:37 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 16:07:37 user nova-compute[75080]:     </rng>
Dec 05 16:07:37 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 16:07:37 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 16:07:37 user nova-compute[75080]:       <stats period="10"/>
Dec 05 16:07:37 user nova-compute[75080]:     </memballoon>
Dec 05 16:07:37 user nova-compute[75080]:   </devices>
Dec 05 16:07:37 user nova-compute[75080]: </domain>
Dec 05 16:07:37 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T16:07:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1195235563',display_name='tempest-AttachVolumeNegativeTest-server-1195235563',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1195235563',id=51,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhHvo3gr+OdbguMwIPN39TKFdvtUh/246KmyYbGI/RdfBxuJR5spqAKOuPbiHyE39yfznAjGYC+QCIz+wxQSP/fGY49ESfQFmIb2jQeikEXvw0Qt4KvB8O7A8JHSgNXyg==',key_name='tempest-keypair-1857856985',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c62808660324e5aa23e8618f7d32ae4',ramdisk_id='',reservation_id='r-5j4isg0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-329346343',owner_user_name='tempest-AttachVolumeNegativeTest-329346343-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T16:07:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf39da2be27240a8b3e89e4484b9a99b',uuid=a7d753a9-1cdc-469e-9704-c3e546d200d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69abb397-14b2-463c-bf7b-4078d0a6708b", "address": "fa:16:3e:9a:9b:94", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69abb397-14", "ovs_interfaceid": "69abb397-14b2-463c-bf7b-4078d0a6708b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Converting VIF {"id": "69abb397-14b2-463c-bf7b-4078d0a6708b", "address": "fa:16:3e:9a:9b:94", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69abb397-14", "ovs_interfaceid": "69abb397-14b2-463c-bf7b-4078d0a6708b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:9b:94,bridge_name='br-int',has_traffic_filtering=True,id=69abb397-14b2-463c-bf7b-4078d0a6708b,network=Network(72069664-17d2-4963-9f71-559dd80df9ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69abb397-14') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG os_vif [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:9b:94,bridge_name='br-int',has_traffic_filtering=True,id=69abb397-14b2-463c-bf7b-4078d0a6708b,network=Network(72069664-17d2-4963-9f71-559dd80df9ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69abb397-14') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c975a8ef-9696-5a41-aa0a-2c9cbee84a40', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69abb397-14, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap69abb397-14, col_values=(('qos', UUID('56042f78-4e5e-4d2f-a7b1-81f8104ee665')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap69abb397-14, col_values=(('external_ids', {'iface-id': '69abb397-14b2-463c-bf7b-4078d0a6708b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:9b:94', 'vm-uuid': 'a7d753a9-1cdc-469e-9704-c3e546d200d1'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:07:37 user nova-compute[75080]: INFO os_vif [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:9b:94,bridge_name='br-int',has_traffic_filtering=True,id=69abb397-14b2-463c-bf7b-4078d0a6708b,network=Network(72069664-17d2-4963-9f71-559dd80df9ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69abb397-14')
Dec 05 16:07:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] No VIF found with MAC fa:16:3e:9a:9b:94, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG nova.network.neutron [req-7b62ffe6-1329-45d0-91f4-91948d1cf934 req-d2337f80-45bb-49db-b7db-1ba0a7a0c873 service nova] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Updated VIF entry in instance network info cache for port 69abb397-14b2-463c-bf7b-4078d0a6708b. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG nova.network.neutron [req-7b62ffe6-1329-45d0-91f4-91948d1cf934 req-d2337f80-45bb-49db-b7db-1ba0a7a0c873 service nova] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Updating instance_info_cache with network_info: [{"id": "69abb397-14b2-463c-bf7b-4078d0a6708b", "address": "fa:16:3e:9a:9b:94", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69abb397-14", "ovs_interfaceid": "69abb397-14b2-463c-bf7b-4078d0a6708b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 16:07:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-7b62ffe6-1329-45d0-91f4-91948d1cf934 req-d2337f80-45bb-49db-b7db-1ba0a7a0c873 service nova] Releasing lock "refresh_cache-a7d753a9-1cdc-469e-9704-c3e546d200d1" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 16:07:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:07:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:07:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:07:39 user nova-compute[75080]: DEBUG nova.compute.manager [req-5bfebba7-039e-4858-9cad-f4bf8f896b08 req-34ba6792-7423-465c-bb99-0ae5d833fa84 service nova] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Received event network-vif-plugged-69abb397-14b2-463c-bf7b-4078d0a6708b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 16:07:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5bfebba7-039e-4858-9cad-f4bf8f896b08 req-34ba6792-7423-465c-bb99-0ae5d833fa84 service nova] Acquiring lock "a7d753a9-1cdc-469e-9704-c3e546d200d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:07:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5bfebba7-039e-4858-9cad-f4bf8f896b08 req-34ba6792-7423-465c-bb99-0ae5d833fa84 service nova] Lock "a7d753a9-1cdc-469e-9704-c3e546d200d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:07:39 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5bfebba7-039e-4858-9cad-f4bf8f896b08 req-34ba6792-7423-465c-bb99-0ae5d833fa84 service nova] Lock "a7d753a9-1cdc-469e-9704-c3e546d200d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:07:39 user nova-compute[75080]: DEBUG nova.compute.manager [req-5bfebba7-039e-4858-9cad-f4bf8f896b08 req-34ba6792-7423-465c-bb99-0ae5d833fa84 service nova] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] No waiting events found dispatching network-vif-plugged-69abb397-14b2-463c-bf7b-4078d0a6708b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 16:07:39 user nova-compute[75080]: WARNING nova.compute.manager [req-5bfebba7-039e-4858-9cad-f4bf8f896b08 req-34ba6792-7423-465c-bb99-0ae5d833fa84 service nova] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Received unexpected event network-vif-plugged-69abb397-14b2-463c-bf7b-4078d0a6708b for instance with vm_state building and task_state spawning.
Dec 05 16:07:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:07:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:07:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:07:41 user nova-compute[75080]: DEBUG nova.compute.manager [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 16:07:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 16:07:41 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Instance spawned successfully.
Dec 05 16:07:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 16:07:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 16:07:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 16:07:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 16:07:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 16:07:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 16:07:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 16:07:41 user nova-compute[75080]: INFO nova.compute.manager [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Took 5.32 seconds to spawn the instance on the hypervisor.
Dec 05 16:07:41 user nova-compute[75080]: DEBUG nova.compute.manager [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 16:07:41 user nova-compute[75080]: DEBUG nova.compute.manager [req-0edcefb7-0147-415d-8778-41e034c8e39b req-dc3eeb06-8483-414b-922f-eff2fc86009a service nova] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Received event network-vif-plugged-69abb397-14b2-463c-bf7b-4078d0a6708b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 16:07:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0edcefb7-0147-415d-8778-41e034c8e39b req-dc3eeb06-8483-414b-922f-eff2fc86009a service nova] Acquiring lock "a7d753a9-1cdc-469e-9704-c3e546d200d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:07:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0edcefb7-0147-415d-8778-41e034c8e39b req-dc3eeb06-8483-414b-922f-eff2fc86009a service nova] Lock "a7d753a9-1cdc-469e-9704-c3e546d200d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:07:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-0edcefb7-0147-415d-8778-41e034c8e39b req-dc3eeb06-8483-414b-922f-eff2fc86009a service nova] Lock "a7d753a9-1cdc-469e-9704-c3e546d200d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:07:41 user nova-compute[75080]: DEBUG nova.compute.manager [req-0edcefb7-0147-415d-8778-41e034c8e39b req-dc3eeb06-8483-414b-922f-eff2fc86009a service nova] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] No waiting events found dispatching network-vif-plugged-69abb397-14b2-463c-bf7b-4078d0a6708b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 16:07:41 user nova-compute[75080]: WARNING nova.compute.manager [req-0edcefb7-0147-415d-8778-41e034c8e39b req-dc3eeb06-8483-414b-922f-eff2fc86009a service nova] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Received unexpected event network-vif-plugged-69abb397-14b2-463c-bf7b-4078d0a6708b for instance with vm_state building and task_state spawning.
Dec 05 16:07:41 user nova-compute[75080]: INFO nova.compute.manager [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Took 5.80 seconds to build instance.
Dec 05 16:07:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-5aadd38a-7512-4c8a-bece-54a1ec0e9894 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "a7d753a9-1cdc-469e-9704-c3e546d200d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.905s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:07:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:07:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:07:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:07:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:07:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:07:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:07:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:07:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:07:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:07:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:07:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:08:02 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:08:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:08:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:08:05 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:08:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:08:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:08:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:08:05 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 16:08:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d753a9-1cdc-469e-9704-c3e546d200d1/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:08:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d753a9-1cdc-469e-9704-c3e546d200d1/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:08:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d753a9-1cdc-469e-9704-c3e546d200d1/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:08:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d753a9-1cdc-469e-9704-c3e546d200d1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:08:06 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:08:06 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:08:06 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=8974MB free_disk=24.954769134521484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 16:08:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:08:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:08:06 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance a7d753a9-1cdc-469e-9704-c3e546d200d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 16:08:06 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 16:08:06 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 16:08:06 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 16:08:06 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 16:08:06 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 16:08:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.251s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:08:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:08:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:08:09 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:08:09 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:08:10 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:08:10 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 16:08:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:08:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:08:15 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:08:15 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:08:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:08:20 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:08:20 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 16:08:20 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Rebuilding the list of instances to heal {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 16:08:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-a7d753a9-1cdc-469e-9704-c3e546d200d1" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 16:08:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-a7d753a9-1cdc-469e-9704-c3e546d200d1" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 16:08:20 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 16:08:20 user nova-compute[75080]: DEBUG nova.objects.instance [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lazy-loading 'info_cache' on Instance uuid a7d753a9-1cdc-469e-9704-c3e546d200d1 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:08:21 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Updating instance_info_cache with network_info: [{"id": "69abb397-14b2-463c-bf7b-4078d0a6708b", "address": "fa:16:3e:9a:9b:94", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69abb397-14", "ovs_interfaceid": "69abb397-14b2-463c-bf7b-4078d0a6708b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 16:08:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-a7d753a9-1cdc-469e-9704-c3e546d200d1" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 16:08:21 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 16:08:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:08:24 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:08:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:08:31 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:08:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:08:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:08:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:08:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:08:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:08:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:08:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:08:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:08:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:08:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:08:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:08:58 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:08:58 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Cleaning up deleted instances {{(pid=75080) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 05 16:08:58 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] There are 0 instances to clean {{(pid=75080) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 05 16:09:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:09:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:09:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:09:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:09:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:09:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:09:03 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:09:05 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:09:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:09:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:09:05 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:09:05 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 16:09:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d753a9-1cdc-469e-9704-c3e546d200d1/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:09:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d753a9-1cdc-469e-9704-c3e546d200d1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:09:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d753a9-1cdc-469e-9704-c3e546d200d1/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:09:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d753a9-1cdc-469e-9704-c3e546d200d1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:09:06 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:09:06 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:09:06 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=9046MB free_disk=24.953975677490234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 16:09:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:09:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:09:06 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance a7d753a9-1cdc-469e-9704-c3e546d200d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 16:09:06 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 16:09:06 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 16:09:06 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing inventories for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 05 16:09:06 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Updating ProviderTree inventory for provider 21b770fa-b774-46c9-9415-db26064ccd0f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 05 16:09:06 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Updating inventory in ProviderTree for provider 21b770fa-b774-46c9-9415-db26064ccd0f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 16:09:06 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing aggregate associations for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f, aggregates: None {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 05 16:09:06 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing trait associations for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f, traits: COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 05 16:09:06 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 16:09:06 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 16:09:06 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 16:09:06 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.349s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:09:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:09:09 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:09:09 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:09:11 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:09:11 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 16:09:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:09:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:09:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:09:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:09:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:09:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:09:15 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:09:17 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:09:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:09:21 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:09:21 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 16:09:21 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Rebuilding the list of instances to heal {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 16:09:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-a7d753a9-1cdc-469e-9704-c3e546d200d1" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 16:09:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-a7d753a9-1cdc-469e-9704-c3e546d200d1" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 16:09:21 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 16:09:21 user nova-compute[75080]: DEBUG nova.objects.instance [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lazy-loading 'info_cache' on Instance uuid a7d753a9-1cdc-469e-9704-c3e546d200d1 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:09:22 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Updating instance_info_cache with network_info: [{"id": "69abb397-14b2-463c-bf7b-4078d0a6708b", "address": "fa:16:3e:9a:9b:94", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69abb397-14", "ovs_interfaceid": "69abb397-14b2-463c-bf7b-4078d0a6708b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 16:09:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-a7d753a9-1cdc-469e-9704-c3e546d200d1" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 16:09:22 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 16:09:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:09:25 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:09:26 user nova-compute[75080]: DEBUG nova.compute.manager [req-69cd9388-eb57-4f10-80be-43e49d4df93e req-ed182e15-320c-4c23-9c6d-8f822e632d3e service nova] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Received event network-changed-69abb397-14b2-463c-bf7b-4078d0a6708b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 16:09:26 user nova-compute[75080]: DEBUG nova.compute.manager [req-69cd9388-eb57-4f10-80be-43e49d4df93e req-ed182e15-320c-4c23-9c6d-8f822e632d3e service nova] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Refreshing instance network info cache due to event network-changed-69abb397-14b2-463c-bf7b-4078d0a6708b. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 16:09:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-69cd9388-eb57-4f10-80be-43e49d4df93e req-ed182e15-320c-4c23-9c6d-8f822e632d3e service nova] Acquiring lock "refresh_cache-a7d753a9-1cdc-469e-9704-c3e546d200d1" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 16:09:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-69cd9388-eb57-4f10-80be-43e49d4df93e req-ed182e15-320c-4c23-9c6d-8f822e632d3e service nova] Acquired lock "refresh_cache-a7d753a9-1cdc-469e-9704-c3e546d200d1" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 16:09:26 user nova-compute[75080]: DEBUG nova.network.neutron [req-69cd9388-eb57-4f10-80be-43e49d4df93e req-ed182e15-320c-4c23-9c6d-8f822e632d3e service nova] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Refreshing network info cache for port 69abb397-14b2-463c-bf7b-4078d0a6708b {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 16:09:27 user nova-compute[75080]: DEBUG nova.network.neutron [req-69cd9388-eb57-4f10-80be-43e49d4df93e req-ed182e15-320c-4c23-9c6d-8f822e632d3e service nova] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Updated VIF entry in instance network info cache for port 69abb397-14b2-463c-bf7b-4078d0a6708b. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 16:09:27 user nova-compute[75080]: DEBUG nova.network.neutron [req-69cd9388-eb57-4f10-80be-43e49d4df93e req-ed182e15-320c-4c23-9c6d-8f822e632d3e service nova] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Updating instance_info_cache with network_info: [{"id": "69abb397-14b2-463c-bf7b-4078d0a6708b", "address": "fa:16:3e:9a:9b:94", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69abb397-14", "ovs_interfaceid": "69abb397-14b2-463c-bf7b-4078d0a6708b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 16:09:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-69cd9388-eb57-4f10-80be-43e49d4df93e req-ed182e15-320c-4c23-9c6d-8f822e632d3e service nova] Releasing lock "refresh_cache-a7d753a9-1cdc-469e-9704-c3e546d200d1" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 16:09:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:09:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:09:28 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:09:28 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75080) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 05 16:09:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "a7d753a9-1cdc-469e-9704-c3e546d200d1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:09:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "a7d753a9-1cdc-469e-9704-c3e546d200d1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:09:29 user nova-compute[75080]: DEBUG nova.objects.instance [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lazy-loading 'flavor' on Instance uuid a7d753a9-1cdc-469e-9704-c3e546d200d1 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:09:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "a7d753a9-1cdc-469e-9704-c3e546d200d1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:09:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "a7d753a9-1cdc-469e-9704-c3e546d200d1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:09:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "a7d753a9-1cdc-469e-9704-c3e546d200d1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:09:30 user nova-compute[75080]: INFO nova.compute.manager [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Attaching volume 05eb6419-fbfe-450f-9ff1-e9f28f02f261 to /dev/vdb
Dec 05 16:09:30 user nova-compute[75080]: DEBUG os_brick.utils [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 16:09:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:09:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:09:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b61d19c-ee8f-4d65-9bb8-48c12238baee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:09:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:09:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:09:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be8a55d-58c6-4d01-baef-539689955cb7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:09:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:09:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:09:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee76089d-4067-445d-87ca-cba76f342ff7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:09:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1682f8ed-6d38-4246-9358-a84a4916cc23]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:09:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:09:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 16:09:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 16:09:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:09:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 16:09:30 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 16:09:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[88040ad7-70f4-42a2-b598-7d5d7c280429]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:09:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 16:09:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 16:09:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 16:09:30 user nova-compute[75080]: DEBUG os_brick.utils [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 16:09:30 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Updating existing volume attachment record: 3dd815eb-f540-45e5-b74b-2d8d7c8db1da {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 16:09:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:09:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:09:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:09:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:09:38 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 16:09:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ndWGXcBS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 16:09:38 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 16:09:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 16:09:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 16:09:38 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 16:09:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 16:09:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 16:09:38 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 16:09:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261 -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:09:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:09:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[74272107-c073-4ea4-b8d1-2a3e9a4b212e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:09:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 16:09:38 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:09:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261 -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:09:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:09:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[73196f6d-86f7-441c-94f2-a6a737dd4529]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:09:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261] added
Dec 05 16:09:38 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:09:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:09:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:09:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b9d8ea-a773-4833-86f3-53b5485b8afe]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:09:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:09:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:09:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:09:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4d6921-bdc0-4979-aad3-702c13c42b1a]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:09:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:09:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ndWGXcBS {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:09:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ndWGXcBS" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:09:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d8b854-0823-48fa-88e9-de4469013b15]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:09:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ndWGXcBS'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:09:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:09:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:09:38 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[200041a1-5c8e-492a-a390-f58102ce4c60]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:09:38 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:09:38 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:09:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:09:39 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b95b0e-643d-4c52-a73f-ff2eb1db244c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:09:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 05 16:09:39 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 16:09:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 05 16:09:39 user nova-compute[75080]:  {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 16:09:39 user nova-compute[75080]: WARNING os_brick.initiator.connectors.iscsi [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 05 16:09:39 user nova-compute[75080]: 
Dec 05 16:09:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261 -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:09:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:09:39 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b59055c-ee46-4a5c-bb27-f5f5faa39147]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:09:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261, portal: 172.16.0.220,3260]
Dec 05 16:09:39 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261, portal: 172.16.0.220,3260] successful.
Dec 05 16:09:39 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:09:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:09:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:09:39 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fe0bfc-8046-40c5-92f4-fc14da6dbd3d]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:09:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:09:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:09:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:09:39 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd4065d-6dfb-42ca-8c04-bdc3d89455be]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:09:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261 (non-flash)
Dec 05 16:09:39 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 16:09:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261 (non-flash)
Dec 05 16:09:39 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 16:09:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 16:09:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 16:09:39 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 16:09:39 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 16:09:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:09:39 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:09:39 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa11d7fc-5caa-4d4b-afc6-e1fcbac21889]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:09:39 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 16:09:39 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ndWGXcBS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 16:09:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 16:09:40 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '26663666164356361', 'path': '/dev/sdb'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 16:09:40 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663666164356361', 'path': '/dev/sdb'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 16:09:40 user nova-compute[75080]: DEBUG nova.objects.instance [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lazy-loading 'flavor' on Instance uuid a7d753a9-1cdc-469e-9704-c3e546d200d1 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:09:40 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 16:09:40 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 16:09:40 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 16:09:40 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 16:09:40 user nova-compute[75080]:   <serial>05eb6419-fbfe-450f-9ff1-e9f28f02f261</serial>
Dec 05 16:09:40 user nova-compute[75080]: </disk>
Dec 05 16:09:40 user nova-compute[75080]:  {{(pid=75080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 16:09:40 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 16:09:40 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 16:09:40 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] No VIF found with MAC fa:16:3e:9a:9b:94, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 16:09:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-cd90300d-0d18-4dfd-97aa-f7629c3498b4 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "a7d753a9-1cdc-469e-9704-c3e546d200d1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.630s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:09:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-96ee1ed4-0769-44b3-975b-e1cbe95ec7e9 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "a7d753a9-1cdc-469e-9704-c3e546d200d1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:09:41 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-96ee1ed4-0769-44b3-975b-e1cbe95ec7e9 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "a7d753a9-1cdc-469e-9704-c3e546d200d1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:09:41 user nova-compute[75080]: INFO nova.compute.manager [None req-96ee1ed4-0769-44b3-975b-e1cbe95ec7e9 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Detaching volume 05eb6419-fbfe-450f-9ff1-e9f28f02f261
Dec 05 16:09:41 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:09:41 user nova-compute[75080]: INFO nova.virt.block_device [None req-96ee1ed4-0769-44b3-975b-e1cbe95ec7e9 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Attempting to driver detach volume 05eb6419-fbfe-450f-9ff1-e9f28f02f261 from mountpoint /dev/vdb
Dec 05 16:09:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-96ee1ed4-0769-44b3-975b-e1cbe95ec7e9 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Attempting to detach device vdb from instance a7d753a9-1cdc-469e-9704-c3e546d200d1 from the persistent domain config. {{(pid=75080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 16:09:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-96ee1ed4-0769-44b3-975b-e1cbe95ec7e9 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 16:09:41 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 16:09:41 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 16:09:41 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 16:09:41 user nova-compute[75080]:   <serial>05eb6419-fbfe-450f-9ff1-e9f28f02f261</serial>
Dec 05 16:09:41 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 16:09:41 user nova-compute[75080]: </disk>
Dec 05 16:09:41 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 16:09:41 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-96ee1ed4-0769-44b3-975b-e1cbe95ec7e9 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Successfully detached device vdb from instance a7d753a9-1cdc-469e-9704-c3e546d200d1 from the persistent domain config.
Dec 05 16:09:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-96ee1ed4-0769-44b3-975b-e1cbe95ec7e9 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a7d753a9-1cdc-469e-9704-c3e546d200d1 from the live domain config. {{(pid=75080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 16:09:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-96ee1ed4-0769-44b3-975b-e1cbe95ec7e9 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 16:09:41 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 16:09:41 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 16:09:41 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 16:09:41 user nova-compute[75080]:   <serial>05eb6419-fbfe-450f-9ff1-e9f28f02f261</serial>
Dec 05 16:09:41 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 16:09:41 user nova-compute[75080]: </disk>
Dec 05 16:09:41 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 16:09:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-96ee1ed4-0769-44b3-975b-e1cbe95ec7e9 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a7d753a9-1cdc-469e-9704-c3e546d200d1 {{(pid=75080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 16:09:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:09:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:09:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:09:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:09:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:09:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:09:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:09:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:09:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:09:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:09:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:10:01 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-96ee1ed4-0769-44b3-975b-e1cbe95ec7e9 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a7d753a9-1cdc-469e-9704-c3e546d200d1 is timed out.
Dec 05 16:10:01 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-96ee1ed4-0769-44b3-975b-e1cbe95ec7e9 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Successfully detached device vdb from instance a7d753a9-1cdc-469e-9704-c3e546d200d1 from the live domain config.
Dec 05 16:10:01 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96ee1ed4-0769-44b3-975b-e1cbe95ec7e9 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 16:10:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ee1ed4-0769-44b3-975b-e1cbe95ec7e9 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ndWGXcBS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 16:10:01 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-96ee1ed4-0769-44b3-975b-e1cbe95ec7e9 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 16:10:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-96ee1ed4-0769-44b3-975b-e1cbe95ec7e9 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 16:10:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-96ee1ed4-0769-44b3-975b-e1cbe95ec7e9 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 16:10:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:10:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:10:01 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d666a29-6cfa-4758-9a7a-cc3fd1bc81e2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:10:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ee1ed4-0769-44b3-975b-e1cbe95ec7e9 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 16:10:01 user nova-compute[75080]: No targets found.
Dec 05 16:10:01 user nova-compute[75080]: iSNS:
Dec 05 16:10:01 user nova-compute[75080]: No targets found.
Dec 05 16:10:01 user nova-compute[75080]: STATIC:
Dec 05 16:10:01 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261
Dec 05 16:10:01 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 16:10:01 user nova-compute[75080]:                 Iface Name: default
Dec 05 16:10:01 user nova-compute[75080]: FIRMWARE:
Dec 05 16:10:01 user nova-compute[75080]: No targets found.
Dec 05 16:10:01 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 16:10:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ee1ed4-0769-44b3-975b-e1cbe95ec7e9 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 16:10:01 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 16:10:01 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 16:10:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ee1ed4-0769-44b3-975b-e1cbe95ec7e9 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 16:10:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:10:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:10:01 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb597090-b719-4410-ba24-39f9f4093829]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:10:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:10:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:10:01 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d79aa6-b3db-4c26-8e1b-7318eaca2772]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:10:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ee1ed4-0769-44b3-975b-e1cbe95ec7e9 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261 (non-flash)
Dec 05 16:10:01 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 16:10:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ee1ed4-0769-44b3-975b-e1cbe95ec7e9 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261 (non-flash)
Dec 05 16:10:01 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 16:10:01 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ee1ed4-0769-44b3-975b-e1cbe95ec7e9 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f663833b6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261'): ({'sdb'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 16:10:01 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-96ee1ed4-0769-44b3-975b-e1cbe95ec7e9 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Removing single pathed devices sdb {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 16:10:01 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:10:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:10:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1070548-e837-4ca8-8db0-8527921600f7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:10:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:10:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:10:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2fd277-1ffd-4bb3-9bc9-08107485102d]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:10:02 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-96ee1ed4-0769-44b3-975b-e1cbe95ec7e9 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Flushing IO for device /dev/sdb {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 16:10:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:10:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:10:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3fee22-b6c0-47f7-b966-636dec7e2a36]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:10:02 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-96ee1ed4-0769-44b3-975b-e1cbe95ec7e9 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 16:10:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:10:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:10:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[16064790-e535-46b0-a942-c10f615ede6b]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:10:02 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-96ee1ed4-0769-44b3-975b-e1cbe95ec7e9 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 16:10:02 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-96ee1ed4-0769-44b3-975b-e1cbe95ec7e9 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 16:10:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ee1ed4-0769-44b3-975b-e1cbe95ec7e9 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 16:10:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:10:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:10:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd68a81d-48bd-4b9e-8712-70e77e81e1e0]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:10:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ee1ed4-0769-44b3-975b-e1cbe95ec7e9 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:10:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261 -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:10:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:10:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99801ef-1c86-4b36-9c23-d437998f3edc]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:10:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ee1ed4-0769-44b3-975b-e1cbe95ec7e9 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261, portal: 172.16.0.220,3260]
Dec 05 16:10:02 user nova-compute[75080]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261, portal: 172.16.0.220,3260] successful.
Dec 05 16:10:02 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:10:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261 -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:10:02 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05eb6419-fbfe-450f-9ff1-e9f28f02f261 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:10:02 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dfb118-ac59-4867-bdb4-ce00d58b63d9]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:10:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ee1ed4-0769-44b3-975b-e1cbe95ec7e9 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:10:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-96ee1ed4-0769-44b3-975b-e1cbe95ec7e9 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 16:10:02 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ee1ed4-0769-44b3-975b-e1cbe95ec7e9 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] <== disconnect_volume: return (269ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 16:10:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96ee1ed4-0769-44b3-975b-e1cbe95ec7e9 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 16:10:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:10:02 user nova-compute[75080]: DEBUG nova.objects.instance [None req-96ee1ed4-0769-44b3-975b-e1cbe95ec7e9 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lazy-loading 'flavor' on Instance uuid a7d753a9-1cdc-469e-9704-c3e546d200d1 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:10:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-96ee1ed4-0769-44b3-975b-e1cbe95ec7e9 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "a7d753a9-1cdc-469e-9704-c3e546d200d1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.636s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:10:04 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:10:07 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:10:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:10:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:10:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:10:07 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 16:10:07 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d753a9-1cdc-469e-9704-c3e546d200d1/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:10:07 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d753a9-1cdc-469e-9704-c3e546d200d1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:10:07 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d753a9-1cdc-469e-9704-c3e546d200d1/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:10:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:10:07 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7d753a9-1cdc-469e-9704-c3e546d200d1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:10:08 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:10:08 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:10:08 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=9038MB free_disk=24.952960968017578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 16:10:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:10:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:10:08 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance a7d753a9-1cdc-469e-9704-c3e546d200d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 16:10:08 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 16:10:08 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 16:10:08 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 16:10:08 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 16:10:08 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 16:10:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:10:09 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:10:10 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:10:11 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:10:11 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 16:10:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:10:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:10:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:10:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:10:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:10:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:10:15 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:10:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:10:18 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:10:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:10:23 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:10:23 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 16:10:23 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Rebuilding the list of instances to heal {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 16:10:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-a7d753a9-1cdc-469e-9704-c3e546d200d1" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 16:10:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-a7d753a9-1cdc-469e-9704-c3e546d200d1" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 16:10:23 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 16:10:23 user nova-compute[75080]: DEBUG nova.objects.instance [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lazy-loading 'info_cache' on Instance uuid a7d753a9-1cdc-469e-9704-c3e546d200d1 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:10:23 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Updating instance_info_cache with network_info: [{"id": "69abb397-14b2-463c-bf7b-4078d0a6708b", "address": "fa:16:3e:9a:9b:94", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69abb397-14", "ovs_interfaceid": "69abb397-14b2-463c-bf7b-4078d0a6708b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 16:10:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-a7d753a9-1cdc-469e-9704-c3e546d200d1" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 16:10:23 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 16:10:26 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:10:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:10:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e97779b9-af82-452c-9630-32a7319b80e2 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "a7d753a9-1cdc-469e-9704-c3e546d200d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:10:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e97779b9-af82-452c-9630-32a7319b80e2 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "a7d753a9-1cdc-469e-9704-c3e546d200d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:10:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e97779b9-af82-452c-9630-32a7319b80e2 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "a7d753a9-1cdc-469e-9704-c3e546d200d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:10:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e97779b9-af82-452c-9630-32a7319b80e2 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "a7d753a9-1cdc-469e-9704-c3e546d200d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:10:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e97779b9-af82-452c-9630-32a7319b80e2 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "a7d753a9-1cdc-469e-9704-c3e546d200d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:10:31 user nova-compute[75080]: INFO nova.compute.manager [None req-e97779b9-af82-452c-9630-32a7319b80e2 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Terminating instance
Dec 05 16:10:31 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e97779b9-af82-452c-9630-32a7319b80e2 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 16:10:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:10:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:10:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:10:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:10:31 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:10:32 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:10:32 user nova-compute[75080]: DEBUG nova.compute.manager [req-76bee1e1-7341-432f-b6e9-4f4f148b0825 req-a8ede59a-44c1-42c5-8436-eb38038ddcac service nova] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Received event network-vif-unplugged-69abb397-14b2-463c-bf7b-4078d0a6708b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 16:10:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-76bee1e1-7341-432f-b6e9-4f4f148b0825 req-a8ede59a-44c1-42c5-8436-eb38038ddcac service nova] Acquiring lock "a7d753a9-1cdc-469e-9704-c3e546d200d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:10:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-76bee1e1-7341-432f-b6e9-4f4f148b0825 req-a8ede59a-44c1-42c5-8436-eb38038ddcac service nova] Lock "a7d753a9-1cdc-469e-9704-c3e546d200d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:10:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-76bee1e1-7341-432f-b6e9-4f4f148b0825 req-a8ede59a-44c1-42c5-8436-eb38038ddcac service nova] Lock "a7d753a9-1cdc-469e-9704-c3e546d200d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:10:32 user nova-compute[75080]: DEBUG nova.compute.manager [req-76bee1e1-7341-432f-b6e9-4f4f148b0825 req-a8ede59a-44c1-42c5-8436-eb38038ddcac service nova] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] No waiting events found dispatching network-vif-unplugged-69abb397-14b2-463c-bf7b-4078d0a6708b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 16:10:32 user nova-compute[75080]: DEBUG nova.compute.manager [req-76bee1e1-7341-432f-b6e9-4f4f148b0825 req-a8ede59a-44c1-42c5-8436-eb38038ddcac service nova] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Received event network-vif-unplugged-69abb397-14b2-463c-bf7b-4078d0a6708b for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 16:10:32 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Instance destroyed successfully.
Dec 05 16:10:32 user nova-compute[75080]: DEBUG nova.objects.instance [None req-e97779b9-af82-452c-9630-32a7319b80e2 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lazy-loading 'resources' on Instance uuid a7d753a9-1cdc-469e-9704-c3e546d200d1 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:10:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-e97779b9-af82-452c-9630-32a7319b80e2 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T16:07:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1195235563',display_name='tempest-AttachVolumeNegativeTest-server-1195235563',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1195235563',id=51,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhHvo3gr+OdbguMwIPN39TKFdvtUh/246KmyYbGI/RdfBxuJR5spqAKOuPbiHyE39yfznAjGYC+QCIz+wxQSP/fGY49ESfQFmIb2jQeikEXvw0Qt4KvB8O7A8JHSgNXyg==',key_name='tempest-keypair-1857856985',keypairs=<?>,launch_index=0,launched_at=2023-12-05T16:07:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c62808660324e5aa23e8618f7d32ae4',ramdisk_id='',reservation_id='r-5j4isg0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-329346343',owner_user_name='tempest-AttachVolumeNegativeTest-329346343-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T16:07:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf39da2be27240a8b3e89e4484b9a99b',uuid=a7d753a9-1cdc-469e-9704-c3e546d200d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69abb397-14b2-463c-bf7b-4078d0a6708b", "address": "fa:16:3e:9a:9b:94", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69abb397-14", "ovs_interfaceid": "69abb397-14b2-463c-bf7b-4078d0a6708b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 16:10:32 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-e97779b9-af82-452c-9630-32a7319b80e2 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Converting VIF {"id": "69abb397-14b2-463c-bf7b-4078d0a6708b", "address": "fa:16:3e:9a:9b:94", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69abb397-14", "ovs_interfaceid": "69abb397-14b2-463c-bf7b-4078d0a6708b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 16:10:32 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-e97779b9-af82-452c-9630-32a7319b80e2 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:9b:94,bridge_name='br-int',has_traffic_filtering=True,id=69abb397-14b2-463c-bf7b-4078d0a6708b,network=Network(72069664-17d2-4963-9f71-559dd80df9ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69abb397-14') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 16:10:32 user nova-compute[75080]: DEBUG os_vif [None req-e97779b9-af82-452c-9630-32a7319b80e2 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:9b:94,bridge_name='br-int',has_traffic_filtering=True,id=69abb397-14b2-463c-bf7b-4078d0a6708b,network=Network(72069664-17d2-4963-9f71-559dd80df9ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69abb397-14') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 16:10:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:10:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69abb397-14, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 16:10:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:10:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:10:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:10:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=56042f78-4e5e-4d2f-a7b1-81f8104ee665) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 16:10:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:10:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:10:32 user nova-compute[75080]: INFO os_vif [None req-e97779b9-af82-452c-9630-32a7319b80e2 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:9b:94,bridge_name='br-int',has_traffic_filtering=True,id=69abb397-14b2-463c-bf7b-4078d0a6708b,network=Network(72069664-17d2-4963-9f71-559dd80df9ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69abb397-14')
Dec 05 16:10:32 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-e97779b9-af82-452c-9630-32a7319b80e2 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Deleting instance files /opt/stack/data/nova/instances/a7d753a9-1cdc-469e-9704-c3e546d200d1_del
Dec 05 16:10:32 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-e97779b9-af82-452c-9630-32a7319b80e2 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Deletion of /opt/stack/data/nova/instances/a7d753a9-1cdc-469e-9704-c3e546d200d1_del complete
Dec 05 16:10:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:10:32 user nova-compute[75080]: INFO nova.compute.manager [None req-e97779b9-af82-452c-9630-32a7319b80e2 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Took 0.84 seconds to destroy the instance on the hypervisor.
Dec 05 16:10:32 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-e97779b9-af82-452c-9630-32a7319b80e2 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 16:10:32 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 16:10:32 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 16:10:33 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 16:10:33 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Took 0.67 seconds to deallocate network for instance.
Dec 05 16:10:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e97779b9-af82-452c-9630-32a7319b80e2 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:10:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e97779b9-af82-452c-9630-32a7319b80e2 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:10:33 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-e97779b9-af82-452c-9630-32a7319b80e2 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 16:10:33 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-e97779b9-af82-452c-9630-32a7319b80e2 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 16:10:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e97779b9-af82-452c-9630-32a7319b80e2 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.124s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:10:33 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-e97779b9-af82-452c-9630-32a7319b80e2 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Deleted allocations for instance a7d753a9-1cdc-469e-9704-c3e546d200d1
Dec 05 16:10:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e97779b9-af82-452c-9630-32a7319b80e2 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "a7d753a9-1cdc-469e-9704-c3e546d200d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.827s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:10:34 user nova-compute[75080]: DEBUG nova.compute.manager [req-65a2232d-4140-484f-b5ea-0c7236714f7b req-69b08d47-4462-4f07-8a01-d0edba01dbc0 service nova] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Received event network-vif-plugged-69abb397-14b2-463c-bf7b-4078d0a6708b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 16:10:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-65a2232d-4140-484f-b5ea-0c7236714f7b req-69b08d47-4462-4f07-8a01-d0edba01dbc0 service nova] Acquiring lock "a7d753a9-1cdc-469e-9704-c3e546d200d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:10:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-65a2232d-4140-484f-b5ea-0c7236714f7b req-69b08d47-4462-4f07-8a01-d0edba01dbc0 service nova] Lock "a7d753a9-1cdc-469e-9704-c3e546d200d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:10:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-65a2232d-4140-484f-b5ea-0c7236714f7b req-69b08d47-4462-4f07-8a01-d0edba01dbc0 service nova] Lock "a7d753a9-1cdc-469e-9704-c3e546d200d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:10:34 user nova-compute[75080]: DEBUG nova.compute.manager [req-65a2232d-4140-484f-b5ea-0c7236714f7b req-69b08d47-4462-4f07-8a01-d0edba01dbc0 service nova] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] No waiting events found dispatching network-vif-plugged-69abb397-14b2-463c-bf7b-4078d0a6708b {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 16:10:34 user nova-compute[75080]: WARNING nova.compute.manager [req-65a2232d-4140-484f-b5ea-0c7236714f7b req-69b08d47-4462-4f07-8a01-d0edba01dbc0 service nova] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Received unexpected event network-vif-plugged-69abb397-14b2-463c-bf7b-4078d0a6708b for instance with vm_state deleted and task_state None.
Dec 05 16:10:34 user nova-compute[75080]: DEBUG nova.compute.manager [req-65a2232d-4140-484f-b5ea-0c7236714f7b req-69b08d47-4462-4f07-8a01-d0edba01dbc0 service nova] [instance: a7d753a9-1cdc-469e-9704-c3e546d200d1] Received event network-vif-deleted-69abb397-14b2-463c-bf7b-4078d0a6708b {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 16:10:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:10:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:10:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:10:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:10:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:10:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:10:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:10:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:10:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:10:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:11:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:11:06 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:11:07 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:11:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:11:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:11:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:11:07 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 16:11:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:11:07 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:11:07 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:11:07 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=9188MB free_disk=24.980243682861328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 16:11:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:11:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:11:07 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 16:11:07 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 16:11:07 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 16:11:07 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 16:11:08 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 16:11:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:11:10 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:11:12 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:11:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:11:13 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:11:13 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 16:11:16 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:11:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:11:19 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:11:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:11:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:11:23 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:11:23 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 16:11:23 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Rebuilding the list of instances to heal {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 16:11:23 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Didn't find any instances for network info cache update. {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 16:11:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "a03f4f91-50ff-41cb-bbc4-e22354e9e6ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:11:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "a03f4f91-50ff-41cb-bbc4-e22354e9e6ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:11:25 user nova-compute[75080]: DEBUG nova.compute.manager [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 16:11:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:11:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:11:26 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 16:11:26 user nova-compute[75080]: INFO nova.compute.claims [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Claim successful on node user
Dec 05 16:11:26 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 16:11:26 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 16:11:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.193s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:11:26 user nova-compute[75080]: DEBUG nova.compute.manager [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 16:11:26 user nova-compute[75080]: DEBUG nova.compute.manager [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 16:11:26 user nova-compute[75080]: DEBUG nova.network.neutron [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 16:11:26 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 16:11:26 user nova-compute[75080]: DEBUG nova.compute.manager [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 16:11:26 user nova-compute[75080]: DEBUG nova.policy [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bf39da2be27240a8b3e89e4484b9a99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c62808660324e5aa23e8618f7d32ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 16:11:26 user nova-compute[75080]: DEBUG nova.compute.manager [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 16:11:26 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 16:11:26 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Creating image(s)
Dec 05 16:11:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "/opt/stack/data/nova/instances/a03f4f91-50ff-41cb-bbc4-e22354e9e6ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:11:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "/opt/stack/data/nova/instances/a03f4f91-50ff-41cb-bbc4-e22354e9e6ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:11:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "/opt/stack/data/nova/instances/a03f4f91-50ff-41cb-bbc4-e22354e9e6ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:11:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:11:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.176s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:11:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:11:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:11:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:11:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.170s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:11:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/a03f4f91-50ff-41cb-bbc4-e22354e9e6ca/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:11:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/a03f4f91-50ff-41cb-bbc4-e22354e9e6ca/disk 1073741824" returned: 0 in 0.048s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:11:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:11:26 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:11:27 user nova-compute[75080]: DEBUG nova.network.neutron [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Successfully created port: a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 16:11:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.177s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:11:27 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a03f4f91-50ff-41cb-bbc4-e22354e9e6ca/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 16:11:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a03f4f91-50ff-41cb-bbc4-e22354e9e6ca/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:11:27 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a03f4f91-50ff-41cb-bbc4-e22354e9e6ca/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:11:27 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Cannot resize image /opt/stack/data/nova/instances/a03f4f91-50ff-41cb-bbc4-e22354e9e6ca/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 16:11:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 16:11:27 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Ensure instance console log exists: /opt/stack/data/nova/instances/a03f4f91-50ff-41cb-bbc4-e22354e9e6ca/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 16:11:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:11:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:11:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:11:27 user nova-compute[75080]: DEBUG nova.network.neutron [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Successfully updated port: a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 16:11:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "refresh_cache-a03f4f91-50ff-41cb-bbc4-e22354e9e6ca" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 16:11:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquired lock "refresh_cache-a03f4f91-50ff-41cb-bbc4-e22354e9e6ca" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 16:11:27 user nova-compute[75080]: DEBUG nova.network.neutron [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 16:11:27 user nova-compute[75080]: DEBUG nova.compute.manager [req-5db62e28-f739-48b4-af63-89fb52e938fe req-a51ce892-9570-4dfa-a5a4-a131324b5870 service nova] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Received event network-changed-a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 16:11:27 user nova-compute[75080]: DEBUG nova.compute.manager [req-5db62e28-f739-48b4-af63-89fb52e938fe req-a51ce892-9570-4dfa-a5a4-a131324b5870 service nova] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Refreshing instance network info cache due to event network-changed-a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 16:11:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5db62e28-f739-48b4-af63-89fb52e938fe req-a51ce892-9570-4dfa-a5a4-a131324b5870 service nova] Acquiring lock "refresh_cache-a03f4f91-50ff-41cb-bbc4-e22354e9e6ca" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 16:11:27 user nova-compute[75080]: DEBUG nova.network.neutron [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 16:11:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:11:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:11:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:11:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:11:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:11:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG nova.network.neutron [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Updating instance_info_cache with network_info: [{"id": "a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc", "address": "fa:16:3e:cc:cf:8e", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65f82eb-1f", "ovs_interfaceid": "a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Releasing lock "refresh_cache-a03f4f91-50ff-41cb-bbc4-e22354e9e6ca" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG nova.compute.manager [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Instance network_info: |[{"id": "a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc", "address": "fa:16:3e:cc:cf:8e", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65f82eb-1f", "ovs_interfaceid": "a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5db62e28-f739-48b4-af63-89fb52e938fe req-a51ce892-9570-4dfa-a5a4-a131324b5870 service nova] Acquired lock "refresh_cache-a03f4f91-50ff-41cb-bbc4-e22354e9e6ca" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG nova.network.neutron [req-5db62e28-f739-48b4-af63-89fb52e938fe req-a51ce892-9570-4dfa-a5a4-a131324b5870 service nova] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Refreshing network info cache for port a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Start _get_guest_xml network_info=[{"id": "a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc", "address": "fa:16:3e:cc:cf:8e", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65f82eb-1f", "ovs_interfaceid": "a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 16:11:28 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:11:28 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:11:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T16:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1580857923',display_name='tempest-AttachVolumeNegativeTest-server-1580857923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1580857923',id=52,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBElQpErReoHu1DmeQCPeLEpvDZCoHjgzXGpnPwy9PN0eYlNCjKx97CwCvxPEwQ8njYP6zHwdmglKi/RVdbuLmC0TwzDUe7ki422qgiKh//AmYhHc5ZJP32VBCsqtKhBcJA==',key_name='tempest-keypair-1372867127',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c62808660324e5aa23e8618f7d32ae4',ramdisk_id='',reservation_id='r-kv47e4fr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-329346343',owner_user_name='tempest-AttachVolumeNegativeTest-329346343-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T16:11:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf39da2be27240a8b3e89e4484b9a99b',uuid=a03f4f91-50ff-41cb-bbc4-e22354e9e6ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc", "address": "fa:16:3e:cc:cf:8e", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65f82eb-1f", "ovs_interfaceid": "a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Converting VIF {"id": "a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc", "address": "fa:16:3e:cc:cf:8e", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65f82eb-1f", "ovs_interfaceid": "a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:cf:8e,bridge_name='br-int',has_traffic_filtering=True,id=a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc,network=Network(72069664-17d2-4963-9f71-559dd80df9ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65f82eb-1f') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG nova.objects.instance [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lazy-loading 'pci_devices' on Instance uuid a03f4f91-50ff-41cb-bbc4-e22354e9e6ca {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] End _get_guest_xml xml=<domain type="kvm">
Dec 05 16:11:28 user nova-compute[75080]:   <uuid>a03f4f91-50ff-41cb-bbc4-e22354e9e6ca</uuid>
Dec 05 16:11:28 user nova-compute[75080]:   <name>instance-00000034</name>
Dec 05 16:11:28 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 16:11:28 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 16:11:28 user nova-compute[75080]:   <metadata>
Dec 05 16:11:28 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 16:11:28 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 16:11:28 user nova-compute[75080]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1580857923</nova:name>
Dec 05 16:11:28 user nova-compute[75080]:       <nova:creationTime>2023-12-05 16:11:28</nova:creationTime>
Dec 05 16:11:28 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 16:11:28 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 16:11:28 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 16:11:28 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 16:11:28 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 16:11:28 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 16:11:28 user nova-compute[75080]:       </nova:flavor>
Dec 05 16:11:28 user nova-compute[75080]:       <nova:owner>
Dec 05 16:11:28 user nova-compute[75080]:         <nova:user uuid="bf39da2be27240a8b3e89e4484b9a99b">tempest-AttachVolumeNegativeTest-329346343-project-member</nova:user>
Dec 05 16:11:28 user nova-compute[75080]:         <nova:project uuid="1c62808660324e5aa23e8618f7d32ae4">tempest-AttachVolumeNegativeTest-329346343</nova:project>
Dec 05 16:11:28 user nova-compute[75080]:       </nova:owner>
Dec 05 16:11:28 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 16:11:28 user nova-compute[75080]:       <nova:ports>
Dec 05 16:11:28 user nova-compute[75080]:         <nova:port uuid="a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc">
Dec 05 16:11:28 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 05 16:11:28 user nova-compute[75080]:         </nova:port>
Dec 05 16:11:28 user nova-compute[75080]:       </nova:ports>
Dec 05 16:11:28 user nova-compute[75080]:     </nova:instance>
Dec 05 16:11:28 user nova-compute[75080]:   </metadata>
Dec 05 16:11:28 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 16:11:28 user nova-compute[75080]:     <system>
Dec 05 16:11:28 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 16:11:28 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 16:11:28 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 16:11:28 user nova-compute[75080]:       <entry name="serial">a03f4f91-50ff-41cb-bbc4-e22354e9e6ca</entry>
Dec 05 16:11:28 user nova-compute[75080]:       <entry name="uuid">a03f4f91-50ff-41cb-bbc4-e22354e9e6ca</entry>
Dec 05 16:11:28 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 16:11:28 user nova-compute[75080]:     </system>
Dec 05 16:11:28 user nova-compute[75080]:   </sysinfo>
Dec 05 16:11:28 user nova-compute[75080]:   <os>
Dec 05 16:11:28 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 16:11:28 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 16:11:28 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 16:11:28 user nova-compute[75080]:   </os>
Dec 05 16:11:28 user nova-compute[75080]:   <features>
Dec 05 16:11:28 user nova-compute[75080]:     <acpi/>
Dec 05 16:11:28 user nova-compute[75080]:     <apic/>
Dec 05 16:11:28 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 16:11:28 user nova-compute[75080]:   </features>
Dec 05 16:11:28 user nova-compute[75080]:   <clock offset="utc">
Dec 05 16:11:28 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 16:11:28 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 16:11:28 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 16:11:28 user nova-compute[75080]:   </clock>
Dec 05 16:11:28 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 16:11:28 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 16:11:28 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 16:11:28 user nova-compute[75080]:   </cpu>
Dec 05 16:11:28 user nova-compute[75080]:   <devices>
Dec 05 16:11:28 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 16:11:28 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 16:11:28 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/a03f4f91-50ff-41cb-bbc4-e22354e9e6ca/disk"/>
Dec 05 16:11:28 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 16:11:28 user nova-compute[75080]:     </disk>
Dec 05 16:11:28 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 16:11:28 user nova-compute[75080]:       <mac address="fa:16:3e:cc:cf:8e"/>
Dec 05 16:11:28 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 16:11:28 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 16:11:28 user nova-compute[75080]:       <target dev="tapa65f82eb-1f"/>
Dec 05 16:11:28 user nova-compute[75080]:     </interface>
Dec 05 16:11:28 user nova-compute[75080]:     <serial type="pty">
Dec 05 16:11:28 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/a03f4f91-50ff-41cb-bbc4-e22354e9e6ca/console.log" append="off"/>
Dec 05 16:11:28 user nova-compute[75080]:     </serial>
Dec 05 16:11:28 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 16:11:28 user nova-compute[75080]:     <video>
Dec 05 16:11:28 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 16:11:28 user nova-compute[75080]:     </video>
Dec 05 16:11:28 user nova-compute[75080]:     <rng model="virtio">
Dec 05 16:11:28 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 16:11:28 user nova-compute[75080]:     </rng>
Dec 05 16:11:28 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 16:11:28 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 16:11:28 user nova-compute[75080]:       <stats period="10"/>
Dec 05 16:11:28 user nova-compute[75080]:     </memballoon>
Dec 05 16:11:28 user nova-compute[75080]:   </devices>
Dec 05 16:11:28 user nova-compute[75080]: </domain>
Dec 05 16:11:28 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T16:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1580857923',display_name='tempest-AttachVolumeNegativeTest-server-1580857923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1580857923',id=52,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBElQpErReoHu1DmeQCPeLEpvDZCoHjgzXGpnPwy9PN0eYlNCjKx97CwCvxPEwQ8njYP6zHwdmglKi/RVdbuLmC0TwzDUe7ki422qgiKh//AmYhHc5ZJP32VBCsqtKhBcJA==',key_name='tempest-keypair-1372867127',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c62808660324e5aa23e8618f7d32ae4',ramdisk_id='',reservation_id='r-kv47e4fr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-329346343',owner_user_name='tempest-AttachVolumeNegativeTest-329346343-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T16:11:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf39da2be27240a8b3e89e4484b9a99b',uuid=a03f4f91-50ff-41cb-bbc4-e22354e9e6ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc", "address": "fa:16:3e:cc:cf:8e", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65f82eb-1f", "ovs_interfaceid": "a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Converting VIF {"id": "a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc", "address": "fa:16:3e:cc:cf:8e", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65f82eb-1f", "ovs_interfaceid": "a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:cf:8e,bridge_name='br-int',has_traffic_filtering=True,id=a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc,network=Network(72069664-17d2-4963-9f71-559dd80df9ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65f82eb-1f') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG os_vif [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:cf:8e,bridge_name='br-int',has_traffic_filtering=True,id=a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc,network=Network(72069664-17d2-4963-9f71-559dd80df9ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65f82eb-1f') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5717b750-6cf1-563f-a5d6-7a9a2d3b5486', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa65f82eb-1f, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa65f82eb-1f, col_values=(('qos', UUID('5f63cc93-09b8-48b5-880b-1396e291225a')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa65f82eb-1f, col_values=(('external_ids', {'iface-id': 'a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:cf:8e', 'vm-uuid': 'a03f4f91-50ff-41cb-bbc4-e22354e9e6ca'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:11:28 user nova-compute[75080]: INFO os_vif [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:cf:8e,bridge_name='br-int',has_traffic_filtering=True,id=a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc,network=Network(72069664-17d2-4963-9f71-559dd80df9ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65f82eb-1f')
Dec 05 16:11:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] No VIF found with MAC fa:16:3e:cc:cf:8e, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG nova.network.neutron [req-5db62e28-f739-48b4-af63-89fb52e938fe req-a51ce892-9570-4dfa-a5a4-a131324b5870 service nova] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Updated VIF entry in instance network info cache for port a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG nova.network.neutron [req-5db62e28-f739-48b4-af63-89fb52e938fe req-a51ce892-9570-4dfa-a5a4-a131324b5870 service nova] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Updating instance_info_cache with network_info: [{"id": "a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc", "address": "fa:16:3e:cc:cf:8e", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65f82eb-1f", "ovs_interfaceid": "a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:11:28 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5db62e28-f739-48b4-af63-89fb52e938fe req-a51ce892-9570-4dfa-a5a4-a131324b5870 service nova] Releasing lock "refresh_cache-a03f4f91-50ff-41cb-bbc4-e22354e9e6ca" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 16:11:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:11:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:11:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:11:29 user nova-compute[75080]: DEBUG nova.compute.manager [req-17c45efa-01cc-4f10-b385-cbbdaaa28c9e req-a6b1f480-a08a-4ec7-89f6-27f67c78937a service nova] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Received event network-vif-plugged-a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 16:11:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-17c45efa-01cc-4f10-b385-cbbdaaa28c9e req-a6b1f480-a08a-4ec7-89f6-27f67c78937a service nova] Acquiring lock "a03f4f91-50ff-41cb-bbc4-e22354e9e6ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:11:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-17c45efa-01cc-4f10-b385-cbbdaaa28c9e req-a6b1f480-a08a-4ec7-89f6-27f67c78937a service nova] Lock "a03f4f91-50ff-41cb-bbc4-e22354e9e6ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:11:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-17c45efa-01cc-4f10-b385-cbbdaaa28c9e req-a6b1f480-a08a-4ec7-89f6-27f67c78937a service nova] Lock "a03f4f91-50ff-41cb-bbc4-e22354e9e6ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:11:29 user nova-compute[75080]: DEBUG nova.compute.manager [req-17c45efa-01cc-4f10-b385-cbbdaaa28c9e req-a6b1f480-a08a-4ec7-89f6-27f67c78937a service nova] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] No waiting events found dispatching network-vif-plugged-a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 16:11:29 user nova-compute[75080]: WARNING nova.compute.manager [req-17c45efa-01cc-4f10-b385-cbbdaaa28c9e req-a6b1f480-a08a-4ec7-89f6-27f67c78937a service nova] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Received unexpected event network-vif-plugged-a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc for instance with vm_state building and task_state spawning.
Dec 05 16:11:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:11:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:11:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:11:31 user nova-compute[75080]: DEBUG nova.compute.manager [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 16:11:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 16:11:31 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Instance spawned successfully.
Dec 05 16:11:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 16:11:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 16:11:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 16:11:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 16:11:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 16:11:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 16:11:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 16:11:31 user nova-compute[75080]: INFO nova.compute.manager [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Took 5.14 seconds to spawn the instance on the hypervisor.
Dec 05 16:11:31 user nova-compute[75080]: DEBUG nova.compute.manager [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 16:11:31 user nova-compute[75080]: INFO nova.compute.manager [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Took 5.73 seconds to build instance.
Dec 05 16:11:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-d052b1b7-fd32-4fad-9245-cdc24acc09b1 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "a03f4f91-50ff-41cb-bbc4-e22354e9e6ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.829s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:11:31 user nova-compute[75080]: DEBUG nova.compute.manager [req-9c1bfce8-0687-4228-8dd0-095ff26ebf3d req-6ed966cb-a3ae-46e9-a795-617fca67594f service nova] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Received event network-vif-plugged-a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 16:11:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9c1bfce8-0687-4228-8dd0-095ff26ebf3d req-6ed966cb-a3ae-46e9-a795-617fca67594f service nova] Acquiring lock "a03f4f91-50ff-41cb-bbc4-e22354e9e6ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:11:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9c1bfce8-0687-4228-8dd0-095ff26ebf3d req-6ed966cb-a3ae-46e9-a795-617fca67594f service nova] Lock "a03f4f91-50ff-41cb-bbc4-e22354e9e6ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:11:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-9c1bfce8-0687-4228-8dd0-095ff26ebf3d req-6ed966cb-a3ae-46e9-a795-617fca67594f service nova] Lock "a03f4f91-50ff-41cb-bbc4-e22354e9e6ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:11:31 user nova-compute[75080]: DEBUG nova.compute.manager [req-9c1bfce8-0687-4228-8dd0-095ff26ebf3d req-6ed966cb-a3ae-46e9-a795-617fca67594f service nova] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] No waiting events found dispatching network-vif-plugged-a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 16:11:31 user nova-compute[75080]: WARNING nova.compute.manager [req-9c1bfce8-0687-4228-8dd0-095ff26ebf3d req-6ed966cb-a3ae-46e9-a795-617fca67594f service nova] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Received unexpected event network-vif-plugged-a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc for instance with vm_state active and task_state None.
Dec 05 16:11:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:11:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:11:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:11:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:11:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:11:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:11:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:11:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:11:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:11:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:11:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:11:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:11:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:11:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:11:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:12:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:12:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:12:06 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:12:07 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:12:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:12:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:12:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:12:07 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 16:12:07 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a03f4f91-50ff-41cb-bbc4-e22354e9e6ca/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:12:07 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a03f4f91-50ff-41cb-bbc4-e22354e9e6ca/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:12:07 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a03f4f91-50ff-41cb-bbc4-e22354e9e6ca/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:12:07 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a03f4f91-50ff-41cb-bbc4-e22354e9e6ca/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:12:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:12:08 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:12:08 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:12:08 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=9019MB free_disk=24.95047378540039GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 16:12:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:12:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:12:08 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance a03f4f91-50ff-41cb-bbc4-e22354e9e6ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 16:12:08 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 16:12:08 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 16:12:08 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 16:12:08 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 16:12:08 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 16:12:08 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:12:12 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:12:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:12:13 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:12:15 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:12:15 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 16:12:17 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:12:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:12:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:12:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:12:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:12:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:12:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:12:21 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:12:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:12:25 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:12:25 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 16:12:25 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Rebuilding the list of instances to heal {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 16:12:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-a03f4f91-50ff-41cb-bbc4-e22354e9e6ca" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 16:12:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-a03f4f91-50ff-41cb-bbc4-e22354e9e6ca" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 16:12:25 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 16:12:25 user nova-compute[75080]: DEBUG nova.objects.instance [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lazy-loading 'info_cache' on Instance uuid a03f4f91-50ff-41cb-bbc4-e22354e9e6ca {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:12:25 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Updating instance_info_cache with network_info: [{"id": "a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc", "address": "fa:16:3e:cc:cf:8e", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65f82eb-1f", "ovs_interfaceid": "a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 16:12:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-a03f4f91-50ff-41cb-bbc4-e22354e9e6ca" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 16:12:25 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 16:12:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:12:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:12:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:12:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:12:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:12:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:12:30 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:12:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:12:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:12:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:12:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:12:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:12:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:12:37 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:12:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:12:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:12:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:12:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:12:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:12:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:12:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:12:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:12:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:12:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:12:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:12:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:12:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:12:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:12:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:12:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:12:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:12:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:12:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:12:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:13:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:13:06 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:13:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:13:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:13:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:13:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:13:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:13:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:13:09 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:13:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:13:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:13:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:13:09 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 16:13:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a03f4f91-50ff-41cb-bbc4-e22354e9e6ca/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:13:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a03f4f91-50ff-41cb-bbc4-e22354e9e6ca/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:13:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a03f4f91-50ff-41cb-bbc4-e22354e9e6ca/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:13:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a03f4f91-50ff-41cb-bbc4-e22354e9e6ca/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:13:10 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:13:10 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:13:10 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=9051MB free_disk=24.949932098388672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 16:13:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:13:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:13:10 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance a03f4f91-50ff-41cb-bbc4-e22354e9e6ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 16:13:10 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 16:13:10 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 16:13:10 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 16:13:10 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 16:13:10 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 16:13:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.158s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:13:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:13:13 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:13:13 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:13:15 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:13:15 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 16:13:16 user nova-compute[75080]: DEBUG nova.compute.manager [req-e29185d8-1fe7-44fa-8fe0-83ba3b4f27f3 req-503529b9-2e4e-4c69-a783-7a9e0ed353d0 service nova] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Received event network-changed-a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 16:13:16 user nova-compute[75080]: DEBUG nova.compute.manager [req-e29185d8-1fe7-44fa-8fe0-83ba3b4f27f3 req-503529b9-2e4e-4c69-a783-7a9e0ed353d0 service nova] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Refreshing instance network info cache due to event network-changed-a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 16:13:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-e29185d8-1fe7-44fa-8fe0-83ba3b4f27f3 req-503529b9-2e4e-4c69-a783-7a9e0ed353d0 service nova] Acquiring lock "refresh_cache-a03f4f91-50ff-41cb-bbc4-e22354e9e6ca" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 16:13:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-e29185d8-1fe7-44fa-8fe0-83ba3b4f27f3 req-503529b9-2e4e-4c69-a783-7a9e0ed353d0 service nova] Acquired lock "refresh_cache-a03f4f91-50ff-41cb-bbc4-e22354e9e6ca" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 16:13:16 user nova-compute[75080]: DEBUG nova.network.neutron [req-e29185d8-1fe7-44fa-8fe0-83ba3b4f27f3 req-503529b9-2e4e-4c69-a783-7a9e0ed353d0 service nova] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Refreshing network info cache for port a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 16:13:17 user nova-compute[75080]: DEBUG nova.network.neutron [req-e29185d8-1fe7-44fa-8fe0-83ba3b4f27f3 req-503529b9-2e4e-4c69-a783-7a9e0ed353d0 service nova] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Updated VIF entry in instance network info cache for port a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 16:13:17 user nova-compute[75080]: DEBUG nova.network.neutron [req-e29185d8-1fe7-44fa-8fe0-83ba3b4f27f3 req-503529b9-2e4e-4c69-a783-7a9e0ed353d0 service nova] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Updating instance_info_cache with network_info: [{"id": "a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc", "address": "fa:16:3e:cc:cf:8e", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65f82eb-1f", "ovs_interfaceid": "a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 16:13:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-e29185d8-1fe7-44fa-8fe0-83ba3b4f27f3 req-503529b9-2e4e-4c69-a783-7a9e0ed353d0 service nova] Releasing lock "refresh_cache-a03f4f91-50ff-41cb-bbc4-e22354e9e6ca" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 16:13:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:13:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:13:18 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:13:18 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:13:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "a03f4f91-50ff-41cb-bbc4-e22354e9e6ca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:13:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "a03f4f91-50ff-41cb-bbc4-e22354e9e6ca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:13:19 user nova-compute[75080]: DEBUG nova.objects.instance [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lazy-loading 'flavor' on Instance uuid a03f4f91-50ff-41cb-bbc4-e22354e9e6ca {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:13:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "a03f4f91-50ff-41cb-bbc4-e22354e9e6ca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:13:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "a03f4f91-50ff-41cb-bbc4-e22354e9e6ca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:13:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "a03f4f91-50ff-41cb-bbc4-e22354e9e6ca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:13:19 user nova-compute[75080]: INFO nova.compute.manager [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Attaching volume c2532591-0c72-4b2a-972e-eb53e92998a5 to /dev/vdb
Dec 05 16:13:19 user nova-compute[75080]: DEBUG os_brick.utils [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 16:13:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:13:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:13:19 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fae164-24b0-470f-8ea6-d933bba5ae1f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:13:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:13:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:13:19 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[949bcc6e-d536-4f54-be94-6bf5e045bf0d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:13:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:13:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:13:19 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1b58ae-9727-495d-b630-2dc3e4156b60]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:13:19 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f14620a-2e3f-44d4-8a0e-d90ff078cb9b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:13:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:13:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 16:13:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 16:13:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:13:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 16:13:19 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 16:13:19 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b0470f-e8fa-4f49-8177-3d476a0a7f2c]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:13:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 16:13:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 16:13:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 16:13:19 user nova-compute[75080]: DEBUG os_brick.utils [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 16:13:19 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Updating existing volume attachment record: fe5ee7d2-17b0-4da5-9bad-bec659ddf0a4 {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 16:13:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:13:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:13:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:13:26 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:13:26 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 16:13:26 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Rebuilding the list of instances to heal {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 16:13:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-a03f4f91-50ff-41cb-bbc4-e22354e9e6ca" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 16:13:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-a03f4f91-50ff-41cb-bbc4-e22354e9e6ca" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 16:13:26 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 16:13:26 user nova-compute[75080]: DEBUG nova.objects.instance [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lazy-loading 'info_cache' on Instance uuid a03f4f91-50ff-41cb-bbc4-e22354e9e6ca {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:13:27 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Updating instance_info_cache with network_info: [{"id": "a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc", "address": "fa:16:3e:cc:cf:8e", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65f82eb-1f", "ovs_interfaceid": "a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 16:13:27 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-a03f4f91-50ff-41cb-bbc4-e22354e9e6ca" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 16:13:27 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EGHftUDr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 16:13:28 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 16:13:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 16:13:28 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 16:13:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 16:13:28 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 16:13:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5 -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39e7859-0e4e-485c-ad9f-beb6d07ff395]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 16:13:28 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0ee035-b48b-4f16-bf39-485b170ddf59]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5] added
Dec 05 16:13:28 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7780825e-dba6-4dd4-8d11-49e37b79354e]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbb778d-5f10-404b-aeee-4bd5e318ada9]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EGHftUDr {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EGHftUDr" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc73799-f43b-4c57-800b-3032c1f6e8e1]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EGHftUDr'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b3debe-90f2-44be-9bb0-a0a061afebb1]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e721a873-43c8-48fe-9d92-712bbb22c6f8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 05 16:13:28 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 05 16:13:28 user nova-compute[75080]:  {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 16:13:28 user nova-compute[75080]: WARNING os_brick.initiator.connectors.iscsi [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 05 16:13:28 user nova-compute[75080]: 
Dec 05 16:13:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5 -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b71f0dc-b23b-48c4-a06c-7fb03e7b4ab3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5, portal: 172.16.0.220,3260]
Dec 05 16:13:28 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5, portal: 172.16.0.220,3260] successful.
Dec 05 16:13:28 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49d27ac-14b6-40dc-9c28-08b9bdcd52f8]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f1ac61-fbe6-4af3-90f8-ed6db70f7c4b]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5 (non-flash)
Dec 05 16:13:28 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5 (non-flash)
Dec 05 16:13:28 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.226s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7195c8bb-75e7-47ac-b9aa-5d372e3aa249]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 16:13:28 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EGHftUDr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 16:13:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.256s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 16:13:29 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] <== connect_volume: return (1258ms) {'type': 'block', 'scsi_wwn': '26165653433356430', 'path': '/dev/sdb'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 16:13:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165653433356430', 'path': '/dev/sdb'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 16:13:29 user nova-compute[75080]: DEBUG nova.objects.instance [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lazy-loading 'flavor' on Instance uuid a03f4f91-50ff-41cb-bbc4-e22354e9e6ca {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:13:29 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 16:13:29 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 16:13:29 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 16:13:29 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 16:13:29 user nova-compute[75080]:   <serial>c2532591-0c72-4b2a-972e-eb53e92998a5</serial>
Dec 05 16:13:29 user nova-compute[75080]: </disk>
Dec 05 16:13:29 user nova-compute[75080]:  {{(pid=75080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 16:13:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 16:13:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 16:13:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] No VIF found with MAC fa:16:3e:cc:cf:8e, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 16:13:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-64999beb-bb6e-4449-9c18-45642e0776d0 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "a03f4f91-50ff-41cb-bbc4-e22354e9e6ca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.003s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:13:31 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:13:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-bae051c3-82e9-4881-9093-3972c797f064 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "a03f4f91-50ff-41cb-bbc4-e22354e9e6ca" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:13:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-bae051c3-82e9-4881-9093-3972c797f064 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "a03f4f91-50ff-41cb-bbc4-e22354e9e6ca" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:13:31 user nova-compute[75080]: INFO nova.compute.manager [None req-bae051c3-82e9-4881-9093-3972c797f064 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Detaching volume c2532591-0c72-4b2a-972e-eb53e92998a5
Dec 05 16:13:31 user nova-compute[75080]: INFO nova.virt.block_device [None req-bae051c3-82e9-4881-9093-3972c797f064 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Attempting to driver detach volume c2532591-0c72-4b2a-972e-eb53e92998a5 from mountpoint /dev/vdb
Dec 05 16:13:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-bae051c3-82e9-4881-9093-3972c797f064 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Attempting to detach device vdb from instance a03f4f91-50ff-41cb-bbc4-e22354e9e6ca from the persistent domain config. {{(pid=75080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 16:13:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-bae051c3-82e9-4881-9093-3972c797f064 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 16:13:31 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 16:13:31 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 16:13:31 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 16:13:31 user nova-compute[75080]:   <serial>c2532591-0c72-4b2a-972e-eb53e92998a5</serial>
Dec 05 16:13:31 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 16:13:31 user nova-compute[75080]: </disk>
Dec 05 16:13:31 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 16:13:31 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-bae051c3-82e9-4881-9093-3972c797f064 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Successfully detached device vdb from instance a03f4f91-50ff-41cb-bbc4-e22354e9e6ca from the persistent domain config.
Dec 05 16:13:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-bae051c3-82e9-4881-9093-3972c797f064 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a03f4f91-50ff-41cb-bbc4-e22354e9e6ca from the live domain config. {{(pid=75080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 16:13:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-bae051c3-82e9-4881-9093-3972c797f064 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 16:13:31 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 16:13:31 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 16:13:31 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 16:13:31 user nova-compute[75080]:   <serial>c2532591-0c72-4b2a-972e-eb53e92998a5</serial>
Dec 05 16:13:31 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 16:13:31 user nova-compute[75080]: </disk>
Dec 05 16:13:31 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 16:13:32 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-bae051c3-82e9-4881-9093-3972c797f064 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a03f4f91-50ff-41cb-bbc4-e22354e9e6ca {{(pid=75080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 16:13:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:13:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:13:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:13:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:13:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:13:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:13:52 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-bae051c3-82e9-4881-9093-3972c797f064 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a03f4f91-50ff-41cb-bbc4-e22354e9e6ca is timed out.
Dec 05 16:13:52 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-bae051c3-82e9-4881-9093-3972c797f064 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Successfully detached device vdb from instance a03f4f91-50ff-41cb-bbc4-e22354e9e6ca from the live domain config.
Dec 05 16:13:52 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bae051c3-82e9-4881-9093-3972c797f064 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae051c3-82e9-4881-9093-3972c797f064 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EGHftUDr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 16:13:52 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-bae051c3-82e9-4881-9093-3972c797f064 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 16:13:52 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-bae051c3-82e9-4881-9093-3972c797f064 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-bae051c3-82e9-4881-9093-3972c797f064 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35488cd-78fb-4000-9517-f5d0d0b3b504]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae051c3-82e9-4881-9093-3972c797f064 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 16:13:52 user nova-compute[75080]: No targets found.
Dec 05 16:13:52 user nova-compute[75080]: iSNS:
Dec 05 16:13:52 user nova-compute[75080]: No targets found.
Dec 05 16:13:52 user nova-compute[75080]: STATIC:
Dec 05 16:13:52 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5
Dec 05 16:13:52 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 16:13:52 user nova-compute[75080]:                 Iface Name: default
Dec 05 16:13:52 user nova-compute[75080]: FIRMWARE:
Dec 05 16:13:52 user nova-compute[75080]: No targets found.
Dec 05 16:13:52 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae051c3-82e9-4881-9093-3972c797f064 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 16:13:52 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 16:13:52 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae051c3-82e9-4881-9093-3972c797f064 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[930c6c7c-dbc3-4460-80f9-b70cbb9a91cf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a24739-f3d3-477a-aaf3-a26920836f85]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae051c3-82e9-4881-9093-3972c797f064 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5 (non-flash)
Dec 05 16:13:52 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae051c3-82e9-4881-9093-3972c797f064 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5 (non-flash)
Dec 05 16:13:52 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae051c3-82e9-4881-9093-3972c797f064 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6638199510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5'): ({'sdb'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-bae051c3-82e9-4881-9093-3972c797f064 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Removing single pathed devices sdb {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d68089f-d76e-4eb0-bb0a-27b4bfab35a2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d77cdb5-e6f2-4cae-8842-f431f0ae9b7e]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-bae051c3-82e9-4881-9093-3972c797f064 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Flushing IO for device /dev/sdb {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fec4220-90da-4289-af00-8aeb1c2df7bb]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-bae051c3-82e9-4881-9093-3972c797f064 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b36b7c5-333f-4620-995b-3a6f6991e14a]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-bae051c3-82e9-4881-9093-3972c797f064 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-bae051c3-82e9-4881-9093-3972c797f064 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae051c3-82e9-4881-9093-3972c797f064 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd27bce4-e01a-45be-9d32-d6a0b75b672e]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae051c3-82e9-4881-9093-3972c797f064 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5 -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7bc790-23c2-4073-a716-7a5604931d1b]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae051c3-82e9-4881-9093-3972c797f064 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5, portal: 172.16.0.220,3260]
Dec 05 16:13:52 user nova-compute[75080]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5, portal: 172.16.0.220,3260] successful.
Dec 05 16:13:52 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5 -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2532591-0c72-4b2a-972e-eb53e92998a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[61dad6c6-77ba-4c62-b7c3-1e5c5ee14e83]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae051c3-82e9-4881-9093-3972c797f064 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-bae051c3-82e9-4881-9093-3972c797f064 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae051c3-82e9-4881-9093-3972c797f064 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] <== disconnect_volume: return (276ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 16:13:52 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bae051c3-82e9-4881-9093-3972c797f064 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 16:13:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:13:53 user nova-compute[75080]: DEBUG nova.objects.instance [None req-bae051c3-82e9-4881-9093-3972c797f064 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lazy-loading 'flavor' on Instance uuid a03f4f91-50ff-41cb-bbc4-e22354e9e6ca {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:13:53 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-bae051c3-82e9-4881-9093-3972c797f064 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "a03f4f91-50ff-41cb-bbc4-e22354e9e6ca" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.927s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:13:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:14:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:14:08 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:14:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:14:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:14:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:14:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:14:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:14:08 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:14:08 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Cleaning up deleted instances {{(pid=75080) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 05 16:14:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:14:08 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] There are 0 instances to clean {{(pid=75080) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 05 16:14:09 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:14:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:14:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:14:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:14:09 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 16:14:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a03f4f91-50ff-41cb-bbc4-e22354e9e6ca/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:14:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a03f4f91-50ff-41cb-bbc4-e22354e9e6ca/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:14:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a03f4f91-50ff-41cb-bbc4-e22354e9e6ca/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:14:09 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a03f4f91-50ff-41cb-bbc4-e22354e9e6ca/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:14:10 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:14:10 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:14:10 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=9045MB free_disk=24.94890594482422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 16:14:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:14:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:14:10 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance a03f4f91-50ff-41cb-bbc4-e22354e9e6ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 16:14:10 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 16:14:10 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 16:14:10 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing inventories for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 05 16:14:10 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Updating ProviderTree inventory for provider 21b770fa-b774-46c9-9415-db26064ccd0f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 05 16:14:10 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Updating inventory in ProviderTree for provider 21b770fa-b774-46c9-9415-db26064ccd0f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 16:14:10 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing aggregate associations for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f, aggregates: None {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 05 16:14:10 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing trait associations for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f, traits: COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 05 16:14:10 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 16:14:10 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 16:14:10 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 16:14:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.323s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:14:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4995-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:14:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:14:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:14:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:14:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:14:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:14:15 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:14:15 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:14:15 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:14:15 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 16:14:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:14:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:14:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:14:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:14:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:14:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:14:19 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:14:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-cd647342-9b9c-492c-996b-ecc8f336d282 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "a03f4f91-50ff-41cb-bbc4-e22354e9e6ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:14:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-cd647342-9b9c-492c-996b-ecc8f336d282 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "a03f4f91-50ff-41cb-bbc4-e22354e9e6ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:14:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-cd647342-9b9c-492c-996b-ecc8f336d282 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "a03f4f91-50ff-41cb-bbc4-e22354e9e6ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:14:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-cd647342-9b9c-492c-996b-ecc8f336d282 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "a03f4f91-50ff-41cb-bbc4-e22354e9e6ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:14:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-cd647342-9b9c-492c-996b-ecc8f336d282 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "a03f4f91-50ff-41cb-bbc4-e22354e9e6ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:14:22 user nova-compute[75080]: INFO nova.compute.manager [None req-cd647342-9b9c-492c-996b-ecc8f336d282 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Terminating instance
Dec 05 16:14:22 user nova-compute[75080]: DEBUG nova.compute.manager [None req-cd647342-9b9c-492c-996b-ecc8f336d282 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 16:14:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:14:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:14:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:14:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:14:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:14:22 user nova-compute[75080]: DEBUG nova.compute.manager [req-cbb06a4b-dd9e-4c77-8e85-df8544b3a643 req-9978fb2e-d846-42b9-abe5-e3321ca584ad service nova] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Received event network-vif-unplugged-a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 16:14:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-cbb06a4b-dd9e-4c77-8e85-df8544b3a643 req-9978fb2e-d846-42b9-abe5-e3321ca584ad service nova] Acquiring lock "a03f4f91-50ff-41cb-bbc4-e22354e9e6ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:14:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-cbb06a4b-dd9e-4c77-8e85-df8544b3a643 req-9978fb2e-d846-42b9-abe5-e3321ca584ad service nova] Lock "a03f4f91-50ff-41cb-bbc4-e22354e9e6ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:14:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-cbb06a4b-dd9e-4c77-8e85-df8544b3a643 req-9978fb2e-d846-42b9-abe5-e3321ca584ad service nova] Lock "a03f4f91-50ff-41cb-bbc4-e22354e9e6ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:14:22 user nova-compute[75080]: DEBUG nova.compute.manager [req-cbb06a4b-dd9e-4c77-8e85-df8544b3a643 req-9978fb2e-d846-42b9-abe5-e3321ca584ad service nova] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] No waiting events found dispatching network-vif-unplugged-a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 16:14:22 user nova-compute[75080]: DEBUG nova.compute.manager [req-cbb06a4b-dd9e-4c77-8e85-df8544b3a643 req-9978fb2e-d846-42b9-abe5-e3321ca584ad service nova] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Received event network-vif-unplugged-a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 16:14:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:14:22 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Instance destroyed successfully.
Dec 05 16:14:22 user nova-compute[75080]: DEBUG nova.objects.instance [None req-cd647342-9b9c-492c-996b-ecc8f336d282 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lazy-loading 'resources' on Instance uuid a03f4f91-50ff-41cb-bbc4-e22354e9e6ca {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:14:22 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-cd647342-9b9c-492c-996b-ecc8f336d282 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T16:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1580857923',display_name='tempest-AttachVolumeNegativeTest-server-1580857923',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1580857923',id=52,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBElQpErReoHu1DmeQCPeLEpvDZCoHjgzXGpnPwy9PN0eYlNCjKx97CwCvxPEwQ8njYP6zHwdmglKi/RVdbuLmC0TwzDUe7ki422qgiKh//AmYhHc5ZJP32VBCsqtKhBcJA==',key_name='tempest-keypair-1372867127',keypairs=<?>,launch_index=0,launched_at=2023-12-05T16:11:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c62808660324e5aa23e8618f7d32ae4',ramdisk_id='',reservation_id='r-kv47e4fr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-329346343',owner_user_name='tempest-AttachVolumeNegativeTest-329346343-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T16:11:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf39da2be27240a8b3e89e4484b9a99b',uuid=a03f4f91-50ff-41cb-bbc4-e22354e9e6ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc", "address": "fa:16:3e:cc:cf:8e", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65f82eb-1f", "ovs_interfaceid": "a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 16:14:22 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-cd647342-9b9c-492c-996b-ecc8f336d282 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Converting VIF {"id": "a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc", "address": "fa:16:3e:cc:cf:8e", "network": {"id": "72069664-17d2-4963-9f71-559dd80df9ca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1338513840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c62808660324e5aa23e8618f7d32ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65f82eb-1f", "ovs_interfaceid": "a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 16:14:22 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-cd647342-9b9c-492c-996b-ecc8f336d282 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:cf:8e,bridge_name='br-int',has_traffic_filtering=True,id=a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc,network=Network(72069664-17d2-4963-9f71-559dd80df9ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65f82eb-1f') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 16:14:22 user nova-compute[75080]: DEBUG os_vif [None req-cd647342-9b9c-492c-996b-ecc8f336d282 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:cf:8e,bridge_name='br-int',has_traffic_filtering=True,id=a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc,network=Network(72069664-17d2-4963-9f71-559dd80df9ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65f82eb-1f') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 16:14:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:14:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa65f82eb-1f, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 16:14:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:14:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:14:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f63cc93-09b8-48b5-880b-1396e291225a) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 16:14:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:14:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:14:22 user nova-compute[75080]: INFO os_vif [None req-cd647342-9b9c-492c-996b-ecc8f336d282 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:cf:8e,bridge_name='br-int',has_traffic_filtering=True,id=a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc,network=Network(72069664-17d2-4963-9f71-559dd80df9ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65f82eb-1f')
Dec 05 16:14:22 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-cd647342-9b9c-492c-996b-ecc8f336d282 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Deleting instance files /opt/stack/data/nova/instances/a03f4f91-50ff-41cb-bbc4-e22354e9e6ca_del
Dec 05 16:14:22 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-cd647342-9b9c-492c-996b-ecc8f336d282 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Deletion of /opt/stack/data/nova/instances/a03f4f91-50ff-41cb-bbc4-e22354e9e6ca_del complete
Dec 05 16:14:23 user nova-compute[75080]: INFO nova.compute.manager [None req-cd647342-9b9c-492c-996b-ecc8f336d282 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Took 0.86 seconds to destroy the instance on the hypervisor.
Dec 05 16:14:23 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-cd647342-9b9c-492c-996b-ecc8f336d282 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 16:14:23 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 16:14:23 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 16:14:23 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 16:14:23 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Took 0.66 seconds to deallocate network for instance.
Dec 05 16:14:23 user nova-compute[75080]: DEBUG nova.compute.manager [req-20b57803-b8b6-4d53-8a52-988428d9b641 req-b54b6591-cf44-41df-8e30-7e31ac67d5cb service nova] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Received event network-vif-deleted-a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 16:14:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-cd647342-9b9c-492c-996b-ecc8f336d282 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:14:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-cd647342-9b9c-492c-996b-ecc8f336d282 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:14:23 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-cd647342-9b9c-492c-996b-ecc8f336d282 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 16:14:23 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-cd647342-9b9c-492c-996b-ecc8f336d282 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 16:14:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-cd647342-9b9c-492c-996b-ecc8f336d282 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.116s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:14:23 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-cd647342-9b9c-492c-996b-ecc8f336d282 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Deleted allocations for instance a03f4f91-50ff-41cb-bbc4-e22354e9e6ca
Dec 05 16:14:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-cd647342-9b9c-492c-996b-ecc8f336d282 tempest-AttachVolumeNegativeTest-329346343 tempest-AttachVolumeNegativeTest-329346343-project-member] Lock "a03f4f91-50ff-41cb-bbc4-e22354e9e6ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.817s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:14:24 user nova-compute[75080]: DEBUG nova.compute.manager [req-b777e8fa-91fa-439a-932e-f46d9568fef5 req-48b1b055-dba2-480d-9136-8763a8283cb2 service nova] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Received event network-vif-plugged-a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 16:14:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-b777e8fa-91fa-439a-932e-f46d9568fef5 req-48b1b055-dba2-480d-9136-8763a8283cb2 service nova] Acquiring lock "a03f4f91-50ff-41cb-bbc4-e22354e9e6ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:14:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-b777e8fa-91fa-439a-932e-f46d9568fef5 req-48b1b055-dba2-480d-9136-8763a8283cb2 service nova] Lock "a03f4f91-50ff-41cb-bbc4-e22354e9e6ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:14:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-b777e8fa-91fa-439a-932e-f46d9568fef5 req-48b1b055-dba2-480d-9136-8763a8283cb2 service nova] Lock "a03f4f91-50ff-41cb-bbc4-e22354e9e6ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:14:24 user nova-compute[75080]: DEBUG nova.compute.manager [req-b777e8fa-91fa-439a-932e-f46d9568fef5 req-48b1b055-dba2-480d-9136-8763a8283cb2 service nova] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] No waiting events found dispatching network-vif-plugged-a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 16:14:24 user nova-compute[75080]: WARNING nova.compute.manager [req-b777e8fa-91fa-439a-932e-f46d9568fef5 req-48b1b055-dba2-480d-9136-8763a8283cb2 service nova] [instance: a03f4f91-50ff-41cb-bbc4-e22354e9e6ca] Received unexpected event network-vif-plugged-a65f82eb-1fd7-4c61-a9a7-33dc0eeb53cc for instance with vm_state deleted and task_state None.
Dec 05 16:14:27 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:14:27 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 16:14:27 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Rebuilding the list of instances to heal {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 16:14:27 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Didn't find any instances for network info cache update. {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 16:14:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:14:31 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:14:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:14:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:14:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:14:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:14:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:14:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:14:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:14:39 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:14:39 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:14:39 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75080) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 05 16:14:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:14:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:14:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:14:53 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:14:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:15:01 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:15:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:15:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:15:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:15:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:15:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:15:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:15:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:15:09 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:15:09 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:15:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:15:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:15:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:15:09 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 16:15:09 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:15:09 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:15:09 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=9185MB free_disk=24.976184844970703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 16:15:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:15:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:15:09 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 16:15:09 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 16:15:09 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 16:15:09 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 16:15:10 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 16:15:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:15:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:15:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:15:17 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:15:17 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:15:17 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:15:17 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 16:15:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:15:19 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:15:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:15:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:15:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:15:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:15:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:15:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:15:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:15:27 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:15:27 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 16:15:27 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Rebuilding the list of instances to heal {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 16:15:27 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Didn't find any instances for network info cache update. {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 16:15:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:15:29 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:15:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:15:33 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:15:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:15:42 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:15:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:15:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:15:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:15:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:15:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:15:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:15:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:15:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:15:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:15:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:15:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:15:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:15:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:15:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:16:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:16:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:16:09 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:16:09 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:16:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:16:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:16:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:16:09 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 16:16:09 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:16:09 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:16:09 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=9093MB free_disk=24.96634292602539GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 16:16:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:16:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:16:10 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 16:16:10 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 16:16:10 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 16:16:10 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 16:16:10 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 16:16:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.189s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:16:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:16:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:16:16 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:16:17 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:16:17 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:16:17 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:16:17 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 16:16:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:16:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:16:19 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:16:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:16:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:16:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:16:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:16:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:16:27 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:16:27 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 16:16:27 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Rebuilding the list of instances to heal {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 16:16:27 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Didn't find any instances for network info cache update. {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 16:16:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:16:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:16:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:16:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:16:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:16:33 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:16:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Acquiring lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:16:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:16:34 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Starting instance... {{(pid=75080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 16:16:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:16:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:16:34 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 16:16:34 user nova-compute[75080]: INFO nova.compute.claims [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Claim successful on node user
Dec 05 16:16:35 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 16:16:35 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 16:16:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.212s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:16:35 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Start building networks asynchronously for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 16:16:35 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Allocating IP information in the background. {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 16:16:35 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] allocate_for_instance() {{(pid=75080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 16:16:35 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 16:16:35 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Start building block device mappings for instance. {{(pid=75080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 16:16:35 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Start spawning the instance on the hypervisor. {{(pid=75080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 16:16:35 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Creating instance directory {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 16:16:35 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Creating image(s)
Dec 05 16:16:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Acquiring lock "/opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:16:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "/opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:16:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "/opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:16:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:16:35 user nova-compute[75080]: DEBUG nova.policy [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2d1ba78be5b542a7abdca5f98c067153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d6c012da084710b1271b53d62bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75080) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 16:16:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.194s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:16:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Acquiring lock "ed68b1c252927ed00fc816385a65373cdd096dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:16:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:16:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:16:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.200s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:16:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/disk 1073741824 {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:16:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee,backing_fmt=raw /opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/disk 1073741824" returned: 0 in 0.049s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:16:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "ed68b1c252927ed00fc816385a65373cdd096dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:16:35 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:16:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed68b1c252927ed00fc816385a65373cdd096dee --force-share --output=json" returned: 0 in 0.204s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:16:36 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Checking if we can resize image /opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/disk. size=1073741824 {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 16:16:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:16:36 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:16:36 user nova-compute[75080]: DEBUG nova.virt.disk.api [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Cannot resize image /opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/disk to a smaller size. {{(pid=75080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 16:16:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Created local disks {{(pid=75080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 16:16:36 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Ensure instance console log exists: /opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/console.log {{(pid=75080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 16:16:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:16:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:16:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:16:36 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Successfully created port: 0ad31548-9664-4be8-9a83-56fa5ea2876a {{(pid=75080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Successfully updated port: 0ad31548-9664-4be8-9a83-56fa5ea2876a {{(pid=75080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Acquiring lock "refresh_cache-696fd8d7-2f17-466b-a2d4-ded76be1d278" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Acquired lock "refresh_cache-696fd8d7-2f17-466b-a2d4-ded76be1d278" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Building network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Instance cache missing network info. {{(pid=75080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG nova.compute.manager [req-5f5715ee-ca6a-4803-a3d5-d69ddee9871d req-ef0bcde8-6424-4a7f-a58d-5f525e7475d4 service nova] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Received event network-changed-0ad31548-9664-4be8-9a83-56fa5ea2876a {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG nova.compute.manager [req-5f5715ee-ca6a-4803-a3d5-d69ddee9871d req-ef0bcde8-6424-4a7f-a58d-5f525e7475d4 service nova] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Refreshing instance network info cache due to event network-changed-0ad31548-9664-4be8-9a83-56fa5ea2876a. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5f5715ee-ca6a-4803-a3d5-d69ddee9871d req-ef0bcde8-6424-4a7f-a58d-5f525e7475d4 service nova] Acquiring lock "refresh_cache-696fd8d7-2f17-466b-a2d4-ded76be1d278" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG nova.network.neutron [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Updating instance_info_cache with network_info: [{"id": "0ad31548-9664-4be8-9a83-56fa5ea2876a", "address": "fa:16:3e:70:4d:1f", "network": {"id": "a89bb50f-bce5-4f59-9926-5bc4148120a7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-219738141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41d6c012da084710b1271b53d62bc00b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad31548-96", "ovs_interfaceid": "0ad31548-9664-4be8-9a83-56fa5ea2876a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Releasing lock "refresh_cache-696fd8d7-2f17-466b-a2d4-ded76be1d278" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Instance network_info: |[{"id": "0ad31548-9664-4be8-9a83-56fa5ea2876a", "address": "fa:16:3e:70:4d:1f", "network": {"id": "a89bb50f-bce5-4f59-9926-5bc4148120a7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-219738141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41d6c012da084710b1271b53d62bc00b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad31548-96", "ovs_interfaceid": "0ad31548-9664-4be8-9a83-56fa5ea2876a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5f5715ee-ca6a-4803-a3d5-d69ddee9871d req-ef0bcde8-6424-4a7f-a58d-5f525e7475d4 service nova] Acquired lock "refresh_cache-696fd8d7-2f17-466b-a2d4-ded76be1d278" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG nova.network.neutron [req-5f5715ee-ca6a-4803-a3d5-d69ddee9871d req-ef0bcde8-6424-4a7f-a58d-5f525e7475d4 service nova] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Refreshing network info cache for port 0ad31548-9664-4be8-9a83-56fa5ea2876a {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Start _get_guest_xml network_info=[{"id": "0ad31548-9664-4be8-9a83-56fa5ea2876a", "address": "fa:16:3e:70:4d:1f", "network": {"id": "a89bb50f-bce5-4f59-9926-5bc4148120a7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-219738141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41d6c012da084710b1271b53d62bc00b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad31548-96", "ovs_interfaceid": "0ad31548-9664-4be8-9a83-56fa5ea2876a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '945b9282-153c-4cca-bc1c-40b0d399f793'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 16:16:37 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:16:37 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:16:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] CPU controller missing on host. {{(pid=75080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.host [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] CPU controller found on host. {{(pid=75080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T15:13:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T15:13:47Z,direct_url=<?>,disk_format='qcow2',id=945b9282-153c-4cca-bc1c-40b0d399f793,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0ca683fa1e094a8fa09c173c4dfc1ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T15:13:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Flavor limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Image limits 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Flavor pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Image pref 0:0:0 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Got 1 possible topologies {{(pid=75080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG nova.virt.hardware [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T16:16:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1357306062',display_name='tempest-SnapshotDataIntegrityTests-server-1357306062',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1357306062',id=53,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhiAU+EYk5VKmXMIlzTv2O77KmTJhJFoUNk+Q2xaR2+spflJ7RMOES2qDlP+EOh0z2mc1Dq1Yea7igjNxHvegcA336D/YO2Zs2cP5UiZbZTBvxolgc/MfuXeevmpCtiww==',key_name='tempest-keypair-37069972',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41d6c012da084710b1271b53d62bc00b',ramdisk_id='',reservation_id='r-bkg8syil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-653227929',owner_user_name='tempest-SnapshotDataIntegrityTests-653227929-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T16:16:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d1ba78be5b542a7abdca5f98c067153',uuid=696fd8d7-2f17-466b-a2d4-ded76be1d278,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ad31548-9664-4be8-9a83-56fa5ea2876a", "address": "fa:16:3e:70:4d:1f", "network": {"id": "a89bb50f-bce5-4f59-9926-5bc4148120a7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-219738141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41d6c012da084710b1271b53d62bc00b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad31548-96", "ovs_interfaceid": "0ad31548-9664-4be8-9a83-56fa5ea2876a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Converting VIF {"id": "0ad31548-9664-4be8-9a83-56fa5ea2876a", "address": "fa:16:3e:70:4d:1f", "network": {"id": "a89bb50f-bce5-4f59-9926-5bc4148120a7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-219738141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41d6c012da084710b1271b53d62bc00b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad31548-96", "ovs_interfaceid": "0ad31548-9664-4be8-9a83-56fa5ea2876a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:4d:1f,bridge_name='br-int',has_traffic_filtering=True,id=0ad31548-9664-4be8-9a83-56fa5ea2876a,network=Network(a89bb50f-bce5-4f59-9926-5bc4148120a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ad31548-96') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG nova.objects.instance [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lazy-loading 'pci_devices' on Instance uuid 696fd8d7-2f17-466b-a2d4-ded76be1d278 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] End _get_guest_xml xml=<domain type="kvm">
Dec 05 16:16:37 user nova-compute[75080]:   <uuid>696fd8d7-2f17-466b-a2d4-ded76be1d278</uuid>
Dec 05 16:16:37 user nova-compute[75080]:   <name>instance-00000035</name>
Dec 05 16:16:37 user nova-compute[75080]:   <memory>524288</memory>
Dec 05 16:16:37 user nova-compute[75080]:   <vcpu>1</vcpu>
Dec 05 16:16:37 user nova-compute[75080]:   <metadata>
Dec 05 16:16:37 user nova-compute[75080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 16:16:37 user nova-compute[75080]:       <nova:package version="0.0.0"/>
Dec 05 16:16:37 user nova-compute[75080]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1357306062</nova:name>
Dec 05 16:16:37 user nova-compute[75080]:       <nova:creationTime>2023-12-05 16:16:37</nova:creationTime>
Dec 05 16:16:37 user nova-compute[75080]:       <nova:flavor name="m1.tiny">
Dec 05 16:16:37 user nova-compute[75080]:         <nova:memory>512</nova:memory>
Dec 05 16:16:37 user nova-compute[75080]:         <nova:disk>1</nova:disk>
Dec 05 16:16:37 user nova-compute[75080]:         <nova:swap>0</nova:swap>
Dec 05 16:16:37 user nova-compute[75080]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 16:16:37 user nova-compute[75080]:         <nova:vcpus>1</nova:vcpus>
Dec 05 16:16:37 user nova-compute[75080]:       </nova:flavor>
Dec 05 16:16:37 user nova-compute[75080]:       <nova:owner>
Dec 05 16:16:37 user nova-compute[75080]:         <nova:user uuid="2d1ba78be5b542a7abdca5f98c067153">tempest-SnapshotDataIntegrityTests-653227929-project-member</nova:user>
Dec 05 16:16:37 user nova-compute[75080]:         <nova:project uuid="41d6c012da084710b1271b53d62bc00b">tempest-SnapshotDataIntegrityTests-653227929</nova:project>
Dec 05 16:16:37 user nova-compute[75080]:       </nova:owner>
Dec 05 16:16:37 user nova-compute[75080]:       <nova:root type="image" uuid="945b9282-153c-4cca-bc1c-40b0d399f793"/>
Dec 05 16:16:37 user nova-compute[75080]:       <nova:ports>
Dec 05 16:16:37 user nova-compute[75080]:         <nova:port uuid="0ad31548-9664-4be8-9a83-56fa5ea2876a">
Dec 05 16:16:37 user nova-compute[75080]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 05 16:16:37 user nova-compute[75080]:         </nova:port>
Dec 05 16:16:37 user nova-compute[75080]:       </nova:ports>
Dec 05 16:16:37 user nova-compute[75080]:     </nova:instance>
Dec 05 16:16:37 user nova-compute[75080]:   </metadata>
Dec 05 16:16:37 user nova-compute[75080]:   <sysinfo type="smbios">
Dec 05 16:16:37 user nova-compute[75080]:     <system>
Dec 05 16:16:37 user nova-compute[75080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 16:16:37 user nova-compute[75080]:       <entry name="product">OpenStack Nova</entry>
Dec 05 16:16:37 user nova-compute[75080]:       <entry name="version">0.0.0</entry>
Dec 05 16:16:37 user nova-compute[75080]:       <entry name="serial">696fd8d7-2f17-466b-a2d4-ded76be1d278</entry>
Dec 05 16:16:37 user nova-compute[75080]:       <entry name="uuid">696fd8d7-2f17-466b-a2d4-ded76be1d278</entry>
Dec 05 16:16:37 user nova-compute[75080]:       <entry name="family">Virtual Machine</entry>
Dec 05 16:16:37 user nova-compute[75080]:     </system>
Dec 05 16:16:37 user nova-compute[75080]:   </sysinfo>
Dec 05 16:16:37 user nova-compute[75080]:   <os>
Dec 05 16:16:37 user nova-compute[75080]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 16:16:37 user nova-compute[75080]:     <boot dev="hd"/>
Dec 05 16:16:37 user nova-compute[75080]:     <smbios mode="sysinfo"/>
Dec 05 16:16:37 user nova-compute[75080]:   </os>
Dec 05 16:16:37 user nova-compute[75080]:   <features>
Dec 05 16:16:37 user nova-compute[75080]:     <acpi/>
Dec 05 16:16:37 user nova-compute[75080]:     <apic/>
Dec 05 16:16:37 user nova-compute[75080]:     <vmcoreinfo/>
Dec 05 16:16:37 user nova-compute[75080]:   </features>
Dec 05 16:16:37 user nova-compute[75080]:   <clock offset="utc">
Dec 05 16:16:37 user nova-compute[75080]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 16:16:37 user nova-compute[75080]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 16:16:37 user nova-compute[75080]:     <timer name="hpet" present="no"/>
Dec 05 16:16:37 user nova-compute[75080]:   </clock>
Dec 05 16:16:37 user nova-compute[75080]:   <cpu mode="custom" match="exact">
Dec 05 16:16:37 user nova-compute[75080]:     <model>Nehalem</model>
Dec 05 16:16:37 user nova-compute[75080]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 16:16:37 user nova-compute[75080]:   </cpu>
Dec 05 16:16:37 user nova-compute[75080]:   <devices>
Dec 05 16:16:37 user nova-compute[75080]:     <disk type="file" device="disk">
Dec 05 16:16:37 user nova-compute[75080]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 16:16:37 user nova-compute[75080]:       <source file="/opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/disk"/>
Dec 05 16:16:37 user nova-compute[75080]:       <target dev="vda" bus="virtio"/>
Dec 05 16:16:37 user nova-compute[75080]:     </disk>
Dec 05 16:16:37 user nova-compute[75080]:     <interface type="ethernet">
Dec 05 16:16:37 user nova-compute[75080]:       <mac address="fa:16:3e:70:4d:1f"/>
Dec 05 16:16:37 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 16:16:37 user nova-compute[75080]:       <mtu size="1442"/>
Dec 05 16:16:37 user nova-compute[75080]:       <target dev="tap0ad31548-96"/>
Dec 05 16:16:37 user nova-compute[75080]:     </interface>
Dec 05 16:16:37 user nova-compute[75080]:     <serial type="pty">
Dec 05 16:16:37 user nova-compute[75080]:       <log file="/opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/console.log" append="off"/>
Dec 05 16:16:37 user nova-compute[75080]:     </serial>
Dec 05 16:16:37 user nova-compute[75080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 16:16:37 user nova-compute[75080]:     <video>
Dec 05 16:16:37 user nova-compute[75080]:       <model type="virtio"/>
Dec 05 16:16:37 user nova-compute[75080]:     </video>
Dec 05 16:16:37 user nova-compute[75080]:     <rng model="virtio">
Dec 05 16:16:37 user nova-compute[75080]:       <backend model="random">/dev/urandom</backend>
Dec 05 16:16:37 user nova-compute[75080]:     </rng>
Dec 05 16:16:37 user nova-compute[75080]:     <controller type="usb" index="0" model="none"/>
Dec 05 16:16:37 user nova-compute[75080]:     <memballoon model="virtio">
Dec 05 16:16:37 user nova-compute[75080]:       <stats period="10"/>
Dec 05 16:16:37 user nova-compute[75080]:     </memballoon>
Dec 05 16:16:37 user nova-compute[75080]:   </devices>
Dec 05 16:16:37 user nova-compute[75080]: </domain>
Dec 05 16:16:37 user nova-compute[75080]:  {{(pid=75080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T16:16:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1357306062',display_name='tempest-SnapshotDataIntegrityTests-server-1357306062',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1357306062',id=53,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhiAU+EYk5VKmXMIlzTv2O77KmTJhJFoUNk+Q2xaR2+spflJ7RMOES2qDlP+EOh0z2mc1Dq1Yea7igjNxHvegcA336D/YO2Zs2cP5UiZbZTBvxolgc/MfuXeevmpCtiww==',key_name='tempest-keypair-37069972',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41d6c012da084710b1271b53d62bc00b',ramdisk_id='',reservation_id='r-bkg8syil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-653227929',owner_user_name='tempest-SnapshotDataIntegrityTests-653227929-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T16:16:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d1ba78be5b542a7abdca5f98c067153',uuid=696fd8d7-2f17-466b-a2d4-ded76be1d278,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ad31548-9664-4be8-9a83-56fa5ea2876a", "address": "fa:16:3e:70:4d:1f", "network": {"id": "a89bb50f-bce5-4f59-9926-5bc4148120a7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-219738141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41d6c012da084710b1271b53d62bc00b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad31548-96", "ovs_interfaceid": "0ad31548-9664-4be8-9a83-56fa5ea2876a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Converting VIF {"id": "0ad31548-9664-4be8-9a83-56fa5ea2876a", "address": "fa:16:3e:70:4d:1f", "network": {"id": "a89bb50f-bce5-4f59-9926-5bc4148120a7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-219738141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41d6c012da084710b1271b53d62bc00b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad31548-96", "ovs_interfaceid": "0ad31548-9664-4be8-9a83-56fa5ea2876a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:4d:1f,bridge_name='br-int',has_traffic_filtering=True,id=0ad31548-9664-4be8-9a83-56fa5ea2876a,network=Network(a89bb50f-bce5-4f59-9926-5bc4148120a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ad31548-96') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG os_vif [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:4d:1f,bridge_name='br-int',has_traffic_filtering=True,id=0ad31548-9664-4be8-9a83-56fa5ea2876a,network=Network(a89bb50f-bce5-4f59-9926-5bc4148120a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ad31548-96') {{(pid=75080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb92f6f2-2b68-5e3a-a0ea-cf8f70612342', '_type': 'linux-noop'}}, row=False) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ad31548-96, may_exist=True, interface_attrs={}) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ad31548-96, col_values=(('qos', UUID('64a6b03f-3a0a-40c7-888f-716e88cfce5c')),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ad31548-96, col_values=(('external_ids', {'iface-id': '0ad31548-9664-4be8-9a83-56fa5ea2876a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:4d:1f', 'vm-uuid': '696fd8d7-2f17-466b-a2d4-ded76be1d278'}),), if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:16:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:16:37 user nova-compute[75080]: INFO os_vif [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:4d:1f,bridge_name='br-int',has_traffic_filtering=True,id=0ad31548-9664-4be8-9a83-56fa5ea2876a,network=Network(a89bb50f-bce5-4f59-9926-5bc4148120a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ad31548-96')
Dec 05 16:16:38 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 16:16:38 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] No VIF found with MAC fa:16:3e:70:4d:1f, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 16:16:38 user nova-compute[75080]: DEBUG nova.network.neutron [req-5f5715ee-ca6a-4803-a3d5-d69ddee9871d req-ef0bcde8-6424-4a7f-a58d-5f525e7475d4 service nova] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Updated VIF entry in instance network info cache for port 0ad31548-9664-4be8-9a83-56fa5ea2876a. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 16:16:38 user nova-compute[75080]: DEBUG nova.network.neutron [req-5f5715ee-ca6a-4803-a3d5-d69ddee9871d req-ef0bcde8-6424-4a7f-a58d-5f525e7475d4 service nova] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Updating instance_info_cache with network_info: [{"id": "0ad31548-9664-4be8-9a83-56fa5ea2876a", "address": "fa:16:3e:70:4d:1f", "network": {"id": "a89bb50f-bce5-4f59-9926-5bc4148120a7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-219738141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41d6c012da084710b1271b53d62bc00b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad31548-96", "ovs_interfaceid": "0ad31548-9664-4be8-9a83-56fa5ea2876a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 16:16:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-5f5715ee-ca6a-4803-a3d5-d69ddee9871d req-ef0bcde8-6424-4a7f-a58d-5f525e7475d4 service nova] Releasing lock "refresh_cache-696fd8d7-2f17-466b-a2d4-ded76be1d278" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 16:16:39 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:16:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:16:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:16:39 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:16:40 user nova-compute[75080]: DEBUG nova.compute.manager [req-bfcc871f-3655-4b7f-b0e6-a55172f659a5 req-34c91234-5c8f-4700-8b81-02d441a178a8 service nova] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Received event network-vif-plugged-0ad31548-9664-4be8-9a83-56fa5ea2876a {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 16:16:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-bfcc871f-3655-4b7f-b0e6-a55172f659a5 req-34c91234-5c8f-4700-8b81-02d441a178a8 service nova] Acquiring lock "696fd8d7-2f17-466b-a2d4-ded76be1d278-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:16:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-bfcc871f-3655-4b7f-b0e6-a55172f659a5 req-34c91234-5c8f-4700-8b81-02d441a178a8 service nova] Lock "696fd8d7-2f17-466b-a2d4-ded76be1d278-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:16:40 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-bfcc871f-3655-4b7f-b0e6-a55172f659a5 req-34c91234-5c8f-4700-8b81-02d441a178a8 service nova] Lock "696fd8d7-2f17-466b-a2d4-ded76be1d278-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:16:40 user nova-compute[75080]: DEBUG nova.compute.manager [req-bfcc871f-3655-4b7f-b0e6-a55172f659a5 req-34c91234-5c8f-4700-8b81-02d441a178a8 service nova] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] No waiting events found dispatching network-vif-plugged-0ad31548-9664-4be8-9a83-56fa5ea2876a {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 16:16:40 user nova-compute[75080]: WARNING nova.compute.manager [req-bfcc871f-3655-4b7f-b0e6-a55172f659a5 req-34c91234-5c8f-4700-8b81-02d441a178a8 service nova] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Received unexpected event network-vif-plugged-0ad31548-9664-4be8-9a83-56fa5ea2876a for instance with vm_state building and task_state spawning.
Dec 05 16:16:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:16:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:16:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:16:41 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Instance event wait completed in 0 seconds for  {{(pid=75080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 16:16:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Guest created on hypervisor {{(pid=75080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 16:16:41 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Instance spawned successfully.
Dec 05 16:16:41 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 16:16:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Found default for hw_cdrom_bus of ide {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 16:16:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Found default for hw_disk_bus of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 16:16:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Found default for hw_input_bus of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 16:16:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Found default for hw_pointer_model of None {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 16:16:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Found default for hw_video_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 16:16:42 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Found default for hw_vif_model of virtio {{(pid=75080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 16:16:42 user nova-compute[75080]: DEBUG nova.compute.manager [req-a514a9c9-7e60-43b4-941e-e0e09a7c0698 req-37427b06-98ff-4370-80bb-b7226a287f3b service nova] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Received event network-vif-plugged-0ad31548-9664-4be8-9a83-56fa5ea2876a {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 16:16:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a514a9c9-7e60-43b4-941e-e0e09a7c0698 req-37427b06-98ff-4370-80bb-b7226a287f3b service nova] Acquiring lock "696fd8d7-2f17-466b-a2d4-ded76be1d278-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:16:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a514a9c9-7e60-43b4-941e-e0e09a7c0698 req-37427b06-98ff-4370-80bb-b7226a287f3b service nova] Lock "696fd8d7-2f17-466b-a2d4-ded76be1d278-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:16:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-a514a9c9-7e60-43b4-941e-e0e09a7c0698 req-37427b06-98ff-4370-80bb-b7226a287f3b service nova] Lock "696fd8d7-2f17-466b-a2d4-ded76be1d278-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:16:42 user nova-compute[75080]: DEBUG nova.compute.manager [req-a514a9c9-7e60-43b4-941e-e0e09a7c0698 req-37427b06-98ff-4370-80bb-b7226a287f3b service nova] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] No waiting events found dispatching network-vif-plugged-0ad31548-9664-4be8-9a83-56fa5ea2876a {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 16:16:42 user nova-compute[75080]: WARNING nova.compute.manager [req-a514a9c9-7e60-43b4-941e-e0e09a7c0698 req-37427b06-98ff-4370-80bb-b7226a287f3b service nova] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Received unexpected event network-vif-plugged-0ad31548-9664-4be8-9a83-56fa5ea2876a for instance with vm_state building and task_state spawning.
Dec 05 16:16:42 user nova-compute[75080]: INFO nova.compute.manager [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Took 6.71 seconds to spawn the instance on the hypervisor.
Dec 05 16:16:42 user nova-compute[75080]: DEBUG nova.compute.manager [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Checking state {{(pid=75080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 16:16:42 user nova-compute[75080]: INFO nova.compute.manager [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Took 7.37 seconds to build instance.
Dec 05 16:16:42 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-e01d4a02-726c-4d91-a995-465778a727db tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.505s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:16:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:16:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:16:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:16:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:16:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:16:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:16:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:17:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:17:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:17:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:17:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:17:10 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:17:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:17:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:17:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:17:10 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 16:17:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:17:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:17:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:17:11 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:17:11 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:17:11 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:17:11 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=8842MB free_disk=24.922649383544922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 16:17:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:17:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:17:11 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 696fd8d7-2f17-466b-a2d4-ded76be1d278 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 16:17:11 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 16:17:11 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 16:17:11 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 16:17:11 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 16:17:11 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 16:17:11 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.246s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:17:12 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:17:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:17:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:17:16 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:17:17 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:17:17 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:17:17 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 16:17:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:17:19 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:17:20 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:17:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:17:24 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:17:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:17:29 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:17:29 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 16:17:29 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Rebuilding the list of instances to heal {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 16:17:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-696fd8d7-2f17-466b-a2d4-ded76be1d278" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 16:17:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-696fd8d7-2f17-466b-a2d4-ded76be1d278" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 16:17:29 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 16:17:29 user nova-compute[75080]: DEBUG nova.objects.instance [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lazy-loading 'info_cache' on Instance uuid 696fd8d7-2f17-466b-a2d4-ded76be1d278 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:17:29 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Updating instance_info_cache with network_info: [{"id": "0ad31548-9664-4be8-9a83-56fa5ea2876a", "address": "fa:16:3e:70:4d:1f", "network": {"id": "a89bb50f-bce5-4f59-9926-5bc4148120a7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-219738141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41d6c012da084710b1271b53d62bc00b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad31548-96", "ovs_interfaceid": "0ad31548-9664-4be8-9a83-56fa5ea2876a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 16:17:29 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-696fd8d7-2f17-466b-a2d4-ded76be1d278" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 16:17:29 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 16:17:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:17:35 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:17:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:17:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:17:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:17:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:17:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:17:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:17:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:17:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:17:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:17:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:17:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:17:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:17:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:17:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:17:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:18:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:18:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:18:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:18:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:18:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:18:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:18:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:18:12 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:18:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:18:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:18:12 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:18:12 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 16:18:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:18:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:18:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:18:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:18:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:18:13 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:18:13 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:18:13 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=9034MB free_disk=24.92074203491211GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 16:18:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:18:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:18:13 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 696fd8d7-2f17-466b-a2d4-ded76be1d278 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 16:18:13 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 16:18:13 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 16:18:13 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 16:18:13 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 16:18:13 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 16:18:13 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.224s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:18:14 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:18:17 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:18:17 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:18:17 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 16:18:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:18:18 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:18:20 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:18:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:18:25 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:18:25 user nova-compute[75080]: DEBUG nova.compute.manager [req-c6cb9ad8-a763-4617-9ffc-6136dbe2783d req-427cde68-891a-44b4-ae8f-73c608cff728 service nova] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Received event network-changed-0ad31548-9664-4be8-9a83-56fa5ea2876a {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 16:18:25 user nova-compute[75080]: DEBUG nova.compute.manager [req-c6cb9ad8-a763-4617-9ffc-6136dbe2783d req-427cde68-891a-44b4-ae8f-73c608cff728 service nova] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Refreshing instance network info cache due to event network-changed-0ad31548-9664-4be8-9a83-56fa5ea2876a. {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 16:18:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c6cb9ad8-a763-4617-9ffc-6136dbe2783d req-427cde68-891a-44b4-ae8f-73c608cff728 service nova] Acquiring lock "refresh_cache-696fd8d7-2f17-466b-a2d4-ded76be1d278" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 16:18:25 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c6cb9ad8-a763-4617-9ffc-6136dbe2783d req-427cde68-891a-44b4-ae8f-73c608cff728 service nova] Acquired lock "refresh_cache-696fd8d7-2f17-466b-a2d4-ded76be1d278" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 16:18:25 user nova-compute[75080]: DEBUG nova.network.neutron [req-c6cb9ad8-a763-4617-9ffc-6136dbe2783d req-427cde68-891a-44b4-ae8f-73c608cff728 service nova] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Refreshing network info cache for port 0ad31548-9664-4be8-9a83-56fa5ea2876a {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 16:18:26 user nova-compute[75080]: DEBUG nova.network.neutron [req-c6cb9ad8-a763-4617-9ffc-6136dbe2783d req-427cde68-891a-44b4-ae8f-73c608cff728 service nova] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Updated VIF entry in instance network info cache for port 0ad31548-9664-4be8-9a83-56fa5ea2876a. {{(pid=75080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 16:18:26 user nova-compute[75080]: DEBUG nova.network.neutron [req-c6cb9ad8-a763-4617-9ffc-6136dbe2783d req-427cde68-891a-44b4-ae8f-73c608cff728 service nova] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Updating instance_info_cache with network_info: [{"id": "0ad31548-9664-4be8-9a83-56fa5ea2876a", "address": "fa:16:3e:70:4d:1f", "network": {"id": "a89bb50f-bce5-4f59-9926-5bc4148120a7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-219738141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41d6c012da084710b1271b53d62bc00b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad31548-96", "ovs_interfaceid": "0ad31548-9664-4be8-9a83-56fa5ea2876a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 16:18:26 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-c6cb9ad8-a763-4617-9ffc-6136dbe2783d req-427cde68-891a-44b4-ae8f-73c608cff728 service nova] Releasing lock "refresh_cache-696fd8d7-2f17-466b-a2d4-ded76be1d278" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 16:18:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:18:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:18:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Acquiring lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:18:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:18:30 user nova-compute[75080]: DEBUG nova.objects.instance [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lazy-loading 'flavor' on Instance uuid 696fd8d7-2f17-466b-a2d4-ded76be1d278 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:18:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:18:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Acquiring lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:18:30 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:18:30 user nova-compute[75080]: INFO nova.compute.manager [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Attaching volume 25da56ee-65f5-4192-bc0a-cb2d671927d1 to /dev/vdb
Dec 05 16:18:30 user nova-compute[75080]: DEBUG os_brick.utils [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 16:18:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:18:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:18:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae3818c-4722-4e47-b987-3bc2c1958d02]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:18:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:18:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:18:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4dbd92a-5dd8-43fe-b988-2bd36987236d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:18:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:18:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:18:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[90725a0d-0a3e-467c-89bc-5ef4ec43f7c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:18:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a633d3-3d69-4e2e-b6f6-e61bbfd05c27]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:18:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:18:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 16:18:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 16:18:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:18:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 16:18:30 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 16:18:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dde7753-ae57-4334-86cb-1e19e804ef37]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:18:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 16:18:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 16:18:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 16:18:30 user nova-compute[75080]: DEBUG os_brick.utils [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 16:18:30 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Updating existing volume attachment record: 5d145074-f7fe-44d3-bcd9-541d3e29898a {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 16:18:31 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:18:31 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 16:18:31 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Rebuilding the list of instances to heal {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 16:18:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-696fd8d7-2f17-466b-a2d4-ded76be1d278" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 16:18:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-696fd8d7-2f17-466b-a2d4-ded76be1d278" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 16:18:31 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 16:18:31 user nova-compute[75080]: DEBUG nova.objects.instance [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lazy-loading 'info_cache' on Instance uuid 696fd8d7-2f17-466b-a2d4-ded76be1d278 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:18:32 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Updating instance_info_cache with network_info: [{"id": "0ad31548-9664-4be8-9a83-56fa5ea2876a", "address": "fa:16:3e:70:4d:1f", "network": {"id": "a89bb50f-bce5-4f59-9926-5bc4148120a7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-219738141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41d6c012da084710b1271b53d62bc00b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad31548-96", "ovs_interfaceid": "0ad31548-9664-4be8-9a83-56fa5ea2876a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 16:18:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-696fd8d7-2f17-466b-a2d4-ded76be1d278" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 16:18:32 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 16:18:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:18:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:18:36 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:18:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:18:40 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:18:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NzPkvSXt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 16:18:43 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 16:18:43 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 16:18:43 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 16:18:43 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 16:18:43 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 16:18:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1 -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2ae24a-fa4f-4044-8784-f99049531dac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 16:18:43 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bda0c27-be1f-4550-80dc-1a6fd3819912]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1] added
Dec 05 16:18:43 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b28141-1e90-42b9-b697-5bb889acacef]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ad6ab3-8fd8-49d9-987b-fa4378a5e3cf]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NzPkvSXt {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NzPkvSXt" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c5ffa2-2e83-429b-9074-951b5aebe615]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NzPkvSXt'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c9626f-ebea-4ad3-a57d-970d7758cdfd]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9230dfea-3c2d-4fe8-88ed-9bf906f7b4bb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 05 16:18:43 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 05 16:18:43 user nova-compute[75080]:  {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 16:18:43 user nova-compute[75080]: WARNING os_brick.initiator.connectors.iscsi [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 05 16:18:43 user nova-compute[75080]: 
Dec 05 16:18:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1 -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1ec383-5687-4de2-b79e-4b0d6d2b5aae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1, portal: 172.16.0.220,3260]
Dec 05 16:18:43 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1, portal: 172.16.0.220,3260] successful.
Dec 05 16:18:43 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[36dc0195-443e-4fa9-8b52-7772882346ba]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d31ba46-1c88-4c9b-b740-b59a7edb3757]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1 (non-flash)
Dec 05 16:18:43 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1 (non-flash)
Dec 05 16:18:43 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.234s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ce7b45-e70b-4fa9-92d4-1c0a9c9032a9]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 16:18:43 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NzPkvSXt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 16:18:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.264s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 16:18:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] <== connect_volume: return (1266ms) {'type': 'block', 'scsi_wwn': '23031323537623032', 'path': '/dev/sdb'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 16:18:44 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031323537623032', 'path': '/dev/sdb'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 16:18:44 user nova-compute[75080]: DEBUG nova.objects.instance [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lazy-loading 'flavor' on Instance uuid 696fd8d7-2f17-466b-a2d4-ded76be1d278 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:18:44 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 16:18:44 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 16:18:44 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 16:18:44 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 16:18:44 user nova-compute[75080]:   <serial>25da56ee-65f5-4192-bc0a-cb2d671927d1</serial>
Dec 05 16:18:44 user nova-compute[75080]: </disk>
Dec 05 16:18:44 user nova-compute[75080]:  {{(pid=75080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 16:18:45 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 16:18:45 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 16:18:45 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] No VIF found with MAC fa:16:3e:70:4d:1f, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 16:18:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2af69b08-68dc-4e37-9445-8e66cd0de9b4 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.721s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:18:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:18:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:18:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:18:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:18:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:18:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:19:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-39b00592-4175-4209-8cce-4c065ea28eae tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Acquiring lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:19:02 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-39b00592-4175-4209-8cce-4c065ea28eae tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:19:02 user nova-compute[75080]: INFO nova.compute.manager [None req-39b00592-4175-4209-8cce-4c065ea28eae tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Detaching volume 25da56ee-65f5-4192-bc0a-cb2d671927d1
Dec 05 16:19:02 user nova-compute[75080]: INFO nova.virt.block_device [None req-39b00592-4175-4209-8cce-4c065ea28eae tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Attempting to driver detach volume 25da56ee-65f5-4192-bc0a-cb2d671927d1 from mountpoint /dev/vdb
Dec 05 16:19:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-39b00592-4175-4209-8cce-4c065ea28eae tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Attempting to detach device vdb from instance 696fd8d7-2f17-466b-a2d4-ded76be1d278 from the persistent domain config. {{(pid=75080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 16:19:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-39b00592-4175-4209-8cce-4c065ea28eae tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 16:19:02 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 16:19:02 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 16:19:02 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 16:19:02 user nova-compute[75080]:   <serial>25da56ee-65f5-4192-bc0a-cb2d671927d1</serial>
Dec 05 16:19:02 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 16:19:02 user nova-compute[75080]: </disk>
Dec 05 16:19:02 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 16:19:02 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-39b00592-4175-4209-8cce-4c065ea28eae tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Successfully detached device vdb from instance 696fd8d7-2f17-466b-a2d4-ded76be1d278 from the persistent domain config.
Dec 05 16:19:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-39b00592-4175-4209-8cce-4c065ea28eae tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 696fd8d7-2f17-466b-a2d4-ded76be1d278 from the live domain config. {{(pid=75080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 16:19:02 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-39b00592-4175-4209-8cce-4c065ea28eae tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 16:19:02 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 16:19:02 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 16:19:02 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 16:19:02 user nova-compute[75080]:   <serial>25da56ee-65f5-4192-bc0a-cb2d671927d1</serial>
Dec 05 16:19:02 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 16:19:02 user nova-compute[75080]: </disk>
Dec 05 16:19:02 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 16:19:02 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:19:03 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-39b00592-4175-4209-8cce-4c065ea28eae tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 696fd8d7-2f17-466b-a2d4-ded76be1d278 {{(pid=75080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 16:19:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:19:07 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:19:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:19:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:19:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:19:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:19:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:19:12 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:19:13 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:19:14 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:19:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:19:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:19:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:19:14 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 16:19:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:19:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:19:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:19:14 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:19:15 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:19:15 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:19:15 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=9012MB free_disk=24.919403076171875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 16:19:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:19:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:19:15 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 696fd8d7-2f17-466b-a2d4-ded76be1d278 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 16:19:15 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 16:19:15 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 16:19:15 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing inventories for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 05 16:19:15 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Updating ProviderTree inventory for provider 21b770fa-b774-46c9-9415-db26064ccd0f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 05 16:19:15 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Updating inventory in ProviderTree for provider 21b770fa-b774-46c9-9415-db26064ccd0f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 16:19:15 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing aggregate associations for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f, aggregates: None {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 05 16:19:15 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing trait associations for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f, traits: COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 05 16:19:15 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 16:19:15 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 16:19:15 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 16:19:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.311s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:19:17 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:19:17 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Cleaning up deleted instances {{(pid=75080) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 05 16:19:17 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] There are 0 instances to clean {{(pid=75080) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 05 16:19:17 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:19:19 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:19:19 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:19:19 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:19:19 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 16:19:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:19:22 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:19:23 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-39b00592-4175-4209-8cce-4c065ea28eae tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 696fd8d7-2f17-466b-a2d4-ded76be1d278 is timed out.
Dec 05 16:19:23 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-39b00592-4175-4209-8cce-4c065ea28eae tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Successfully detached device vdb from instance 696fd8d7-2f17-466b-a2d4-ded76be1d278 from the live domain config.
Dec 05 16:19:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39b00592-4175-4209-8cce-4c065ea28eae tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b00592-4175-4209-8cce-4c065ea28eae tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NzPkvSXt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 16:19:23 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-39b00592-4175-4209-8cce-4c065ea28eae tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 16:19:23 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-39b00592-4175-4209-8cce-4c065ea28eae tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-39b00592-4175-4209-8cce-4c065ea28eae tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a16335c-9443-4597-b94e-255946197b33]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b00592-4175-4209-8cce-4c065ea28eae tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 16:19:23 user nova-compute[75080]: No targets found.
Dec 05 16:19:23 user nova-compute[75080]: iSNS:
Dec 05 16:19:23 user nova-compute[75080]: No targets found.
Dec 05 16:19:23 user nova-compute[75080]: STATIC:
Dec 05 16:19:23 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1
Dec 05 16:19:23 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 16:19:23 user nova-compute[75080]:                 Iface Name: default
Dec 05 16:19:23 user nova-compute[75080]: FIRMWARE:
Dec 05 16:19:23 user nova-compute[75080]: No targets found.
Dec 05 16:19:23 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b00592-4175-4209-8cce-4c065ea28eae tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 16:19:23 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 16:19:23 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b00592-4175-4209-8cce-4c065ea28eae tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9ad541-4285-4dc8-b919-d9dfd23e7116]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ad7e84-6c59-4968-9c4d-df499536063b]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b00592-4175-4209-8cce-4c065ea28eae tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1 (non-flash)
Dec 05 16:19:23 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b00592-4175-4209-8cce-4c065ea28eae tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1 (non-flash)
Dec 05 16:19:23 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b00592-4175-4209-8cce-4c065ea28eae tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f665c5cb910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1'): ({'sdb'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-39b00592-4175-4209-8cce-4c065ea28eae tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Removing single pathed devices sdb {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0254c6c9-a47e-4049-bcd6-e3256ff265b2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7095e77a-f8aa-47fa-802e-02601d0af100]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-39b00592-4175-4209-8cce-4c065ea28eae tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Flushing IO for device /dev/sdb {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7888b04-af97-4b46-bc37-1e5126b98098]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-39b00592-4175-4209-8cce-4c065ea28eae tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[16df8f6f-d268-4c90-91a1-904993c42777]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-39b00592-4175-4209-8cce-4c065ea28eae tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-39b00592-4175-4209-8cce-4c065ea28eae tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b00592-4175-4209-8cce-4c065ea28eae tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9af3a1-7520-4355-8389-e4e0cfd19aa6]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b00592-4175-4209-8cce-4c065ea28eae tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1 -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f02fdb-9ebb-493a-bdde-a1c6fb92a955]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b00592-4175-4209-8cce-4c065ea28eae tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1, portal: 172.16.0.220,3260]
Dec 05 16:19:23 user nova-compute[75080]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1, portal: 172.16.0.220,3260] successful.
Dec 05 16:19:23 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1 -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25da56ee-65f5-4192-bc0a-cb2d671927d1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb798f4b-1640-4c0a-991d-bac1c630b0d1]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b00592-4175-4209-8cce-4c065ea28eae tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-39b00592-4175-4209-8cce-4c065ea28eae tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b00592-4175-4209-8cce-4c065ea28eae tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] <== disconnect_volume: return (297ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 16:19:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39b00592-4175-4209-8cce-4c065ea28eae tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 16:19:24 user nova-compute[75080]: DEBUG nova.objects.instance [None req-39b00592-4175-4209-8cce-4c065ea28eae tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lazy-loading 'flavor' on Instance uuid 696fd8d7-2f17-466b-a2d4-ded76be1d278 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:19:24 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-39b00592-4175-4209-8cce-4c065ea28eae tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.721s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:19:26 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:19:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:19:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:19:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:19:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:19:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:19:27 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:19:31 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:19:31 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 16:19:31 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Rebuilding the list of instances to heal {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 16:19:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-696fd8d7-2f17-466b-a2d4-ded76be1d278" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 16:19:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-696fd8d7-2f17-466b-a2d4-ded76be1d278" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 16:19:31 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 16:19:31 user nova-compute[75080]: DEBUG nova.objects.instance [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lazy-loading 'info_cache' on Instance uuid 696fd8d7-2f17-466b-a2d4-ded76be1d278 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:19:31 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Updating instance_info_cache with network_info: [{"id": "0ad31548-9664-4be8-9a83-56fa5ea2876a", "address": "fa:16:3e:70:4d:1f", "network": {"id": "a89bb50f-bce5-4f59-9926-5bc4148120a7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-219738141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41d6c012da084710b1271b53d62bc00b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad31548-96", "ovs_interfaceid": "0ad31548-9664-4be8-9a83-56fa5ea2876a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 16:19:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-696fd8d7-2f17-466b-a2d4-ded76be1d278" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 16:19:31 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 16:19:32 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:19:37 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:19:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:19:42 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:19:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:19:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:19:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:19:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:19:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:19:47 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:19:48 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:19:48 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75080) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 05 16:19:52 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:19:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Acquiring lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:19:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:19:55 user nova-compute[75080]: DEBUG nova.objects.instance [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lazy-loading 'flavor' on Instance uuid 696fd8d7-2f17-466b-a2d4-ded76be1d278 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:19:55 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:19:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Acquiring lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:19:56 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:19:56 user nova-compute[75080]: INFO nova.compute.manager [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Attaching volume 032bdf4b-3162-4631-b2c2-677e368b77c5 to /dev/vdb
Dec 05 16:19:56 user nova-compute[75080]: DEBUG os_brick.utils [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 16:19:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:19:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:19:56 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90810b6-d047-491d-aa0c-ffbc37f38b57]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:19:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:19:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:19:56 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63a0be1-3a82-494d-942e-3a79b446e4a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:19:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:19:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:19:56 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[594d4699-a59f-4701-9453-4b60f9c6407d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:19:56 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cffb7a0-1b7a-4710-bde0-4321a8c2c35d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:19:56 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:19:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 16:19:57 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 16:19:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:19:57 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 16:19:57 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 16:19:57 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d5df59-83cd-4305-9872-13315f0d4a4f]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:19:57 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 16:19:57 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 16:19:57 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 16:19:57 user nova-compute[75080]: DEBUG os_brick.utils [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 16:19:57 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Updating existing volume attachment record: 5fe695ff-6288-42c7-972c-0a4414d62a24 {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 16:19:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:19:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:19:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:19:57 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:19:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:19:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:19:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:20:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:20:04 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:20:05 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 16:20:05 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KbAWROyY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 16:20:05 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 16:20:05 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 16:20:05 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 16:20:05 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 16:20:05 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 16:20:05 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 16:20:05 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 16:20:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5 -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:20:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:20:05 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8154f8a-2192-4e61-a248-8478d474a7fc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:20:05 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 16:20:05 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:20:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:20:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:20:05 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0ec96f-04a8-41ea-8ecf-b0746a0d9728]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:20:05 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5] added
Dec 05 16:20:05 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:20:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:20:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:20:05 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c3fe9c-d30f-4256-8219-ebe466659862]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:20:05 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:20:05 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:20:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:20:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[44945d1d-3dbd-4d46-b044-8ee64795399f]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:20:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:20:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KbAWROyY {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:20:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KbAWROyY" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:20:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[26eb61fd-a8af-420c-94e8-b3ab9123d6eb]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:20:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KbAWROyY'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:20:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:20:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:20:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef478ba-9a23-4994-831b-0d0a190f907b]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:20:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:20:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:20:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:20:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[af01d136-7579-4a1c-8844-6252e771ae3d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:20:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 05 16:20:06 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 16:20:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 05 16:20:06 user nova-compute[75080]:  {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 16:20:06 user nova-compute[75080]: WARNING os_brick.initiator.connectors.iscsi [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 05 16:20:06 user nova-compute[75080]: 
Dec 05 16:20:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5 -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:20:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:20:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5612b57-0a99-4822-9873-d4bec2dfbd4c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:20:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5, portal: 172.16.0.220,3260]
Dec 05 16:20:06 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5, portal: 172.16.0.220,3260] successful.
Dec 05 16:20:06 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:20:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:20:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:20:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ac0004-42d3-46d9-a57e-452bb31e900b]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:20:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:20:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:20:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:20:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea451992-1123-4aad-be4c-ab1f77838156]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:20:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5 (non-flash)
Dec 05 16:20:06 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 16:20:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5 (non-flash)
Dec 05 16:20:06 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 16:20:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 16:20:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 16:20:06 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 16:20:06 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 16:20:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:20:06 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:20:06 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09c2d61-130b-41d4-b4d9-7a1fffd99c05]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:20:06 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 16:20:06 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KbAWROyY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 16:20:07 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 16:20:07 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26339343765326138', 'path': '/dev/sdb'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 16:20:07 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339343765326138', 'path': '/dev/sdb'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 16:20:07 user nova-compute[75080]: DEBUG nova.objects.instance [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lazy-loading 'flavor' on Instance uuid 696fd8d7-2f17-466b-a2d4-ded76be1d278 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:20:07 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 16:20:07 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 16:20:07 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 16:20:07 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 16:20:07 user nova-compute[75080]:   <serial>032bdf4b-3162-4631-b2c2-677e368b77c5</serial>
Dec 05 16:20:07 user nova-compute[75080]: </disk>
Dec 05 16:20:07 user nova-compute[75080]:  {{(pid=75080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 16:20:07 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 16:20:07 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 16:20:07 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] No VIF found with MAC fa:16:3e:70:4d:1f, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 16:20:07 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-77cfd0f0-393d-4c94-9f54-cf92376f7ecb tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.967s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:20:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:20:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2408586a-9462-40aa-aa64-72ea480caa58 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Acquiring lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:20:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2408586a-9462-40aa-aa64-72ea480caa58 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:20:10 user nova-compute[75080]: INFO nova.compute.manager [None req-2408586a-9462-40aa-aa64-72ea480caa58 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Detaching volume 032bdf4b-3162-4631-b2c2-677e368b77c5
Dec 05 16:20:10 user nova-compute[75080]: INFO nova.virt.block_device [None req-2408586a-9462-40aa-aa64-72ea480caa58 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Attempting to driver detach volume 032bdf4b-3162-4631-b2c2-677e368b77c5 from mountpoint /dev/vdb
Dec 05 16:20:10 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2408586a-9462-40aa-aa64-72ea480caa58 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Attempting to detach device vdb from instance 696fd8d7-2f17-466b-a2d4-ded76be1d278 from the persistent domain config. {{(pid=75080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 16:20:10 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-2408586a-9462-40aa-aa64-72ea480caa58 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 16:20:10 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 16:20:10 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 16:20:10 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 16:20:10 user nova-compute[75080]:   <serial>032bdf4b-3162-4631-b2c2-677e368b77c5</serial>
Dec 05 16:20:10 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 16:20:10 user nova-compute[75080]: </disk>
Dec 05 16:20:10 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 16:20:10 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-2408586a-9462-40aa-aa64-72ea480caa58 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Successfully detached device vdb from instance 696fd8d7-2f17-466b-a2d4-ded76be1d278 from the persistent domain config.
Dec 05 16:20:10 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2408586a-9462-40aa-aa64-72ea480caa58 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 696fd8d7-2f17-466b-a2d4-ded76be1d278 from the live domain config. {{(pid=75080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 16:20:10 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-2408586a-9462-40aa-aa64-72ea480caa58 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 16:20:10 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 16:20:10 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 16:20:10 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 16:20:10 user nova-compute[75080]:   <serial>032bdf4b-3162-4631-b2c2-677e368b77c5</serial>
Dec 05 16:20:10 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 16:20:10 user nova-compute[75080]: </disk>
Dec 05 16:20:10 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 16:20:10 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-2408586a-9462-40aa-aa64-72ea480caa58 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 696fd8d7-2f17-466b-a2d4-ded76be1d278 {{(pid=75080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 16:20:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:20:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:20:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:20:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:20:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:20:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:20:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:20:15 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:20:15 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:20:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:20:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:20:15 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:20:15 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 16:20:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:20:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:20:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:20:15 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:20:16 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:20:16 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:20:16 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=9005MB free_disk=24.918453216552734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 16:20:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:20:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:20:16 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 696fd8d7-2f17-466b-a2d4-ded76be1d278 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 16:20:16 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 16:20:16 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 16:20:16 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 16:20:16 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 16:20:16 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 16:20:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:20:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:20:20 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:20:20 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:20:20 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:20:20 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 16:20:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:20:23 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:20:26 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:20:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:20:30 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-2408586a-9462-40aa-aa64-72ea480caa58 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 696fd8d7-2f17-466b-a2d4-ded76be1d278 is timed out.
Dec 05 16:20:30 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-2408586a-9462-40aa-aa64-72ea480caa58 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Successfully detached device vdb from instance 696fd8d7-2f17-466b-a2d4-ded76be1d278 from the live domain config.
Dec 05 16:20:30 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2408586a-9462-40aa-aa64-72ea480caa58 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 16:20:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2408586a-9462-40aa-aa64-72ea480caa58 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KbAWROyY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 16:20:30 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-2408586a-9462-40aa-aa64-72ea480caa58 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 16:20:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-2408586a-9462-40aa-aa64-72ea480caa58 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 16:20:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-2408586a-9462-40aa-aa64-72ea480caa58 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 16:20:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:20:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:20:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd501c70-f9e3-4f18-928b-0d79bc25d4b7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:20:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2408586a-9462-40aa-aa64-72ea480caa58 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 16:20:30 user nova-compute[75080]: No targets found.
Dec 05 16:20:30 user nova-compute[75080]: iSNS:
Dec 05 16:20:30 user nova-compute[75080]: No targets found.
Dec 05 16:20:30 user nova-compute[75080]: STATIC:
Dec 05 16:20:30 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5
Dec 05 16:20:30 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 16:20:30 user nova-compute[75080]:                 Iface Name: default
Dec 05 16:20:30 user nova-compute[75080]: FIRMWARE:
Dec 05 16:20:30 user nova-compute[75080]: No targets found.
Dec 05 16:20:30 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 16:20:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2408586a-9462-40aa-aa64-72ea480caa58 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 16:20:30 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 16:20:30 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 16:20:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2408586a-9462-40aa-aa64-72ea480caa58 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 16:20:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:20:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:20:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[593f788e-e0e2-4b82-a41c-f086ac667cd1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:20:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:20:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:20:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e98e27-7b6a-478c-9699-759d7a9bdf5f]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:20:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2408586a-9462-40aa-aa64-72ea480caa58 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5 (non-flash)
Dec 05 16:20:30 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 16:20:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2408586a-9462-40aa-aa64-72ea480caa58 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5 (non-flash)
Dec 05 16:20:30 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 16:20:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2408586a-9462-40aa-aa64-72ea480caa58 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6638199510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5'): ({'sdb'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 16:20:30 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-2408586a-9462-40aa-aa64-72ea480caa58 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Removing single pathed devices sdb {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 16:20:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:20:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:20:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e41eb2b-f620-4e1e-854e-d51d878647b9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:20:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:20:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:20:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[810e37b1-258e-4bb7-8234-5f9cfdc8b11a]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:20:30 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-2408586a-9462-40aa-aa64-72ea480caa58 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Flushing IO for device /dev/sdb {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 16:20:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:20:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:20:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d56737-bc72-4513-bbcb-cdaa7036894d]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:20:30 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-2408586a-9462-40aa-aa64-72ea480caa58 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 16:20:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:20:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.027s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:20:30 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6c13d4-c8b2-4dc7-b564-c667aca58d04]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:20:30 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-2408586a-9462-40aa-aa64-72ea480caa58 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 16:20:30 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-2408586a-9462-40aa-aa64-72ea480caa58 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 16:20:30 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2408586a-9462-40aa-aa64-72ea480caa58 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 16:20:30 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:20:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:20:31 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dd193c-fb8e-493a-8b4d-9770ff49bcb8]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:20:31 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2408586a-9462-40aa-aa64-72ea480caa58 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:20:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5 -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:20:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:20:31 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d319bceb-3c2a-4e80-b801-d2435ea4884c]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:20:31 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2408586a-9462-40aa-aa64-72ea480caa58 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5, portal: 172.16.0.220,3260]
Dec 05 16:20:31 user nova-compute[75080]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5, portal: 172.16.0.220,3260] successful.
Dec 05 16:20:31 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:20:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5 -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:20:31 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:032bdf4b-3162-4631-b2c2-677e368b77c5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:20:31 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[205a0802-b7a4-4d62-9a01-a0c6b1c8c9df]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:20:31 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2408586a-9462-40aa-aa64-72ea480caa58 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:20:31 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-2408586a-9462-40aa-aa64-72ea480caa58 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 16:20:31 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2408586a-9462-40aa-aa64-72ea480caa58 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] <== disconnect_volume: return (263ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 16:20:31 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2408586a-9462-40aa-aa64-72ea480caa58 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 16:20:31 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:20:31 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 16:20:31 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Rebuilding the list of instances to heal {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 16:20:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-696fd8d7-2f17-466b-a2d4-ded76be1d278" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 16:20:31 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-696fd8d7-2f17-466b-a2d4-ded76be1d278" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 16:20:31 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 16:20:31 user nova-compute[75080]: DEBUG nova.objects.instance [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lazy-loading 'info_cache' on Instance uuid 696fd8d7-2f17-466b-a2d4-ded76be1d278 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:20:32 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Updating instance_info_cache with network_info: [{"id": "0ad31548-9664-4be8-9a83-56fa5ea2876a", "address": "fa:16:3e:70:4d:1f", "network": {"id": "a89bb50f-bce5-4f59-9926-5bc4148120a7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-219738141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41d6c012da084710b1271b53d62bc00b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad31548-96", "ovs_interfaceid": "0ad31548-9664-4be8-9a83-56fa5ea2876a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 16:20:32 user nova-compute[75080]: DEBUG nova.objects.instance [None req-2408586a-9462-40aa-aa64-72ea480caa58 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lazy-loading 'flavor' on Instance uuid 696fd8d7-2f17-466b-a2d4-ded76be1d278 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:20:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-696fd8d7-2f17-466b-a2d4-ded76be1d278" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 16:20:32 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 16:20:32 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-2408586a-9462-40aa-aa64-72ea480caa58 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.877s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:20:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:20:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:20:39 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:20:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:20:45 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:20:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:20:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:20:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:20:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:20:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:20:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:20:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:20:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:21:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:21:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Acquiring lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:21:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:21:03 user nova-compute[75080]: DEBUG nova.objects.instance [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lazy-loading 'flavor' on Instance uuid 696fd8d7-2f17-466b-a2d4-ded76be1d278 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:21:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:21:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:21:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Acquiring lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:21:03 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:21:03 user nova-compute[75080]: INFO nova.compute.manager [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Attaching volume b00ed7ab-c55f-4b24-bf3a-9c76061d9a69 to /dev/vdb
Dec 05 16:21:03 user nova-compute[75080]: DEBUG os_brick.utils [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 16:21:03 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:21:03 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:21:03 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62fd013-0991-4e2e-a07a-2c8f028421c7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:21:03 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:21:03 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:21:03 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b79adf2-2e6b-4ea2-a847-081d47f7caae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:21:03 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:21:03 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:21:03 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0f07c2-f00e-4cff-a05c-feb88621ed65]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:21:03 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdf84e0-fe75-4ba0-b597-f99fdc246fd8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:21:03 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:21:03 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 16:21:03 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 16:21:03 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:21:03 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 16:21:03 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 16:21:03 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cd07ef-bbbd-4fed-a150-ccc1403d8ab4]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:21:03 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 16:21:03 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 16:21:03 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 16:21:03 user nova-compute[75080]: DEBUG os_brick.utils [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 16:21:03 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Updating existing volume attachment record: e9886904-e83a-42bd-b861-39feb6e9e95f {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 16:21:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:21:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKxAmpvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 16:21:12 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 16:21:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 16:21:12 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 16:21:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 16:21:12 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 16:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69 -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[959debf0-9468-47ef-b05a-7b1f23c032dd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 16:21:12 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69 -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb782b2-280f-485a-8c7a-7bc542104719]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69] added
Dec 05 16:21:12 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29c4a43-4e66-4062-94f5-2256b3112882]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dec7381-2289-4175-8689-55fbdd4aee7e]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NKxAmpvT {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NKxAmpvT" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[972366a5-53c9-4051-9546-e933e6fa56a9]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NKxAmpvT'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f53ac16-95d3-40f0-9731-8e2593ee32ed]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae12d59a-6375-4cb9-9101-c7e2f8ae2c94]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 05 16:21:12 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 05 16:21:12 user nova-compute[75080]:  {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 16:21:12 user nova-compute[75080]: WARNING os_brick.initiator.connectors.iscsi [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 05 16:21:12 user nova-compute[75080]: 
Dec 05 16:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69 -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed40912e-05ea-4af4-9dfb-9705eb481ad3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69, portal: 172.16.0.220,3260]
Dec 05 16:21:12 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69, portal: 172.16.0.220,3260] successful.
Dec 05 16:21:12 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4351994a-4d41-4091-8596-53aeb866a95c]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[73751142-c90f-4baa-b6f5-4bdc316d97cf]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69 (non-flash)
Dec 05 16:21:12 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69 (non-flash)
Dec 05 16:21:12 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58a6b54-cf86-4f78-b398-94b7509c5b06]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 16:21:12 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKxAmpvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 16:21:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:21:13 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 16:21:13 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23031633937333061', 'path': '/dev/sdb'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 16:21:13 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031633937333061', 'path': '/dev/sdb'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 16:21:13 user nova-compute[75080]: DEBUG nova.objects.instance [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lazy-loading 'flavor' on Instance uuid 696fd8d7-2f17-466b-a2d4-ded76be1d278 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:21:13 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 16:21:13 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 16:21:13 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 16:21:13 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 16:21:13 user nova-compute[75080]:   <serial>b00ed7ab-c55f-4b24-bf3a-9c76061d9a69</serial>
Dec 05 16:21:13 user nova-compute[75080]: </disk>
Dec 05 16:21:13 user nova-compute[75080]:  {{(pid=75080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 16:21:14 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 16:21:14 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 16:21:14 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] No VIF found with MAC fa:16:3e:70:4d:1f, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 16:21:14 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ba24031b-58bf-44d8-976f-4763a043020f tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.119s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:21:16 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:21:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c0dfb580-9945-4de1-bb81-b173ea278ab1 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Acquiring lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:21:16 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c0dfb580-9945-4de1-bb81-b173ea278ab1 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:21:16 user nova-compute[75080]: INFO nova.compute.manager [None req-c0dfb580-9945-4de1-bb81-b173ea278ab1 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Detaching volume b00ed7ab-c55f-4b24-bf3a-9c76061d9a69
Dec 05 16:21:16 user nova-compute[75080]: INFO nova.virt.block_device [None req-c0dfb580-9945-4de1-bb81-b173ea278ab1 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Attempting to driver detach volume b00ed7ab-c55f-4b24-bf3a-9c76061d9a69 from mountpoint /dev/vdb
Dec 05 16:21:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c0dfb580-9945-4de1-bb81-b173ea278ab1 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Attempting to detach device vdb from instance 696fd8d7-2f17-466b-a2d4-ded76be1d278 from the persistent domain config. {{(pid=75080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 16:21:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-c0dfb580-9945-4de1-bb81-b173ea278ab1 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 16:21:16 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 16:21:16 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 16:21:16 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 16:21:16 user nova-compute[75080]:   <serial>b00ed7ab-c55f-4b24-bf3a-9c76061d9a69</serial>
Dec 05 16:21:16 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 16:21:16 user nova-compute[75080]: </disk>
Dec 05 16:21:16 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 16:21:16 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-c0dfb580-9945-4de1-bb81-b173ea278ab1 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Successfully detached device vdb from instance 696fd8d7-2f17-466b-a2d4-ded76be1d278 from the persistent domain config.
Dec 05 16:21:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c0dfb580-9945-4de1-bb81-b173ea278ab1 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 696fd8d7-2f17-466b-a2d4-ded76be1d278 from the live domain config. {{(pid=75080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 16:21:16 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-c0dfb580-9945-4de1-bb81-b173ea278ab1 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 16:21:16 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 16:21:16 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 16:21:16 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 16:21:16 user nova-compute[75080]:   <serial>b00ed7ab-c55f-4b24-bf3a-9c76061d9a69</serial>
Dec 05 16:21:16 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 16:21:16 user nova-compute[75080]: </disk>
Dec 05 16:21:16 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 16:21:17 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-c0dfb580-9945-4de1-bb81-b173ea278ab1 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 696fd8d7-2f17-466b-a2d4-ded76be1d278 {{(pid=75080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 16:21:17 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:21:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:21:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:21:17 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:21:17 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 16:21:17 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:21:17 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:21:17 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:21:17 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:21:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:21:18 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:21:18 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:21:18 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=9007MB free_disk=24.917438507080078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 16:21:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:21:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:21:18 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 696fd8d7-2f17-466b-a2d4-ded76be1d278 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 16:21:18 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 16:21:18 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 16:21:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:21:18 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 16:21:18 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 16:21:18 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 16:21:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:21:21 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:21:21 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:21:21 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:21:21 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 16:21:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:21:24 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:21:26 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:21:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:21:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:21:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:21:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:21:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:21:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:21:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:21:33 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:21:33 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 16:21:33 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Rebuilding the list of instances to heal {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 16:21:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-696fd8d7-2f17-466b-a2d4-ded76be1d278" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 16:21:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-696fd8d7-2f17-466b-a2d4-ded76be1d278" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 16:21:33 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 16:21:33 user nova-compute[75080]: DEBUG nova.objects.instance [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lazy-loading 'info_cache' on Instance uuid 696fd8d7-2f17-466b-a2d4-ded76be1d278 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:21:33 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Updating instance_info_cache with network_info: [{"id": "0ad31548-9664-4be8-9a83-56fa5ea2876a", "address": "fa:16:3e:70:4d:1f", "network": {"id": "a89bb50f-bce5-4f59-9926-5bc4148120a7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-219738141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41d6c012da084710b1271b53d62bc00b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad31548-96", "ovs_interfaceid": "0ad31548-9664-4be8-9a83-56fa5ea2876a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 16:21:33 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-696fd8d7-2f17-466b-a2d4-ded76be1d278" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 16:21:33 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 16:21:37 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-c0dfb580-9945-4de1-bb81-b173ea278ab1 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 696fd8d7-2f17-466b-a2d4-ded76be1d278 is timed out.
Dec 05 16:21:37 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-c0dfb580-9945-4de1-bb81-b173ea278ab1 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Successfully detached device vdb from instance 696fd8d7-2f17-466b-a2d4-ded76be1d278 from the live domain config.
Dec 05 16:21:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0dfb580-9945-4de1-bb81-b173ea278ab1 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0dfb580-9945-4de1-bb81-b173ea278ab1 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKxAmpvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 16:21:37 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-c0dfb580-9945-4de1-bb81-b173ea278ab1 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 16:21:37 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-c0dfb580-9945-4de1-bb81-b173ea278ab1 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-c0dfb580-9945-4de1-bb81-b173ea278ab1 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[baadedc8-d88a-44e6-b58d-5ef33f27fdeb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0dfb580-9945-4de1-bb81-b173ea278ab1 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 16:21:37 user nova-compute[75080]: No targets found.
Dec 05 16:21:37 user nova-compute[75080]: iSNS:
Dec 05 16:21:37 user nova-compute[75080]: No targets found.
Dec 05 16:21:37 user nova-compute[75080]: STATIC:
Dec 05 16:21:37 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69
Dec 05 16:21:37 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 16:21:37 user nova-compute[75080]:                 Iface Name: default
Dec 05 16:21:37 user nova-compute[75080]: FIRMWARE:
Dec 05 16:21:37 user nova-compute[75080]: No targets found.
Dec 05 16:21:37 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0dfb580-9945-4de1-bb81-b173ea278ab1 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 16:21:37 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 16:21:37 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0dfb580-9945-4de1-bb81-b173ea278ab1 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c7ed48-361e-4a92-9b07-cca8693a0e3e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf198bf-72de-4a4d-b814-c667056ee5fe]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69 (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0dfb580-9945-4de1-bb81-b173ea278ab1 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69 (non-flash)
Dec 05 16:21:37 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0dfb580-9945-4de1-bb81-b173ea278ab1 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69 (non-flash)
Dec 05 16:21:37 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0dfb580-9945-4de1-bb81-b173ea278ab1 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f66384aab90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69'): ({'sdb'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-c0dfb580-9945-4de1-bb81-b173ea278ab1 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Removing single pathed devices sdb {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca98017-03f3-49ee-8feb-4c6f41f89acc]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2b46af-228d-4280-86ec-0ba4016b8b42]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-c0dfb580-9945-4de1-bb81-b173ea278ab1 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Flushing IO for device /dev/sdb {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef356c3-2734-4ed9-8f29-92b29e046b2e]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-c0dfb580-9945-4de1-bb81-b173ea278ab1 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d68fe1f-d10a-4748-aca3-ab6c6c4c2566]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-c0dfb580-9945-4de1-bb81-b173ea278ab1 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-c0dfb580-9945-4de1-bb81-b173ea278ab1 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0dfb580-9945-4de1-bb81-b173ea278ab1 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cacbb71c-639e-4b1a-aacc-dad2a968908b]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0dfb580-9945-4de1-bb81-b173ea278ab1 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69 -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd7a8f8-0d35-4fa6-9144-075b7150eb00]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0dfb580-9945-4de1-bb81-b173ea278ab1 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69, portal: 172.16.0.220,3260]
Dec 05 16:21:37 user nova-compute[75080]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69, portal: 172.16.0.220,3260] successful.
Dec 05 16:21:37 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69 -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b00ed7ab-c55f-4b24-bf3a-9c76061d9a69 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3446d25b-d927-4d5f-8b51-a8048c05a68f]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0dfb580-9945-4de1-bb81-b173ea278ab1 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-c0dfb580-9945-4de1-bb81-b173ea278ab1 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0dfb580-9945-4de1-bb81-b173ea278ab1 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] <== disconnect_volume: return (293ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 16:21:37 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0dfb580-9945-4de1-bb81-b173ea278ab1 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 16:21:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:21:38 user nova-compute[75080]: DEBUG nova.objects.instance [None req-c0dfb580-9945-4de1-bb81-b173ea278ab1 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lazy-loading 'flavor' on Instance uuid 696fd8d7-2f17-466b-a2d4-ded76be1d278 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:21:38 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-c0dfb580-9945-4de1-bb81-b173ea278ab1 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.017s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:21:39 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:21:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:21:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:21:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:21:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:21:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:21:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:21:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:21:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:21:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:22:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:22:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:22:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:22:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:22:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:22:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:22:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:22:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Acquiring lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:22:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:22:09 user nova-compute[75080]: DEBUG nova.objects.instance [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lazy-loading 'flavor' on Instance uuid 696fd8d7-2f17-466b-a2d4-ded76be1d278 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:22:09 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:22:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Acquiring lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:22:10 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:22:10 user nova-compute[75080]: INFO nova.compute.manager [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Attaching volume 4ac8be4b-9ae7-4e58-bdd0-841efa536f4c to /dev/vdb
Dec 05 16:22:10 user nova-compute[75080]: DEBUG os_brick.utils [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 16:22:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:22:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:22:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99c24c0-188a-4071-9d1f-fd319908f3ca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2588e0e8f7dc\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:22:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:22:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:22:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00c7d22-ff6e-4851-abac-88e58a18bbba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:22:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:22:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:22:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[748b5e1b-f216-4ed5-9374-94a09c7235b0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:22:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d02b68-eef7-48ac-ae09-6b49ab8e1d7b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:22:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Running cmd (subprocess): nvme version {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:22:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] 'nvme version' failed. Not Retrying. {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 16:22:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] nvme not present on system {{(pid=75080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 16:22:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:22:10 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 16:22:10 user nova-compute[75080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 16:22:10 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[593694ff-3482-4f3a-8f9a-680d089f7237]: (4, '') {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:22:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 16:22:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 16:22:10 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.lightos [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] LIGHTOS: no hostnqn found. {{(pid=75080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 16:22:10 user nova-compute[75080]: DEBUG os_brick.utils [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2588e0e8f7dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 16:22:10 user nova-compute[75080]: DEBUG nova.virt.block_device [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Updating existing volume attachment record: c57eeabc-744c-41e4-80cf-a835bd9acca2 {{(pid=75080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 16:22:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:22:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:22:17 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:22:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:22:18 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:22:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:22:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:22:18 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:22:18 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 16:22:18 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:22:18 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:22:18 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:22:18 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Calling os-brick to attach iSCSI Volume {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iRDsJwUv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 16:22:19 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 16:22:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 16:22:19 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 16:22:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 16:22:19 user nova-compute[75080]: INFO os_brick.initiator.connectors.iscsi [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 16:22:19 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:22:19 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:22:19 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=9018MB free_disk=24.91665267944336GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c -p 172.16.0.220:3260 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[59069993-c201-4bc5-9ae0-68244419adf5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 16:22:19 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c -p 172.16.0.220:3260 --interface default --op new {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[061416f4-84ba-4b65-9f50-70f7102c5208]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c] added\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c] added
Dec 05 16:22:19 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[101369ff-d9ab-4809-bc34-b2d5c8a55b62]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[066bd0b6-c1bc-4739-873c-598dec0859a2]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iRDsJwUv {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iRDsJwUv" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45071aa-598b-4422-b6a8-6c1cadccbbeb]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iRDsJwUv'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d214824-9b1e-481e-bee7-9bf22404cba5]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b198128-ea44-4932-bd53-ec2bde98f1d4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 05 16:22:19 user nova-compute[75080]:  {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 05 16:22:19 user nova-compute[75080]:  {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 16:22:19 user nova-compute[75080]: WARNING os_brick.initiator.connectors.iscsi [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 05 16:22:19 user nova-compute[75080]: 
Dec 05 16:22:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c -p 172.16.0.220:3260 --login {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a5f33c-ea3f-4901-8c79-d4a02bb9ac15]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c, portal: 172.16.0.220,3260]
Dec 05 16:22:19 user nova-compute[75080]: Login to [iface: default, target: iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c, portal: 172.16.0.220,3260] successful.
Dec 05 16:22:19 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[db21f5ba-5a89-4635-a1cf-f06165bf5bc9]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a837405-48a7-4811-80af-f49497d2b448]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c (non-flash)
Dec 05 16:22:19 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c (non-flash)
Dec 05 16:22:19 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Connected to 172.16.0.220:3260 {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=75080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca64e5b-4865-45ec-aefb-0655228d7b22]: (4, ('- - 0', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iRDsJwUv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 696fd8d7-2f17-466b-a2d4-ded76be1d278 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 16:22:19 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.461s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:22:20 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 16:22:20 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23730626332616137', 'path': '/dev/sdb'} {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 16:22:20 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730626332616137', 'path': '/dev/sdb'} {{(pid=75080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 16:22:20 user nova-compute[75080]: DEBUG nova.objects.instance [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lazy-loading 'flavor' on Instance uuid 696fd8d7-2f17-466b-a2d4-ded76be1d278 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:22:20 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 16:22:20 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 16:22:20 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 16:22:20 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 16:22:20 user nova-compute[75080]:   <serial>4ac8be4b-9ae7-4e58-bdd0-841efa536f4c</serial>
Dec 05 16:22:20 user nova-compute[75080]: </disk>
Dec 05 16:22:20 user nova-compute[75080]:  {{(pid=75080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 16:22:21 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] No BDM found with device name vda, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 16:22:21 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 16:22:21 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] No VIF found with MAC fa:16:3e:70:4d:1f, not building metadata {{(pid=75080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 16:22:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-1b093b9a-2b6f-45d4-8a2d-9970c7ac8558 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.083s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:22:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:22:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:22:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:22:22 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 16:22:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:22:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:22:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ab5cbb25-553a-4187-8361-2e63f837840d tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Acquiring lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:22:23 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ab5cbb25-553a-4187-8361-2e63f837840d tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:22:23 user nova-compute[75080]: INFO nova.compute.manager [None req-ab5cbb25-553a-4187-8361-2e63f837840d tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Detaching volume 4ac8be4b-9ae7-4e58-bdd0-841efa536f4c
Dec 05 16:22:23 user nova-compute[75080]: INFO nova.virt.block_device [None req-ab5cbb25-553a-4187-8361-2e63f837840d tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Attempting to driver detach volume 4ac8be4b-9ae7-4e58-bdd0-841efa536f4c from mountpoint /dev/vdb
Dec 05 16:22:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ab5cbb25-553a-4187-8361-2e63f837840d tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Attempting to detach device vdb from instance 696fd8d7-2f17-466b-a2d4-ded76be1d278 from the persistent domain config. {{(pid=75080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 16:22:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-ab5cbb25-553a-4187-8361-2e63f837840d tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 16:22:23 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 16:22:23 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 16:22:23 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 16:22:23 user nova-compute[75080]:   <serial>4ac8be4b-9ae7-4e58-bdd0-841efa536f4c</serial>
Dec 05 16:22:23 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 16:22:23 user nova-compute[75080]: </disk>
Dec 05 16:22:23 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 16:22:23 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-ab5cbb25-553a-4187-8361-2e63f837840d tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Successfully detached device vdb from instance 696fd8d7-2f17-466b-a2d4-ded76be1d278 from the persistent domain config.
Dec 05 16:22:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ab5cbb25-553a-4187-8361-2e63f837840d tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 696fd8d7-2f17-466b-a2d4-ded76be1d278 from the live domain config. {{(pid=75080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 16:22:23 user nova-compute[75080]: DEBUG nova.virt.libvirt.guest [None req-ab5cbb25-553a-4187-8361-2e63f837840d tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 16:22:23 user nova-compute[75080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 16:22:23 user nova-compute[75080]:   <source dev="/dev/sdb"/>
Dec 05 16:22:23 user nova-compute[75080]:   <target dev="vdb" bus="virtio"/>
Dec 05 16:22:23 user nova-compute[75080]:   <serial>4ac8be4b-9ae7-4e58-bdd0-841efa536f4c</serial>
Dec 05 16:22:23 user nova-compute[75080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 16:22:23 user nova-compute[75080]: </disk>
Dec 05 16:22:23 user nova-compute[75080]:  {{(pid=75080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 16:22:24 user nova-compute[75080]: DEBUG nova.virt.libvirt.driver [None req-ab5cbb25-553a-4187-8361-2e63f837840d tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 696fd8d7-2f17-466b-a2d4-ded76be1d278 {{(pid=75080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 16:22:26 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:22:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:22:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:22:28 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:22:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:22:34 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:22:34 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 16:22:34 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Rebuilding the list of instances to heal {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 16:22:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-696fd8d7-2f17-466b-a2d4-ded76be1d278" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 16:22:34 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-696fd8d7-2f17-466b-a2d4-ded76be1d278" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 16:22:34 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 16:22:34 user nova-compute[75080]: DEBUG nova.objects.instance [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lazy-loading 'info_cache' on Instance uuid 696fd8d7-2f17-466b-a2d4-ded76be1d278 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:22:35 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Updating instance_info_cache with network_info: [{"id": "0ad31548-9664-4be8-9a83-56fa5ea2876a", "address": "fa:16:3e:70:4d:1f", "network": {"id": "a89bb50f-bce5-4f59-9926-5bc4148120a7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-219738141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41d6c012da084710b1271b53d62bc00b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad31548-96", "ovs_interfaceid": "0ad31548-9664-4be8-9a83-56fa5ea2876a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 16:22:35 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-696fd8d7-2f17-466b-a2d4-ded76be1d278" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 16:22:35 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 16:22:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:22:40 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:22:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:22:44 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-ab5cbb25-553a-4187-8361-2e63f837840d tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 696fd8d7-2f17-466b-a2d4-ded76be1d278 is timed out.
Dec 05 16:22:44 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-ab5cbb25-553a-4187-8361-2e63f837840d tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Successfully detached device vdb from instance 696fd8d7-2f17-466b-a2d4-ded76be1d278 from the live domain config.
Dec 05 16:22:44 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab5cbb25-553a-4187-8361-2e63f837840d tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] calling os-brick to detach iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5cbb25-553a-4187-8361-2e63f837840d tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f665c1c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iRDsJwUv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 16:22:44 user nova-compute[75080]: WARNING os_brick.initiator.connectors.base [None req-ab5cbb25-553a-4187-8361-2e63f837840d tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 16:22:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-ab5cbb25-553a-4187-8361-2e63f837840d tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-ab5cbb25-553a-4187-8361-2e63f837840d tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[90afd5f6-c46a-46bf-8ad0-1116b8c30795]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5cbb25-553a-4187-8361-2e63f837840d tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 16:22:44 user nova-compute[75080]: No targets found.
Dec 05 16:22:44 user nova-compute[75080]: iSNS:
Dec 05 16:22:44 user nova-compute[75080]: No targets found.
Dec 05 16:22:44 user nova-compute[75080]: STATIC:
Dec 05 16:22:44 user nova-compute[75080]: Target: iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c
Dec 05 16:22:44 user nova-compute[75080]:         Portal: 172.16.0.220:3260,-1
Dec 05 16:22:44 user nova-compute[75080]:                 Iface Name: default
Dec 05 16:22:44 user nova-compute[75080]: FIRMWARE:
Dec 05 16:22:44 user nova-compute[75080]: No targets found.
Dec 05 16:22:44 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5cbb25-553a-4187-8361-2e63f837840d tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 16:22:44 user nova-compute[75080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 16:22:44 user nova-compute[75080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5cbb25-553a-4187-8361-2e63f837840d tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c', 0)] {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d16a957-b0c3-45b0-8fa5-060d9d357591]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[015b3b10-7a12-435d-b967-a5565d09a821]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c (non-flash)\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5cbb25-553a-4187-8361-2e63f837840d tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c (non-flash)
Dec 05 16:22:44 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5cbb25-553a-4187-8361-2e63f837840d tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c (non-flash)
Dec 05 16:22:44 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5cbb25-553a-4187-8361-2e63f837840d tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f66384e1bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c'): ({'sdb'}, set())}) {{(pid=75080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-ab5cbb25-553a-4187-8361-2e63f837840d tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Removing single pathed devices sdb {{(pid=75080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9321c5-6915-4074-945c-dcd1a3fbff37]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1288b9b-f069-4749-a2f3-375237b6ead3]: (4, ('ok\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-ab5cbb25-553a-4187-8361-2e63f837840d tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Flushing IO for device /dev/sdb {{(pid=75080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb871df5-c967-42ad-a9b3-2b3d03d66dfb]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-ab5cbb25-553a-4187-8361-2e63f837840d tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b53bdf1-a403-43e5-899e-b88c1491f013]: (4, ('1', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-ab5cbb25-553a-4187-8361-2e63f837840d tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG os_brick.initiator.linuxscsi [None req-ab5cbb25-553a-4187-8361-2e63f837840d tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] SCSI volumes sdb have been removed. {{(pid=75080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5cbb25-553a-4187-8361-2e63f837840d tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c')] {{(pid=75080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5887de35-efb9-4522-aa8e-35f8af4ebfb8]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5cbb25-553a-4187-8361-2e63f837840d tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c -p 172.16.0.220:3260 --logout {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c -p 172.16.0.220:3260 --logout" returned: 0 in 0.041s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e711593-cb78-425a-a793-132bc3cbf541]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5cbb25-553a-4187-8361-2e63f837840d tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c, portal: 172.16.0.220,3260]
Dec 05 16:22:44 user nova-compute[75080]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c, portal: 172.16.0.220,3260] successful.
Dec 05 16:22:44 user nova-compute[75080]:  stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c -p 172.16.0.220:3260 --op delete {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ac8be4b-9ae7-4e58-bdd0-841efa536f4c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG oslo.privsep.daemon [-] privsep: reply[176e2793-2e4c-49cd-8846-4176f8364ece]: (4, ('', '')) {{(pid=86242) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5cbb25-553a-4187-8361-2e63f837840d tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.base [None req-ab5cbb25-553a-4187-8361-2e63f837840d tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5cbb25-553a-4187-8361-2e63f837840d tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] <== disconnect_volume: return (270ms) None {{(pid=75080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 16:22:44 user nova-compute[75080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab5cbb25-553a-4187-8361-2e63f837840d tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Disconnected iSCSI Volume {{(pid=75080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 16:22:45 user nova-compute[75080]: DEBUG nova.objects.instance [None req-ab5cbb25-553a-4187-8361-2e63f837840d tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lazy-loading 'flavor' on Instance uuid 696fd8d7-2f17-466b-a2d4-ded76be1d278 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:22:45 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-ab5cbb25-553a-4187-8361-2e63f837840d tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.622s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:22:47 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:22:48 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:22:53 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:22:58 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:23:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:23:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:23:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:23:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:23:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:23:03 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:23:08 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:23:13 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:23:17 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:23:18 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:23:20 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:23:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:23:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:23:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:23:20 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 16:23:20 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:23:20 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:23:20 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/disk --force-share --output=json {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 16:23:20 user nova-compute[75080]: DEBUG oslo_concurrency.processutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 16:23:21 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:23:21 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:23:21 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=9021MB free_disk=24.915695190429688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 16:23:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:23:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:23:21 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Instance 696fd8d7-2f17-466b-a2d4-ded76be1d278 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 16:23:21 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 16:23:21 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 16:23:21 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 16:23:21 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 16:23:21 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 16:23:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:23:23 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:23:23 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:23:23 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:23:23 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 16:23:23 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:23:27 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:23:28 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:23:29 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:23:33 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:23:36 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:23:36 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 16:23:36 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Rebuilding the list of instances to heal {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 16:23:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "refresh_cache-696fd8d7-2f17-466b-a2d4-ded76be1d278" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 16:23:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquired lock "refresh_cache-696fd8d7-2f17-466b-a2d4-ded76be1d278" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 16:23:36 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Forcefully refreshing network info cache for instance {{(pid=75080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 16:23:36 user nova-compute[75080]: DEBUG nova.objects.instance [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lazy-loading 'info_cache' on Instance uuid 696fd8d7-2f17-466b-a2d4-ded76be1d278 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:23:36 user nova-compute[75080]: DEBUG nova.network.neutron [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Updating instance_info_cache with network_info: [{"id": "0ad31548-9664-4be8-9a83-56fa5ea2876a", "address": "fa:16:3e:70:4d:1f", "network": {"id": "a89bb50f-bce5-4f59-9926-5bc4148120a7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-219738141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41d6c012da084710b1271b53d62bc00b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad31548-96", "ovs_interfaceid": "0ad31548-9664-4be8-9a83-56fa5ea2876a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 16:23:36 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Releasing lock "refresh_cache-696fd8d7-2f17-466b-a2d4-ded76be1d278" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 16:23:36 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Updated the network info_cache for instance {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 16:23:38 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:23:40 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:23:43 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:23:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0595375c-b484-481b-86ef-024947cfd196 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Acquiring lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:23:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0595375c-b484-481b-86ef-024947cfd196 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:23:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0595375c-b484-481b-86ef-024947cfd196 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Acquiring lock "696fd8d7-2f17-466b-a2d4-ded76be1d278-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:23:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0595375c-b484-481b-86ef-024947cfd196 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "696fd8d7-2f17-466b-a2d4-ded76be1d278-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:23:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0595375c-b484-481b-86ef-024947cfd196 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "696fd8d7-2f17-466b-a2d4-ded76be1d278-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:23:44 user nova-compute[75080]: INFO nova.compute.manager [None req-0595375c-b484-481b-86ef-024947cfd196 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Terminating instance
Dec 05 16:23:44 user nova-compute[75080]: DEBUG nova.compute.manager [None req-0595375c-b484-481b-86ef-024947cfd196 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Start destroying the instance on the hypervisor. {{(pid=75080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 16:23:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:23:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:23:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:23:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:23:44 user nova-compute[75080]: DEBUG nova.compute.manager [req-45d94b36-4d03-4b76-a59b-0e7d3eca5d2c req-d5352782-54aa-41d4-a2f8-27874568e823 service nova] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Received event network-vif-unplugged-0ad31548-9664-4be8-9a83-56fa5ea2876a {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 16:23:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-45d94b36-4d03-4b76-a59b-0e7d3eca5d2c req-d5352782-54aa-41d4-a2f8-27874568e823 service nova] Acquiring lock "696fd8d7-2f17-466b-a2d4-ded76be1d278-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:23:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-45d94b36-4d03-4b76-a59b-0e7d3eca5d2c req-d5352782-54aa-41d4-a2f8-27874568e823 service nova] Lock "696fd8d7-2f17-466b-a2d4-ded76be1d278-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:23:44 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-45d94b36-4d03-4b76-a59b-0e7d3eca5d2c req-d5352782-54aa-41d4-a2f8-27874568e823 service nova] Lock "696fd8d7-2f17-466b-a2d4-ded76be1d278-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:23:44 user nova-compute[75080]: DEBUG nova.compute.manager [req-45d94b36-4d03-4b76-a59b-0e7d3eca5d2c req-d5352782-54aa-41d4-a2f8-27874568e823 service nova] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] No waiting events found dispatching network-vif-unplugged-0ad31548-9664-4be8-9a83-56fa5ea2876a {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 16:23:44 user nova-compute[75080]: DEBUG nova.compute.manager [req-45d94b36-4d03-4b76-a59b-0e7d3eca5d2c req-d5352782-54aa-41d4-a2f8-27874568e823 service nova] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Received event network-vif-unplugged-0ad31548-9664-4be8-9a83-56fa5ea2876a for instance with task_state deleting. {{(pid=75080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 16:23:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:23:44 user nova-compute[75080]: INFO nova.virt.libvirt.driver [-] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Instance destroyed successfully.
Dec 05 16:23:44 user nova-compute[75080]: DEBUG nova.objects.instance [None req-0595375c-b484-481b-86ef-024947cfd196 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lazy-loading 'resources' on Instance uuid 696fd8d7-2f17-466b-a2d4-ded76be1d278 {{(pid=75080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 16:23:44 user nova-compute[75080]: DEBUG nova.virt.libvirt.vif [None req-0595375c-b484-481b-86ef-024947cfd196 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T16:16:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1357306062',display_name='tempest-SnapshotDataIntegrityTests-server-1357306062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1357306062',id=53,image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhiAU+EYk5VKmXMIlzTv2O77KmTJhJFoUNk+Q2xaR2+spflJ7RMOES2qDlP+EOh0z2mc1Dq1Yea7igjNxHvegcA336D/YO2Zs2cP5UiZbZTBvxolgc/MfuXeevmpCtiww==',key_name='tempest-keypair-37069972',keypairs=<?>,launch_index=0,launched_at=2023-12-05T16:16:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41d6c012da084710b1271b53d62bc00b',ramdisk_id='',reservation_id='r-bkg8syil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='945b9282-153c-4cca-bc1c-40b0d399f793',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-653227929',owner_user_name='tempest-SnapshotDataIntegrityTests-653227929-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T16:16:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d1ba78be5b542a7abdca5f98c067153',uuid=696fd8d7-2f17-466b-a2d4-ded76be1d278,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ad31548-9664-4be8-9a83-56fa5ea2876a", "address": "fa:16:3e:70:4d:1f", "network": {"id": "a89bb50f-bce5-4f59-9926-5bc4148120a7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-219738141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41d6c012da084710b1271b53d62bc00b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad31548-96", "ovs_interfaceid": "0ad31548-9664-4be8-9a83-56fa5ea2876a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 16:23:44 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-0595375c-b484-481b-86ef-024947cfd196 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Converting VIF {"id": "0ad31548-9664-4be8-9a83-56fa5ea2876a", "address": "fa:16:3e:70:4d:1f", "network": {"id": "a89bb50f-bce5-4f59-9926-5bc4148120a7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-219738141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41d6c012da084710b1271b53d62bc00b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad31548-96", "ovs_interfaceid": "0ad31548-9664-4be8-9a83-56fa5ea2876a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 16:23:44 user nova-compute[75080]: DEBUG nova.network.os_vif_util [None req-0595375c-b484-481b-86ef-024947cfd196 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:4d:1f,bridge_name='br-int',has_traffic_filtering=True,id=0ad31548-9664-4be8-9a83-56fa5ea2876a,network=Network(a89bb50f-bce5-4f59-9926-5bc4148120a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ad31548-96') {{(pid=75080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 16:23:44 user nova-compute[75080]: DEBUG os_vif [None req-0595375c-b484-481b-86ef-024947cfd196 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:4d:1f,bridge_name='br-int',has_traffic_filtering=True,id=0ad31548-9664-4be8-9a83-56fa5ea2876a,network=Network(a89bb50f-bce5-4f59-9926-5bc4148120a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ad31548-96') {{(pid=75080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 16:23:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:23:44 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ad31548-96, bridge=br-int, if_exists=True) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 16:23:45 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:23:45 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:23:45 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:23:45 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=64a6b03f-3a0a-40c7-888f-716e88cfce5c) {{(pid=75080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 16:23:45 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:23:45 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:23:45 user nova-compute[75080]: INFO os_vif [None req-0595375c-b484-481b-86ef-024947cfd196 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:4d:1f,bridge_name='br-int',has_traffic_filtering=True,id=0ad31548-9664-4be8-9a83-56fa5ea2876a,network=Network(a89bb50f-bce5-4f59-9926-5bc4148120a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ad31548-96')
Dec 05 16:23:45 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-0595375c-b484-481b-86ef-024947cfd196 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Deleting instance files /opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278_del
Dec 05 16:23:45 user nova-compute[75080]: INFO nova.virt.libvirt.driver [None req-0595375c-b484-481b-86ef-024947cfd196 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Deletion of /opt/stack/data/nova/instances/696fd8d7-2f17-466b-a2d4-ded76be1d278_del complete
Dec 05 16:23:45 user nova-compute[75080]: INFO nova.compute.manager [None req-0595375c-b484-481b-86ef-024947cfd196 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Took 0.90 seconds to destroy the instance on the hypervisor.
Dec 05 16:23:45 user nova-compute[75080]: DEBUG oslo.service.loopingcall [None req-0595375c-b484-481b-86ef-024947cfd196 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 16:23:45 user nova-compute[75080]: DEBUG nova.compute.manager [-] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Deallocating network for instance {{(pid=75080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 16:23:45 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] deallocate_for_instance() {{(pid=75080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 16:23:46 user nova-compute[75080]: DEBUG nova.network.neutron [-] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Updating instance_info_cache with network_info: [] {{(pid=75080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 16:23:46 user nova-compute[75080]: INFO nova.compute.manager [-] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Took 1.11 seconds to deallocate network for instance.
Dec 05 16:23:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0595375c-b484-481b-86ef-024947cfd196 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:23:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0595375c-b484-481b-86ef-024947cfd196 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:23:46 user nova-compute[75080]: DEBUG nova.compute.manager [req-0228a015-8334-4d94-972b-24713c5e4d96 req-6ed86c5c-cdf2-4f83-9369-137df2e426fc service nova] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Received event network-vif-deleted-0ad31548-9664-4be8-9a83-56fa5ea2876a {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 16:23:46 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-0595375c-b484-481b-86ef-024947cfd196 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 16:23:46 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-0595375c-b484-481b-86ef-024947cfd196 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 16:23:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0595375c-b484-481b-86ef-024947cfd196 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.142s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:23:46 user nova-compute[75080]: INFO nova.scheduler.client.report [None req-0595375c-b484-481b-86ef-024947cfd196 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Deleted allocations for instance 696fd8d7-2f17-466b-a2d4-ded76be1d278
Dec 05 16:23:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-0595375c-b484-481b-86ef-024947cfd196 tempest-SnapshotDataIntegrityTests-653227929 tempest-SnapshotDataIntegrityTests-653227929-project-member] Lock "696fd8d7-2f17-466b-a2d4-ded76be1d278" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.359s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:23:46 user nova-compute[75080]: DEBUG nova.compute.manager [req-583afa75-e9e5-471a-89dc-6410e122007e req-db764f38-7b90-4df4-91ec-86d169abe45c service nova] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Received event network-vif-plugged-0ad31548-9664-4be8-9a83-56fa5ea2876a {{(pid=75080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 16:23:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-583afa75-e9e5-471a-89dc-6410e122007e req-db764f38-7b90-4df4-91ec-86d169abe45c service nova] Acquiring lock "696fd8d7-2f17-466b-a2d4-ded76be1d278-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:23:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-583afa75-e9e5-471a-89dc-6410e122007e req-db764f38-7b90-4df4-91ec-86d169abe45c service nova] Lock "696fd8d7-2f17-466b-a2d4-ded76be1d278-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:23:46 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [req-583afa75-e9e5-471a-89dc-6410e122007e req-db764f38-7b90-4df4-91ec-86d169abe45c service nova] Lock "696fd8d7-2f17-466b-a2d4-ded76be1d278-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:23:46 user nova-compute[75080]: DEBUG nova.compute.manager [req-583afa75-e9e5-471a-89dc-6410e122007e req-db764f38-7b90-4df4-91ec-86d169abe45c service nova] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] No waiting events found dispatching network-vif-plugged-0ad31548-9664-4be8-9a83-56fa5ea2876a {{(pid=75080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 16:23:46 user nova-compute[75080]: WARNING nova.compute.manager [req-583afa75-e9e5-471a-89dc-6410e122007e req-db764f38-7b90-4df4-91ec-86d169abe45c service nova] [instance: 696fd8d7-2f17-466b-a2d4-ded76be1d278] Received unexpected event network-vif-plugged-0ad31548-9664-4be8-9a83-56fa5ea2876a for instance with vm_state deleted and task_state None.
Dec 05 16:23:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:23:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:24:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:24:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:24:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:24:15 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:24:19 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:24:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:24:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:24:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:24:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:24:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:24:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:24:20 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:24:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:24:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:24:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:24:20 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 16:24:20 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:24:20 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:24:20 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=9167MB free_disk=24.942947387695312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 16:24:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:24:20 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:24:20 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 16:24:20 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 16:24:21 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing inventories for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 05 16:24:21 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Updating ProviderTree inventory for provider 21b770fa-b774-46c9-9415-db26064ccd0f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 05 16:24:21 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Updating inventory in ProviderTree for provider 21b770fa-b774-46c9-9415-db26064ccd0f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 16:24:21 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing aggregate associations for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f, aggregates: None {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 05 16:24:21 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Refreshing trait associations for resource provider 21b770fa-b774-46c9-9415-db26064ccd0f, traits: COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=75080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 05 16:24:21 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 16:24:21 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 16:24:21 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 16:24:21 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.299s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:24:21 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:24:21 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Cleaning up deleted instances {{(pid=75080) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 05 16:24:21 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] There are 0 instances to clean {{(pid=75080) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 05 16:24:23 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:24:23 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:24:23 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 16:24:23 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:24:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:24:28 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:24:29 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:24:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:24:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:24:36 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:24:36 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:24:36 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 16:24:36 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Rebuilding the list of instances to heal {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 16:24:36 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Didn't find any instances for network info cache update. {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 16:24:37 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:24:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:24:41 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:24:42 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:24:45 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:24:48 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:24:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:24:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:24:57 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:24:57 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75080) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 05 16:25:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:25:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:25:07 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:25:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:25:15 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:25:19 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:25:20 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:25:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:25:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:25:22 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 16:25:22 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:25:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:25:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:25:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:25:22 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 16:25:22 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:25:22 user nova-compute[75080]: WARNING nova.virt.libvirt.driver [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 16:25:22 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Hypervisor/Node resource view: name=user free_ram=9275MB free_disk=24.93465805053711GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 16:25:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 16:25:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 16:25:22 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 16:25:22 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 16:25:22 user nova-compute[75080]: DEBUG nova.compute.provider_tree [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed in ProviderTree for provider: 21b770fa-b774-46c9-9415-db26064ccd0f {{(pid=75080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 16:25:22 user nova-compute[75080]: DEBUG nova.scheduler.client.report [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Inventory has not changed for provider 21b770fa-b774-46c9-9415-db26064ccd0f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 16:25:22 user nova-compute[75080]: DEBUG nova.compute.resource_tracker [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Compute_service record updated for user:user {{(pid=75080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 16:25:22 user nova-compute[75080]: DEBUG oslo_concurrency.lockutils [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.107s {{(pid=75080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 16:25:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:25:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:25:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 16:25:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:25:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 16:25:25 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:25:25 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:25:28 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:25:30 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:25:30 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:25:35 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:25:37 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:25:37 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Starting heal instance info cache {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 16:25:37 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Rebuilding the list of instances to heal {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 16:25:37 user nova-compute[75080]: DEBUG nova.compute.manager [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Didn't find any instances for network info cache update. {{(pid=75080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 16:25:40 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:25:42 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:25:45 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 16:25:50 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:25:55 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:25:57 user nova-compute[75080]: DEBUG oslo_service.periodic_task [None req-7ed6ed34-44c8-4dae-b01f-11adbd218cc5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 16:26:00 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:26:05 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 16:26:10 user nova-compute[75080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}